2024-09-11T14:08:30.721 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T14:08:30.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:08:30.838 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333 branch: wip-matanb-crimson-testing-sep11 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rados_api_tests} email: null first_in_suite: false job_id: '7901333' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-sep11 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd objectstore: seastore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: e7a65bf96d25c503998be3c193e951647cc62cab ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: e7a65bf96d25c503998be3c193e951647cc62cab selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 2853 sha1: e7a65bf96d25c503998be3c193e951647cc62cab sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBciRswQ6Ro+VTB/yWOGTrtyoye+vLL57GuiFMzBj8wQOo7TbNsy4YtjnD26OsXDKm0UBZiVgO40jU5l2cx8hkc= smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM65ieD3QnF3miVm7fi4RfvXicTvcGwCwVkGskEih49//jgWvjS2usKgIK18WhtMRpoLq4Ute2BfBdmCkxo3aCw= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_13:53:46 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T14:08:30.838 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-11T14:08:30.840 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-11T14:08:30.840 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T14:08:30.842 INFO:teuthology.task.internal:Checking packages... 2024-09-11T14:08:30.877 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash 'e7a65bf96d25c503998be3c193e951647cc62cab' 2024-09-11T14:08:30.878 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T14:08:30.878 INFO:teuthology.packaging:ref: None 2024-09-11T14:08:30.878 INFO:teuthology.packaging:tag: None 2024-09-11T14:08:30.878 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-sep11 2024-09-11T14:08:30.878 INFO:teuthology.packaging:sha1: e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:08:30.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-sep11 2024-09-11T14:08:31.022 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4884.ge7a65bf9 2024-09-11T14:08:31.023 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T14:08:31.031 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T14:08:31.031 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T14:08:31.081 INFO:teuthology.task.internal:Saving configuration 2024-09-11T14:08:31.093 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T14:08:31.108 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T14:08:31.127 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 14:03:30.877989', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBciRswQ6Ro+VTB/yWOGTrtyoye+vLL57GuiFMzBj8wQOo7TbNsy4YtjnD26OsXDKm0UBZiVgO40jU5l2cx8hkc='} 2024-09-11T14:08:31.146 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 14:03:30.876760', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM65ieD3QnF3miVm7fi4RfvXicTvcGwCwVkGskEih49//jgWvjS2usKgIK18WhtMRpoLq4Ute2BfBdmCkxo3aCw='} 2024-09-11T14:08:31.146 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T14:08:31.157 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-11T14:08:31.157 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T14:08:31.157 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T14:08:31.236 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1b06a97be0>, signals=[15]) 2024-09-11T14:08:31.236 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T14:08:31.247 INFO:teuthology.task.internal:Opening connections... 2024-09-11T14:08:31.248 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-09-11T14:08:31.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:08:31.364 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-09-11T14:08:31.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:08:31.439 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T14:08:31.450 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-09-11T14:08:31.468 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-09-11T14:08:31.468 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-09-11T14:08:31.526 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-09-11T14:08:31.526 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-09-11T14:08:31.526 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-09-11T14:08:31.526 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-09-11T14:08:31.526 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-09-11T14:08:31.526 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-09-11T14:08:31.526 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T14:08:31.526 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-09-11T14:08:31.527 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-09-11T14:08:31.527 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T14:08:31.527 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-09-11T14:08:31.527 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T14:08:31.527 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T14:08:31.527 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T14:08:31.528 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-09-11T14:08:31.546 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-09-11T14:08:31.564 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-09-11T14:08:31.565 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-09-11T14:08:31.623 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-09-11T14:08:31.623 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-09-11T14:08:31.623 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-09-11T14:08:31.623 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T14:08:31.624 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T14:08:31.625 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-09-11T14:08:31.646 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T14:08:31.657 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T14:08:31.680 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T14:08:31.680 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-09-11T14:08:31.682 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-09-11T14:08:31.699 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T14:08:31.707 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T14:08:31.707 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-09-11T14:08:31.740 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-09-11T14:08:31.766 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T14:08:31.821 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T14:08:31.836 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-11T14:08:31.836 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-11T14:08:31.837 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T14:08:31.837 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T14:08:31.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:08:31.853 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-11T14:08:31.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:08:31.854 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-11T14:08:31.912 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-503.el9.x86_64 2024-09-11T14:08:31.913 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-503.el9.x86_64 2024-09-11T14:08:31.913 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-09-11T14:08:31.914 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-503.el9.x86_64 2024-09-11T14:08:31.914 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.14.0-503.el9.x86_64 2024-09-11T14:08:31.914 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum install -y kernel 2024-09-11T14:08:35.385 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-11T14:08:35.862 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.2 MB 00:02 2024-09-11T14:08:37.137 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-11T14:08:37.730 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-11T14:08:42.462 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-11T14:08:43.064 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.5 MB 00:01 2024-09-11T14:08:43.888 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 117 kB/s | 19 kB 00:00 2024-09-11T14:08:44.606 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-11T14:08:44.658 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-11T14:08:45.760 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T14:08:50.315 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T14:08:51.315 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T14:08:52.388 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T14:08:52.388 INFO:teuthology.orchestra.run.smithi047.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T14:08:52.483 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:08:52.501 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:08:52.501 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-11T14:08:52.501 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:08:52.501 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:08:52.501 INFO:teuthology.orchestra.run.smithi047.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T14:08:52.501 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-11T14:08:52.501 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T14:08:52.501 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T14:08:52.501 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T14:08:52.502 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:08:52.502 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:08:52.502 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:08:52.502 INFO:teuthology.orchestra.run.smithi047.stdout:Install 4 Packages 2024-09-11T14:08:52.502 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:08:52.502 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 79 M 2024-09-11T14:08:52.502 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 126 M 2024-09-11T14:08:52.503 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:08:52.841 INFO:teuthology.orchestra.run.smithi047.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 250 kB/s | 23 kB 00:00 2024-09-11T14:08:53.275 INFO:teuthology.orchestra.run.smithi047.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-11T14:08:53.422 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T14:08:53.423 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T14:08:53.506 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:08:53.513 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:08:53.514 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-09-11T14:08:53.514 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:08:53.514 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 79 M 2024-09-11T14:08:53.514 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 126 M 2024-09-11T14:08:53.514 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:08:53.641 INFO:teuthology.orchestra.run.smithi047.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-11T14:08:53.650 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 269 kB/s | 23 kB 00:00 2024-09-11T14:08:53.942 INFO:teuthology.orchestra.run.smithi047.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-11T14:08:53.942 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:08:53.942 INFO:teuthology.orchestra.run.smithi047.stdout:Total 55 MB/s | 79 MB 00:01 2024-09-11T14:08:54.117 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-11T14:08:54.467 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 38 MB/s | 35 MB 00:00 2024-09-11T14:08:54.657 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:08:54.809 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-11T14:08:54.810 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:08:54.810 INFO:teuthology.orchestra.run.smithi046.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-11T14:08:55.028 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:08:55.028 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:08:55.521 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:08:55.905 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:08:55.905 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:08:56.038 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:08:56.038 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:08:56.908 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:08:56.908 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:08:58.592 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:08:59.261 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:08:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:08:59.508 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:09:00.179 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:09:00.268 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:09:02.148 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:09:02.270 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:09:03.084 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:09:03.212 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:09:07.394 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:09:07.445 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:08.377 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:09:08.422 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:12.617 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:13.560 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:51.672 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:51.712 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:52.090 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:52.090 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:09:52.090 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:09:52.090 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:09:52.752 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:52.795 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:52.906 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:09:52.907 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:09:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T14:09:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T14:09:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T14:09:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T14:09:52.907 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:09:52.907 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:09:53.197 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:53.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T14:09:53.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T14:09:53.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T14:09:53.231 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:09:53.323 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:09:53.323 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:09:53.323 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T14:09:53.323 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T14:09:53.324 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T14:09:53.324 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-11T14:09:53.324 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T14:09:53.324 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:09:53.382 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:09:53.382 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:09:53.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-09-11T14:09:53.414 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-09-11T14:09:53.414 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-09-11T14:09:53.414 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-09-11T14:09:53.414 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 82.el9 2024-09-11T14:09:53.414 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-09-11T14:09:53.414 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T14:09:53.414 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-09-11T14:09:53.414 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8274670 2024-09-11T14:09:53.414 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T14:09:53.415 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-09-11T14:09:53.416 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:09:53.416 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T14:09:53.416 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T14:09:53.417 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 5.14.0-505.el9.x86_64 2024-09-11T14:09:53.417 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T14:09:54.031 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-09-11T14:09:54.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T14:09:54.167 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:09:54.167 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:09:54.167 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T14:09:54.167 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T14:09:54.167 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T14:09:54.167 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T14:09:54.167 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:09:54.168 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:09:54.519 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:09:54.619 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:09:54.620 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:09:54.620 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T14:09:54.620 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T14:09:54.620 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T14:09:54.620 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T14:09:54.620 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T14:09:54.620 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T14:09:54.679 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T14:09:54.679 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T14:09:54.679 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-09-11T14:09:54.711 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-09-11T14:09:54.711 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-09-11T14:09:54.711 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-09-11T14:09:54.711 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 82.el9 2024-09-11T14:09:54.711 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-09-11T14:09:54.711 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T14:09:54.711 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-09-11T14:09:54.711 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8274670 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T14:09:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T14:09:54.713 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T14:09:54.713 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-09-11T14:09:54.713 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:09:54.713 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T14:09:54.714 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T14:09:54.714 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-505.el9.x86_64 2024-09-11T14:09:54.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T14:09:55.319 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-09-11T14:09:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T14:09:55.374 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-09-11T14:09:55.376 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-11T14:09:55.392 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.WbdGckPigj 2024-09-11T14:09:55.392 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WbdGckPigj 2024-09-11T14:09:55.464 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.WbdGckPigj 2024-09-11T14:09:55.609 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.WbdGckPigj is 6KB 2024-09-11T14:09:55.657 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.WbdGckPigj 2024-09-11T14:09:55.673 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T14:09:55.736 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T14:09:55.736 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T14:09:55.737 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T14:09:55.737 INFO:teuthology.orchestra.run.smithi047.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T14:09:55.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T14:09:55.879 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-09-11T14:09:56.706 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T14:09:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-09-11T14:09:56.733 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-09-11T14:09:56.748 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.vXWebBD2s1 2024-09-11T14:09:56.749 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vXWebBD2s1 2024-09-11T14:09:56.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.vXWebBD2s1 2024-09-11T14:09:56.952 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.vXWebBD2s1 is 6KB 2024-09-11T14:09:57.000 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.vXWebBD2s1 2024-09-11T14:09:57.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T14:09:57.076 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T14:09:57.077 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T14:09:57.077 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T14:09:57.077 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T14:09:57.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T14:09:57.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-09-11T14:10:25.909 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-11T14:10:25.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-11T14:10:25.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:10:27.250 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T14:10:27.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-11T14:10:27.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:10:44.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-09-11T14:10:45.693 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-11T14:10:53.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-11T14:10:53.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:10:54.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-11T14:10:54.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:10:57.757 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-11T14:11:09.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-11T14:11:09.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:11:53.466 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T14:12:05.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-11T14:12:05.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:12:05.805 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-11T14:12:06.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-11T14:12:06.175 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-11T14:12:06.175 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-11T14:12:06.193 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-505.el9.x86_64 2024-09-11T14:12:06.193 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T14:12:06.193 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T14:12:06.193 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T14:12:07.194 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-11T14:12:07.194 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T14:12:07.285 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-09-11T14:12:07.312 DEBUG:teuthology.parallel:result is None 2024-09-11T14:12:09.773 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T14:12:24.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-11T14:12:24.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:12:25.092 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-11T14:12:25.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-11T14:12:25.449 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T14:12:25.449 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-11T14:12:25.467 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-505.el9.x86_64 2024-09-11T14:12:25.467 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T14:12:25.467 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T14:12:25.467 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T14:12:26.468 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T14:12:26.468 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T14:12:26.552 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-09-11T14:12:26.574 DEBUG:teuthology.parallel:result is None 2024-09-11T14:12:26.575 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T14:12:26.582 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T14:12:26.582 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T14:12:26.585 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T14:12:26.604 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T14:12:26.626 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T14:12:26.659 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T14:12:26.659 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T14:12:26.662 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T14:12:26.692 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T14:12:26.700 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T14:12:26.701 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T14:12:26.730 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T14:12:26.768 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:12:26.770 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:12:26.780 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:12:26.782 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T14:12:26.784 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T14:12:26.791 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T14:12:26.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T14:12:26.824 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T14:12:26.853 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T14:12:26.863 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T14:12:26.863 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T14:12:26.893 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T14:12:26.912 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:12:26.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:12:27.046 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:12:27.129 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:12:27.176 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:12:27.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T14:12:27.242 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:12:27.283 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T14:12:27.342 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:12:27.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T14:12:27.471 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:12:27.471 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T14:12:27.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-09-11T14:12:27.541 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-09-11T14:12:27.589 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:12:27.622 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:12:28.007 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T14:12:28.015 INFO:teuthology.task.internal:Starting timer... 2024-09-11T14:12:28.015 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T14:12:28.057 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T14:12:28.106 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-11T14:12:28.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-09-11T14:12:28.148 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-09-11T14:12:28.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-09-11T14:12:28.226 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-09-11T14:12:28.228 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T14:12:28.228 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-09-11T14:12:28.256 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-09-11T14:12:28.256 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-09-11T14:12:28.284 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-09-11T14:12:28.284 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi047.front.sepia.ceph.com': 'permissive'} 2024-09-11T14:12:28.284 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:12:28.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:12:28.328 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:12:28.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:12:28.358 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T14:12:28.358 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-09-11T14:12:28.406 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-09-11T14:12:28.442 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T14:12:28.451 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T14:12:28.467 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T14:12:28.469 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi047.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T14:16:25.855 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi047.front.sepia.ceph.com')] 2024-09-11T14:16:25.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-11T14:16:25.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:16:25.935 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-11T14:16:26.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-11T14:16:26.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-11T14:16:26.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T14:16:26.097 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-11T14:16:26.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-11T14:16:26.177 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T14:16:26.192 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T14:16:26.193 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T14:16:26.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:16:26.197 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T14:16:26.198 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:16:26.227 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T14:16:26.243 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T14:16:26.251 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T14:16:26.267 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T14:16:26.269 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-09-11T14:16:26.281 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-09-11T14:16:26.293 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-09-11T14:16:26.296 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T14:16:26.305 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-09-11T14:16:26.311 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T14:16:26.320 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T14:16:26.335 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T14:16:26.367 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:16:26.371 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:16:26.371 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-11T14:16:26.371 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:16:26.371 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:16:26.371 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:16:26.371 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:16:26.394 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:16:26.398 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:16:26.398 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-11T14:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:16:26.399 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:16:26.399 INFO:teuthology.run_tasks:Running task install... 2024-09-11T14:16:26.407 DEBUG:teuthology.task.install:project ceph 2024-09-11T14:16:26.407 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'}} 2024-09-11T14:16:26.408 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'} 2024-09-11T14:16:26.408 INFO:teuthology.task.install:Using flavor: crimson 2024-09-11T14:16:26.417 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T14:16:26.418 INFO:teuthology.task.install:extra packages: [] 2024-09-11T14:16:26.418 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'tag': None, 'wait_for_package': False} 2024-09-11T14:16:26.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:16:26.422 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'tag': None, 'wait_for_package': False} 2024-09-11T14:16:26.423 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:16:26.569 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/ 2024-09-11T14:16:26.569 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4884.ge7a65bf9 2024-09-11T14:16:26.573 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/ 2024-09-11T14:16:26.573 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4884.ge7a65bf9 2024-09-11T14:16:26.679 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T14:16:26.680 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:16:26.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T14:16:26.691 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-sep11/e7a65bf96d25c503998be3c193e951647cc62cab/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T14:16:26.691 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:16:26.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T14:16:26.706 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T14:16:26.707 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e7a65bf96d25c503998be3c193e951647cc62cab/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T14:16:26.719 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T14:16:26.719 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e7a65bf96d25c503998be3c193e951647cc62cab/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T14:16:26.774 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T14:16:26.786 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T14:16:26.852 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T14:16:26.863 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T14:16:26.918 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-09-11T14:16:26.920 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-09-11T14:16:26.928 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-09-11T14:16:26.930 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-09-11T14:16:27.152 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-09-11T14:16:27.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw 2024-09-11T14:16:27.182 INFO:teuthology.orchestra.run.smithi046.stdout:45 files removed 2024-09-11T14:16:27.209 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw 2024-09-11T14:16:27.739 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 340 kB/s | 89 kB 00:00 2024-09-11T14:16:27.802 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 302 kB/s | 89 kB 00:00 2024-09-11T14:16:28.040 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-11T14:16:28.094 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-11T14:16:28.324 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 8.5 kB/s | 2.1 kB 00:00 2024-09-11T14:16:28.370 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 8.8 kB/s | 2.1 kB 00:00 2024-09-11T14:16:28.828 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-11T14:16:29.057 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-11T14:16:33.334 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 20 MB 00:03 2024-09-11T14:16:37.835 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-11T14:16:39.519 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-11T14:16:40.431 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T14:16:46.062 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T14:16:48.517 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:16:48.531 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:16:48.531 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:16:48.531 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:16:48.531 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 10 M 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.8 M 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.1 M 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 20 M 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 25 k 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T14:16:48.532 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 808 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 557 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.4 M 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T14:16:48.533 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 45 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 143 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 160 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 315 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 303 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 99 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T14:16:48.534 INFO:teuthology.orchestra.run.smithi047.stdout:Installing weak dependencies: 2024-09-11T14:16:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T14:16:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:16:48.535 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:16:48.535 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:16:48.535 INFO:teuthology.orchestra.run.smithi047.stdout:Install 31 Packages 2024-09-11T14:16:48.535 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 2 Packages 2024-09-11T14:16:48.535 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:16:48.535 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 60 M 2024-09-11T14:16:48.536 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:16:48.979 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-11T14:16:49.780 INFO:teuthology.orchestra.run.smithi047.stdout:(1/33): ceph-base-19.3.0-4884.ge7a65bf9.el9.x86 12 MB/s | 6.1 MB 00:00 2024-09-11T14:16:49.830 INFO:teuthology.orchestra.run.smithi047.stdout:(2/33): ceph-selinux-19.3.0-4884.ge7a65bf9.el9. 506 kB/s | 25 kB 00:00 2024-09-11T14:16:49.931 INFO:teuthology.orchestra.run.smithi047.stdout:(3/33): libcephfs2-19.3.0-4884.ge7a65bf9.el9.x8 7.9 MB/s | 808 kB 00:00 2024-09-11T14:16:50.040 INFO:teuthology.orchestra.run.smithi047.stdout:(4/33): libradosstriper1-19.3.0-4884.ge7a65bf9. 5.0 MB/s | 557 kB 00:00 2024-09-11T14:16:50.240 INFO:teuthology.orchestra.run.smithi047.stdout:(5/33): ceph-common-19.3.0-4884.ge7a65bf9.el9.x 20 MB/s | 20 MB 00:00 2024-09-11T14:16:50.290 INFO:teuthology.orchestra.run.smithi047.stdout:(6/33): python3-ceph-argparse-19.3.0-4884.ge7a6 907 kB/s | 45 kB 00:00 2024-09-11T14:16:50.399 INFO:teuthology.orchestra.run.smithi047.stdout:(7/33): ceph-radosgw-19.3.0-4884.ge7a65bf9.el9. 9.1 MB/s | 10 MB 00:01 2024-09-11T14:16:50.424 INFO:teuthology.orchestra.run.smithi047.stdout:(8/33): python3-ceph-common-19.3.0-4884.ge7a65b 1.0 MB/s | 143 kB 00:00 2024-09-11T14:16:50.449 INFO:teuthology.orchestra.run.smithi047.stdout:(9/33): python3-cephfs-19.3.0-4884.ge7a65bf9.el 3.1 MB/s | 160 kB 00:00 2024-09-11T14:16:50.474 INFO:teuthology.orchestra.run.smithi047.stdout:(10/33): python3-rados-19.3.0-4884.ge7a65bf9.el 6.1 MB/s | 315 kB 00:00 2024-09-11T14:16:50.500 INFO:teuthology.orchestra.run.smithi047.stdout:(11/33): python3-rbd-19.3.0-4884.ge7a65bf9.el9. 5.9 MB/s | 303 kB 00:00 2024-09-11T14:16:50.525 INFO:teuthology.orchestra.run.smithi047.stdout:(12/33): python3-rgw-19.3.0-4884.ge7a65bf9.el9. 1.9 MB/s | 99 kB 00:00 2024-09-11T14:16:50.609 INFO:teuthology.orchestra.run.smithi047.stdout:(13/33): librgw2-19.3.0-4884.ge7a65bf9.el9.x86_ 9.5 MB/s | 5.4 MB 00:00 2024-09-11T14:16:51.001 INFO:teuthology.orchestra.run.smithi047.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 213 kB/s | 107 kB 00:00 2024-09-11T14:16:51.092 INFO:teuthology.orchestra.run.smithi047.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 301 kB/s | 171 kB 00:00 2024-09-11T14:16:51.118 INFO:teuthology.orchestra.run.smithi047.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-11T14:16:51.218 INFO:teuthology.orchestra.run.smithi047.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 263 kB/s | 160 kB 00:00 2024-09-11T14:16:51.326 INFO:teuthology.orchestra.run.smithi047.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 391 kB/s | 42 kB 00:00 2024-09-11T14:16:51.402 INFO:teuthology.orchestra.run.smithi047.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-09-11T14:16:51.477 INFO:teuthology.orchestra.run.smithi047.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 1.7 MB/s | 662 kB 00:00 2024-09-11T14:16:51.510 INFO:teuthology.orchestra.run.smithi047.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 330 kB/s | 36 kB 00:00 2024-09-11T14:16:51.561 INFO:teuthology.orchestra.run.smithi047.stdout:(22/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 6.0 MB/s | 309 kB 00:00 2024-09-11T14:16:51.586 INFO:teuthology.orchestra.run.smithi047.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-11T14:16:51.645 INFO:teuthology.orchestra.run.smithi047.stdout:(24/33): qatlib-24.02.0-1.el9.x86_64.rpm 694 kB/s | 221 kB 00:00 2024-09-11T14:16:51.678 INFO:teuthology.orchestra.run.smithi047.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-09-11T14:16:51.704 INFO:teuthology.orchestra.run.smithi047.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 861 kB/s | 49 kB 00:00 2024-09-11T14:16:51.729 INFO:teuthology.orchestra.run.smithi047.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-11T14:16:51.762 INFO:teuthology.orchestra.run.smithi047.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-11T14:16:51.804 INFO:teuthology.orchestra.run.smithi047.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-11T14:16:51.863 INFO:teuthology.orchestra.run.smithi047.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T14:16:51.947 INFO:teuthology.orchestra.run.smithi047.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-11T14:16:52.063 INFO:teuthology.orchestra.run.smithi047.stdout:(32/33): librados2-19.3.0-4884.ge7a65bf9.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-11T14:16:52.172 INFO:teuthology.orchestra.run.smithi047.stdout:(33/33): librbd1-19.3.0-4884.ge7a65bf9.el9.x86_ 12 MB/s | 3.8 MB 00:00 2024-09-11T14:16:52.178 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:16:52.178 INFO:teuthology.orchestra.run.smithi047.stdout:Total 17 MB/s | 60 MB 00:03 2024-09-11T14:16:52.294 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:16:52.336 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:16:52.336 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:16:53.061 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:16:53.061 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:16:54.642 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:16:55.169 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T14:16:55.252 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:16:55.350 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:16:55.451 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:16:55.476 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:16:55.522 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:16:55.570 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-11T14:16:55.588 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-11T14:16:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-11T14:16:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-11T14:16:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:16:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:16:55.856 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:16:55.887 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:16:55.932 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-11T14:16:55.975 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 11/35 2024-09-11T14:16:56.003 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:16:56.093 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-11T14:16:56.116 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:16:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:16:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-11T14:16:56.350 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-11T14:16:56.383 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-11T14:16:56.424 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-11T14:16:56.448 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 19/35 2024-09-11T14:16:56.477 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-11T14:16:56.513 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-11T14:16:56.888 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T14:16:56.948 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:16:57.040 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:16:57.069 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 24/35 2024-09-11T14:16:57.106 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T14:16:57.157 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-11T14:16:57.723 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T14:16:57.750 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:16:57.822 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:16:57.903 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 28/35 2024-09-11T14:16:57.928 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 29/35 2024-09-11T14:16:58.226 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-11T14:17:00.535 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:17:00.574 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:17:01.300 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:17:01.344 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:17:01.419 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:17:01.419 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T14:17:01.419 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T14:17:01.419 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:01.453 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:17:03.882 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-11T14:17:06.354 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:17:06.357 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:17:06.357 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:17:06.357 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:17:06.358 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:17:06.358 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 10 M 2024-09-11T14:17:06.358 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-09-11T14:17:06.359 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:17:06.359 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.8 M 2024-09-11T14:17:06.359 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-11T14:17:06.359 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T14:17:06.359 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.1 M 2024-09-11T14:17:06.360 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 20 M 2024-09-11T14:17:06.360 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 25 k 2024-09-11T14:17:06.360 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T14:17:06.360 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T14:17:06.360 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T14:17:06.361 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 808 k 2024-09-11T14:17:06.361 INFO:teuthology.orchestra.run.smithi046.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T14:17:06.361 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T14:17:06.361 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T14:17:06.361 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T14:17:06.362 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 557 k 2024-09-11T14:17:06.362 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T14:17:06.362 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.4 M 2024-09-11T14:17:06.362 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T14:17:06.362 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T14:17:06.363 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T14:17:06.363 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 45 k 2024-09-11T14:17:06.363 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 143 k 2024-09-11T14:17:06.363 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 160 k 2024-09-11T14:17:06.363 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T14:17:06.363 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 315 k 2024-09-11T14:17:06.364 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 303 k 2024-09-11T14:17:06.364 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 99 k 2024-09-11T14:17:06.364 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T14:17:06.364 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T14:17:06.365 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T14:17:06.365 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T14:17:06.365 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-09-11T14:17:06.365 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T14:17:06.365 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:06.365 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:17:06.366 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:17:06.366 INFO:teuthology.orchestra.run.smithi046.stdout:Install 31 Packages 2024-09-11T14:17:06.366 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 2 Packages 2024-09-11T14:17:06.366 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:06.367 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 60 M 2024-09-11T14:17:06.367 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:17:07.134 INFO:teuthology.orchestra.run.smithi046.stdout:(1/33): ceph-base-19.3.0-4884.ge7a65bf9.el9.x86 10 MB/s | 6.1 MB 00:00 2024-09-11T14:17:07.192 INFO:teuthology.orchestra.run.smithi046.stdout:(2/33): ceph-selinux-19.3.0-4884.ge7a65bf9.el9. 432 kB/s | 25 kB 00:00 2024-09-11T14:17:07.292 INFO:teuthology.orchestra.run.smithi046.stdout:(3/33): libcephfs2-19.3.0-4884.ge7a65bf9.el9.x8 7.9 MB/s | 808 kB 00:00 2024-09-11T14:17:07.409 INFO:teuthology.orchestra.run.smithi046.stdout:(4/33): ceph-radosgw-19.3.0-4884.ge7a65bf9.el9. 12 MB/s | 10 MB 00:00 2024-09-11T14:17:07.443 INFO:teuthology.orchestra.run.smithi046.stdout:(5/33): libradosstriper1-19.3.0-4884.ge7a65bf9. 3.6 MB/s | 557 kB 00:00 2024-09-11T14:17:07.502 INFO:teuthology.orchestra.run.smithi046.stdout:(6/33): python3-ceph-argparse-19.3.0-4884.ge7a6 773 kB/s | 45 kB 00:00 2024-09-11T14:17:07.711 INFO:teuthology.orchestra.run.smithi046.stdout:(7/33): ceph-common-19.3.0-4884.ge7a65bf9.el9.x 17 MB/s | 20 MB 00:01 2024-09-11T14:17:07.736 INFO:teuthology.orchestra.run.smithi046.stdout:(8/33): python3-ceph-common-19.3.0-4884.ge7a65b 612 kB/s | 143 kB 00:00 2024-09-11T14:17:07.769 INFO:teuthology.orchestra.run.smithi046.stdout:(9/33): python3-cephfs-19.3.0-4884.ge7a65bf9.el 2.7 MB/s | 160 kB 00:00 2024-09-11T14:17:07.794 INFO:teuthology.orchestra.run.smithi046.stdout:(10/33): python3-rados-19.3.0-4884.ge7a65bf9.el 5.3 MB/s | 315 kB 00:00 2024-09-11T14:17:07.820 INFO:teuthology.orchestra.run.smithi046.stdout:(11/33): python3-rbd-19.3.0-4884.ge7a65bf9.el9. 5.9 MB/s | 303 kB 00:00 2024-09-11T14:17:07.845 INFO:teuthology.orchestra.run.smithi046.stdout:(12/33): python3-rgw-19.3.0-4884.ge7a65bf9.el9. 1.9 MB/s | 99 kB 00:00 2024-09-11T14:17:07.937 INFO:teuthology.orchestra.run.smithi046.stdout:(13/33): librgw2-19.3.0-4884.ge7a65bf9.el9.x86_ 10 MB/s | 5.4 MB 00:00 2024-09-11T14:17:08.021 INFO:teuthology.orchestra.run.smithi046.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 533 kB/s | 107 kB 00:00 2024-09-11T14:17:08.046 INFO:teuthology.orchestra.run.smithi046.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 851 kB/s | 171 kB 00:00 2024-09-11T14:17:08.063 INFO:teuthology.orchestra.run.smithi046.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-11T14:17:08.088 INFO:teuthology.orchestra.run.smithi046.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-11T14:17:08.122 INFO:teuthology.orchestra.run.smithi046.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 42 kB 00:00 2024-09-11T14:17:08.147 INFO:teuthology.orchestra.run.smithi046.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-11T14:17:08.189 INFO:teuthology.orchestra.run.smithi046.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-11T14:17:08.214 INFO:teuthology.orchestra.run.smithi046.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 537 kB/s | 36 kB 00:00 2024-09-11T14:17:08.239 INFO:teuthology.orchestra.run.smithi046.stdout:(22/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.3 MB/s | 662 kB 00:00 2024-09-11T14:17:08.265 INFO:teuthology.orchestra.run.smithi046.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-11T14:17:08.323 INFO:teuthology.orchestra.run.smithi046.stdout:(24/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.8 MB/s | 309 kB 00:00 2024-09-11T14:17:08.348 INFO:teuthology.orchestra.run.smithi046.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T14:17:08.374 INFO:teuthology.orchestra.run.smithi046.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 280 kB/s | 26 kB 00:00 2024-09-11T14:17:08.399 INFO:teuthology.orchestra.run.smithi046.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T14:17:08.424 INFO:teuthology.orchestra.run.smithi046.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-11T14:17:08.483 INFO:teuthology.orchestra.run.smithi046.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-11T14:17:08.525 INFO:teuthology.orchestra.run.smithi046.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T14:17:08.609 INFO:teuthology.orchestra.run.smithi046.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-11T14:17:08.742 INFO:teuthology.orchestra.run.smithi046.stdout:(32/33): librados2-19.3.0-4884.ge7a65bf9.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-11T14:17:08.809 INFO:teuthology.orchestra.run.smithi046.stdout:(33/33): librbd1-19.3.0-4884.ge7a65bf9.el9.x86_ 13 MB/s | 3.8 MB 00:00 2024-09-11T14:17:08.814 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:17:08.814 INFO:teuthology.orchestra.run.smithi046.stdout:Total 25 MB/s | 60 MB 00:02 2024-09-11T14:17:08.932 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:17:08.974 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:17:08.974 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:17:09.654 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:17:09.654 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:17:11.227 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:17:11.746 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T14:17:11.813 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:17:11.906 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:17:11.997 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:17:12.023 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:17:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:17:12.135 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-11T14:17:12.169 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-11T14:17:12.194 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-11T14:17:12.217 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:17:12.243 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-11T14:17:12.454 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:17:12.483 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-11T14:17:12.519 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-11T14:17:12.571 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 11/35 2024-09-11T14:17:12.600 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-09-11T14:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-09-11T14:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-09-11T14:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-09-11T14:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-09-11T14:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-09-11T14:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-09-11T14:17:12.609 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:12.682 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-11T14:17:12.705 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:17:12.785 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 14/35 2024-09-11T14:17:12.821 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-11T14:17:12.930 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-11T14:17:12.964 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-11T14:17:13.004 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-11T14:17:13.036 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 19/35 2024-09-11T14:17:13.066 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-11T14:17:13.102 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-11T14:17:13.475 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T14:17:13.528 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:17:13.620 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 23/35 2024-09-11T14:17:13.658 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 24/35 2024-09-11T14:17:13.695 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T14:17:13.736 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:17:13.763 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:17:13.763 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:17:13.763 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T14:17:13.763 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:17:13.763 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:17:13.763 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:13.765 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:17:13.847 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:17:13.847 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:17:14.319 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T14:17:14.347 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:17:14.419 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 27/35 2024-09-11T14:17:14.491 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 28/35 2024-09-11T14:17:14.533 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 29/35 2024-09-11T14:17:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:17:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/35 2024-09-11T14:17:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:17:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 6/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 7/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 8/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 9/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 10/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 11/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 13/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T14:17:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T14:17:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T14:17:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T14:17:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T14:17:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T14:17:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T14:17:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:17:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T14:17:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/35 2024-09-11T14:17:16.030 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:17:16.030 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:16.030 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-09-11T14:17:16.030 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.030 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.030 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:17:16.030 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T14:17:16.030 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.030 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T14:17:16.031 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T14:17:16.032 INFO:teuthology.orchestra.run.smithi047.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T14:17:16.033 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T14:17:16.033 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T14:17:16.033 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:16.033 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:17:16.385 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-test 2024-09-11T14:17:16.970 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:30 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:17:17.111 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:17:17.112 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:17:17.112 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:17:17.112 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:17:17.112 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:17:17.112 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 85 M 2024-09-11T14:17:17.112 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-11T14:17:17.112 INFO:teuthology.orchestra.run.smithi047.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-11T14:17:17.112 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 175 k 2024-09-11T14:17:17.112 INFO:teuthology.orchestra.run.smithi047.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout:Install 9 Packages 2024-09-11T14:17:17.113 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:17.114 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 87 M 2024-09-11T14:17:17.114 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 797 M 2024-09-11T14:17:17.114 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:17:17.139 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:17:17.180 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:17:17.626 INFO:teuthology.orchestra.run.smithi047.stdout:(1/9): libcephsqlite-19.3.0-4884.ge7a65bf9.el9. 577 kB/s | 175 kB 00:00 2024-09-11T14:17:17.777 INFO:teuthology.orchestra.run.smithi047.stdout:(2/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 207 kB/s | 94 kB 00:00 2024-09-11T14:17:17.906 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 30/35 2024-09-11T14:17:17.966 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:17:18.042 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 31/35 2024-09-11T14:17:18.042 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T14:17:18.042 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T14:17:18.042 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:18.076 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:17:18.694 INFO:teuthology.orchestra.run.smithi047.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 481 kB/s | 513 kB 00:01 2024-09-11T14:17:19.036 INFO:teuthology.orchestra.run.smithi047.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 145 kB/s | 183 kB 00:01 2024-09-11T14:17:19.820 INFO:teuthology.orchestra.run.smithi047.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 918 kB/s | 1.0 MB 00:01 2024-09-11T14:17:19.961 INFO:teuthology.orchestra.run.smithi047.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 332 kB/s | 304 kB 00:00 2024-09-11T14:17:20.003 INFO:teuthology.orchestra.run.smithi047.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2024-09-11T14:17:20.503 INFO:teuthology.orchestra.run.smithi047.stdout:(8/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-09-11T14:17:21.329 INFO:teuthology.orchestra.run.smithi047.stdout:(9/9): ceph-test-19.3.0-4884.ge7a65bf9.el9.x86_ 21 MB/s | 85 MB 00:04 2024-09-11T14:17:21.332 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:17:21.332 INFO:teuthology.orchestra.run.smithi047.stdout:Total 21 MB/s | 87 MB 00:04 2024-09-11T14:17:21.418 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:17:21.444 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:17:21.444 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:17:22.076 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:17:22.077 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:17:23.012 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:17:23.077 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-11T14:17:23.131 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-11T14:17:23.184 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-11T14:17:23.215 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-11T14:17:23.250 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:17:23.274 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:17:23.345 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:17:23.400 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-11T14:17:23.434 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:17:29.114 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:17:29.115 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-09-11T14:17:29.115 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-09-11T14:17:29.115 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-09-11T14:17:29.115 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-09-11T14:17:29.115 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-09-11T14:17:29.115 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-09-11T14:17:29.115 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-09-11T14:17:29.115 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:30.253 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:17:30.280 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/35 2024-09-11T14:17:30.281 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:17:30.281 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T14:17:30.281 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:17:30.281 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T14:17:30.281 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:30.282 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:17:30.389 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T14:17:30.390 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:17:31.643 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_6 6/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 7/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9. 8/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x8 9/35 2024-09-11T14:17:31.644 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 10/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 11/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 12/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 13/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T14:17:31.645 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T14:17:31.646 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T14:17:31.646 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T14:17:31.646 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T14:17:31.646 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T14:17:31.646 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T14:17:31.646 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T14:17:31.646 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T14:17:31.646 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T14:17:31.647 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T14:17:31.647 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T14:17:31.647 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T14:17:31.648 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 32/35 2024-09-11T14:17:31.648 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T14:17:31.648 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/35 2024-09-11T14:17:32.556 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T14:17:32.556 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:32.556 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-09-11T14:17:32.556 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.556 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.556 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:17:32.556 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T14:17:32.557 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:32.558 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T14:17:32.559 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T14:17:32.559 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T14:17:32.559 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T14:17:32.559 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T14:17:32.559 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:32.559 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:17:32.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-test 2024-09-11T14:17:33.505 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:30 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:17:33.645 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:17:33.646 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:17:33.646 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:17:33.646 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:17:33.646 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:17:33.646 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 85 M 2024-09-11T14:17:33.646 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-11T14:17:33.646 INFO:teuthology.orchestra.run.smithi046.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 175 k 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout:Install 9 Packages 2024-09-11T14:17:33.647 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:33.648 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 87 M 2024-09-11T14:17:33.648 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 797 M 2024-09-11T14:17:33.648 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:17:34.461 INFO:teuthology.orchestra.run.smithi046.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 539 kB/s | 94 kB 00:00 2024-09-11T14:17:34.511 INFO:teuthology.orchestra.run.smithi046.stdout:(2/9): libcephsqlite-19.3.0-4884.ge7a65bf9.el9. 778 kB/s | 175 kB 00:00 2024-09-11T14:17:34.711 INFO:teuthology.orchestra.run.smithi046.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 914 kB/s | 183 kB 00:00 2024-09-11T14:17:34.745 INFO:teuthology.orchestra.run.smithi046.stdout:(4/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 1.8 MB/s | 513 kB 00:00 2024-09-11T14:17:34.804 INFO:teuthology.orchestra.run.smithi046.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-11T14:17:34.854 INFO:teuthology.orchestra.run.smithi046.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-11T14:17:34.904 INFO:teuthology.orchestra.run.smithi046.stdout:(7/9): protobuf-3.14.0-13.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2024-09-11T14:17:34.921 INFO:teuthology.orchestra.run.smithi046.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-11T14:17:35.293 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:17:35.378 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:17:36.730 INFO:teuthology.orchestra.run.smithi046.stdout:(9/9): ceph-test-19.3.0-4884.ge7a65bf9.el9.x86_ 35 MB/s | 85 MB 00:02 2024-09-11T14:17:36.733 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:17:36.734 INFO:teuthology.orchestra.run.smithi046.stdout:Total 28 MB/s | 87 MB 00:03 2024-09-11T14:17:36.821 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:17:36.847 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:17:36.847 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:17:37.480 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:17:37.480 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:17:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:17:38.479 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-11T14:17:38.525 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-11T14:17:38.569 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-11T14:17:38.605 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-11T14:17:38.643 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:17:38.667 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:17:38.741 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-11T14:17:38.784 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-11T14:17:38.819 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:17:41.191 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:17:41.191 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/9 2024-09-11T14:17:41.191 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/9 2024-09-11T14:17:41.191 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-11T14:17:41.191 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-11T14:17:41.191 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:17:41.191 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-11T14:17:41.191 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-11T14:17:41.191 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T14:17:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T14:17:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-11T14:17:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:41.580 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:17:41.889 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph 2024-09-11T14:17:42.471 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:56 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:17:42.612 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:17:42.614 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:17:42.614 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:17:42.614 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:17:42.614 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:17:42.614 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.5 k 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 2.2 M 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 1.6 M 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 291 k 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.1 M 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 70 M 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T14:17:42.615 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T14:17:42.616 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:17:42.617 INFO:teuthology.orchestra.run.smithi047.stdout:Install 37 Packages 2024-09-11T14:17:42.618 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:42.618 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 84 M 2024-09-11T14:17:42.618 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 896 M 2024-09-11T14:17:42.618 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:17:43.178 INFO:teuthology.orchestra.run.smithi047.stdout:(1/37): ceph-19.3.0-4884.ge7a65bf9.el9.x86_64.r 32 kB/s | 6.5 kB 00:00 2024-09-11T14:17:43.728 INFO:teuthology.orchestra.run.smithi047.stdout:(2/37): ceph-mgr-19.3.0-4884.ge7a65bf9.el9.x86_ 2.1 MB/s | 1.6 MB 00:00 2024-09-11T14:17:43.895 INFO:teuthology.orchestra.run.smithi047.stdout:(3/37): ceph-mds-19.3.0-4884.ge7a65bf9.el9.x86_ 2.4 MB/s | 2.2 MB 00:00 2024-09-11T14:17:44.045 INFO:teuthology.orchestra.run.smithi047.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4884.ge7a6 1.9 MB/s | 291 kB 00:00 2024-09-11T14:17:44.271 INFO:teuthology.orchestra.run.smithi047.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-11T14:17:44.429 INFO:teuthology.orchestra.run.smithi047.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 7.8 MB/s | 1.2 MB 00:00 2024-09-11T14:17:44.479 INFO:teuthology.orchestra.run.smithi047.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-11T14:17:44.563 INFO:teuthology.orchestra.run.smithi047.stdout:(8/37): ceph-mon-19.3.0-4884.ge7a65bf9.el9.x86_ 3.7 MB/s | 5.1 MB 00:01 2024-09-11T14:17:44.605 INFO:teuthology.orchestra.run.smithi047.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-11T14:17:44.664 INFO:teuthology.orchestra.run.smithi047.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-11T14:17:44.722 INFO:teuthology.orchestra.run.smithi047.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-11T14:17:44.747 INFO:teuthology.orchestra.run.smithi047.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 678 kB/s | 125 kB 00:00 2024-09-11T14:17:44.781 INFO:teuthology.orchestra.run.smithi047.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T14:17:44.806 INFO:teuthology.orchestra.run.smithi047.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 593 kB/s | 35 kB 00:00 2024-09-11T14:17:44.831 INFO:teuthology.orchestra.run.smithi047.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-11T14:17:44.857 INFO:teuthology.orchestra.run.smithi047.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T14:17:44.882 INFO:teuthology.orchestra.run.smithi047.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-11T14:17:44.916 INFO:teuthology.orchestra.run.smithi047.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 379 kB/s | 22 kB 00:00 2024-09-11T14:17:44.949 INFO:teuthology.orchestra.run.smithi047.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-11T14:17:44.975 INFO:teuthology.orchestra.run.smithi047.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 767 kB/s | 43 kB 00:00 2024-09-11T14:17:45.000 INFO:teuthology.orchestra.run.smithi047.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.5 MB/s | 172 kB 00:00 2024-09-11T14:17:45.025 INFO:teuthology.orchestra.run.smithi047.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 426 kB/s | 11 kB 00:00 2024-09-11T14:17:45.050 INFO:teuthology.orchestra.run.smithi047.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 710 kB/s | 18 kB 00:00 2024-09-11T14:17:45.076 INFO:teuthology.orchestra.run.smithi047.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 925 kB/s | 23 kB 00:00 2024-09-11T14:17:45.101 INFO:teuthology.orchestra.run.smithi047.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 778 kB/s | 19 kB 00:00 2024-09-11T14:17:45.126 INFO:teuthology.orchestra.run.smithi047.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 792 kB/s | 20 kB 00:00 2024-09-11T14:17:45.151 INFO:teuthology.orchestra.run.smithi047.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-09-11T14:17:45.177 INFO:teuthology.orchestra.run.smithi047.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-11T14:17:45.202 INFO:teuthology.orchestra.run.smithi047.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T14:17:45.228 INFO:teuthology.orchestra.run.smithi047.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 661 kB/s | 16 kB 00:00 2024-09-11T14:17:45.253 INFO:teuthology.orchestra.run.smithi047.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-11T14:17:45.278 INFO:teuthology.orchestra.run.smithi047.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-11T14:17:45.304 INFO:teuthology.orchestra.run.smithi047.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 710 kB/s | 36 kB 00:00 2024-09-11T14:17:45.329 INFO:teuthology.orchestra.run.smithi047.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-11T14:17:45.354 INFO:teuthology.orchestra.run.smithi047.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-11T14:17:45.380 INFO:teuthology.orchestra.run.smithi047.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-11T14:17:48.055 INFO:teuthology.orchestra.run.smithi047.stdout:(37/37): ceph-osd-19.3.0-4884.ge7a65bf9.el9.x86 16 MB/s | 70 MB 00:04 2024-09-11T14:17:48.059 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:17:48.060 INFO:teuthology.orchestra.run.smithi047.stdout:Total 15 MB/s | 84 MB 00:05 2024-09-11T14:17:48.214 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:17:48.260 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:17:48.260 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:17:49.123 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:17:49.124 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:17:50.747 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 8/9 2024-09-11T14:17:50.837 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:17:50.946 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:17:51.007 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T14:17:51.041 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T14:17:51.071 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T14:17:51.146 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T14:17:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T14:17:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T14:17:51.457 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T14:17:51.534 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T14:17:51.581 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T14:17:51.616 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T14:17:51.645 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T14:17:51.680 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T14:17:51.714 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T14:17:51.754 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T14:17:51.797 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T14:17:51.831 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T14:17:51.906 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T14:17:51.968 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T14:17:52.055 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T14:17:52.206 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T14:17:52.289 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T14:17:52.474 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T14:17:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T14:17:52.570 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T14:17:52.634 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T14:17:52.828 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T14:17:52.874 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T14:17:52.955 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T14:17:53.047 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T14:17:53.084 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T14:17:53.219 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T14:17:53.421 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 32/37 2024-09-11T14:17:53.461 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:17:53.489 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:17:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:17:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T14:17:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:17:53.489 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:17:53.489 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:17:57.047 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 9/9 2024-09-11T14:17:57.048 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/9 2024-09-11T14:17:57.048 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/9 2024-09-11T14:17:57.048 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-11T14:17:57.048 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-11T14:17:57.048 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-11T14:17:57.048 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-11T14:17:57.048 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-11T14:17:57.048 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-11T14:17:57.448 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-11T14:17:57.448 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:57.448 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:17:57.448 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:57.449 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:17:57.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph 2024-09-11T14:17:58.376 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:55 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:17:58.520 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:17:58.522 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 6.5 k 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 2.2 M 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 1.6 M 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 291 k 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 5.1 M 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 70 M 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T14:17:58.523 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T14:17:58.524 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T14:17:58.525 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout:Install 37 Packages 2024-09-11T14:17:58.526 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:17:58.527 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 84 M 2024-09-11T14:17:58.527 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 896 M 2024-09-11T14:17:58.527 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:17:59.069 INFO:teuthology.orchestra.run.smithi046.stdout:(1/37): ceph-19.3.0-4884.ge7a65bf9.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-11T14:17:59.278 INFO:teuthology.orchestra.run.smithi046.stdout:(2/37): ceph-mds-19.3.0-4884.ge7a65bf9.el9.x86_ 6.4 MB/s | 2.2 MB 00:00 2024-09-11T14:17:59.312 INFO:teuthology.orchestra.run.smithi046.stdout:(3/37): ceph-mgr-19.3.0-4884.ge7a65bf9.el9.x86_ 4.2 MB/s | 1.6 MB 00:00 2024-09-11T14:17:59.387 INFO:teuthology.orchestra.run.smithi046.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4884.ge7a6 3.8 MB/s | 291 kB 00:00 2024-09-11T14:17:59.495 INFO:teuthology.orchestra.run.smithi046.stdout:(5/37): ceph-mon-19.3.0-4884.ge7a65bf9.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-11T14:17:59.954 INFO:teuthology.orchestra.run.smithi046.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 446 kB/s | 253 kB 00:00 2024-09-11T14:18:00.071 INFO:teuthology.orchestra.run.smithi046.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 915 kB/s | 106 kB 00:00 2024-09-11T14:18:00.188 INFO:teuthology.orchestra.run.smithi046.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-11T14:18:00.305 INFO:teuthology.orchestra.run.smithi046.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.0 MB/s | 125 kB 00:00 2024-09-11T14:18:00.422 INFO:teuthology.orchestra.run.smithi046.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-09-11T14:18:00.489 INFO:teuthology.orchestra.run.smithi046.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:00 2024-09-11T14:18:00.547 INFO:teuthology.orchestra.run.smithi046.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-11T14:18:00.606 INFO:teuthology.orchestra.run.smithi046.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-11T14:18:00.631 INFO:teuthology.orchestra.run.smithi046.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 416 kB/s | 35 kB 00:00 2024-09-11T14:18:01.273 INFO:teuthology.orchestra.run.smithi046.stdout:(15/37): ceph-osd-19.3.0-4884.ge7a65bf9.el9.x86 35 MB/s | 70 MB 00:01 2024-09-11T14:18:01.290 INFO:teuthology.orchestra.run.smithi046.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 77 kB/s | 51 kB 00:00 2024-09-11T14:18:01.323 INFO:teuthology.orchestra.run.smithi046.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 108 kB/s | 77 kB 00:00 2024-09-11T14:18:01.374 INFO:teuthology.orchestra.run.smithi046.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-11T14:18:01.390 INFO:teuthology.orchestra.run.smithi046.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-11T14:18:01.408 INFO:teuthology.orchestra.run.smithi046.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-09-11T14:18:01.449 INFO:teuthology.orchestra.run.smithi046.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-11T14:18:01.466 INFO:teuthology.orchestra.run.smithi046.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 736 kB/s | 11 kB 00:00 2024-09-11T14:18:01.495 INFO:teuthology.orchestra.run.smithi046.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 619 kB/s | 18 kB 00:00 2024-09-11T14:18:01.520 INFO:teuthology.orchestra.run.smithi046.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-11T14:18:01.546 INFO:teuthology.orchestra.run.smithi046.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-11T14:18:01.571 INFO:teuthology.orchestra.run.smithi046.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-11T14:18:01.596 INFO:teuthology.orchestra.run.smithi046.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-09-11T14:18:01.622 INFO:teuthology.orchestra.run.smithi046.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-11T14:18:01.647 INFO:teuthology.orchestra.run.smithi046.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-11T14:18:01.672 INFO:teuthology.orchestra.run.smithi046.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-11T14:18:01.698 INFO:teuthology.orchestra.run.smithi046.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-11T14:18:01.731 INFO:teuthology.orchestra.run.smithi046.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-11T14:18:01.756 INFO:teuthology.orchestra.run.smithi046.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 709 kB/s | 36 kB 00:00 2024-09-11T14:18:01.872 INFO:teuthology.orchestra.run.smithi046.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-11T14:18:01.873 INFO:teuthology.orchestra.run.smithi046.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-11T14:18:01.873 INFO:teuthology.orchestra.run.smithi046.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-11T14:18:02.107 INFO:teuthology.orchestra.run.smithi046.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 27 kB/s | 22 kB 00:00 2024-09-11T14:18:02.113 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:02.113 INFO:teuthology.orchestra.run.smithi046.stdout:Total 23 MB/s | 84 MB 00:03 2024-09-11T14:18:02.272 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:18:02.318 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:18:02.318 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:18:03.146 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:18:03.146 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:18:04.686 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:18:04.715 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:18:04.715 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:18:04.715 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T14:18:04.715 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:18:04.715 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:18:04.715 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:04.872 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:18:04.935 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T14:18:04.969 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T14:18:04.996 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T14:18:05.074 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T14:18:05.129 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T14:18:05.162 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T14:18:05.259 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T14:18:05.287 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:18:05.311 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:18:05.312 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:18:05.312 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T14:18:05.312 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:18:05.312 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:18:05.312 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T14:18:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T14:18:05.425 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T14:18:05.454 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T14:18:05.488 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T14:18:05.521 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T14:18:05.554 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:18:05.563 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T14:18:05.578 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:18:05.579 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:18:05.579 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T14:18:05.579 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:18:05.579 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:18:05.579 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:05.606 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T14:18:05.631 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T14:18:05.646 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:18:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T14:18:05.722 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T14:18:05.799 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T14:18:05.952 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T14:18:06.032 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T14:18:06.085 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T14:18:06.122 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T14:18:06.172 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T14:18:06.236 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T14:18:06.435 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T14:18:06.484 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T14:18:06.567 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T14:18:06.673 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T14:18:06.708 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T14:18:06.846 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T14:18:07.046 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 32/37 2024-09-11T14:18:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:18:07.104 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 33/37 2024-09-11T14:18:07.104 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:18:07.104 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T14:18:07.104 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:18:07.104 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T14:18:07.104 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:12.244 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 6/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T14:18:12.245 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T14:18:12.246 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T14:18:12.247 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:13.194 INFO:teuthology.orchestra.run.smithi047.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T14:18:13.195 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T14:18:13.196 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T14:18:13.197 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T14:18:13.197 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T14:18:13.197 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T14:18:13.197 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:13.197 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:13.469 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-base 2024-09-11T14:18:14.053 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:18:14.147 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:18:14.192 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:18:14.193 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-11T14:18:14.193 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:14.260 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install cephadm 2024-09-11T14:18:14.844 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:18:14.984 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:18:14.985 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:14.985 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:18:14.985 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:14.985 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:18:14.986 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 784 k 2024-09-11T14:18:14.986 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:14.986 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:18:14.986 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:14.986 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-11T14:18:14.986 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:14.986 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 784 k 2024-09-11T14:18:14.986 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 791 k 2024-09-11T14:18:14.986 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:18:15.261 INFO:teuthology.orchestra.run.smithi047.stdout:cephadm-19.3.0-4884.ge7a65bf9.el9.noarch.rpm 2.8 MB/s | 784 kB 00:00 2024-09-11T14:18:15.262 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:15.262 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.8 MB/s | 784 kB 00:00 2024-09-11T14:18:15.262 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:18:15.268 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:18:15.268 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:18:15.275 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:18:15.275 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:18:15.352 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:18:15.870 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:18:15.960 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:18:16.338 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:18:16.601 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:18:16.601 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:16.601 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:18:16.601 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:16.601 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:16.601 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:16.815 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T14:18:17.401 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:18:17.541 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:18:17.542 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:17.542 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-11T14:18:17.542 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:17.542 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:18:17.543 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 158 k 2024-09-11T14:18:17.543 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:17.543 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:18:17.543 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:17.543 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-11T14:18:17.544 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:17.544 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 158 k 2024-09-11T14:18:17.544 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 644 k 2024-09-11T14:18:17.544 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:18:17.767 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-immutable-object-cache-19.3.0-4884.ge7a65b 705 kB/s | 158 kB 00:00 2024-09-11T14:18:17.768 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:17.768 INFO:teuthology.orchestra.run.smithi047.stdout:Total 699 kB/s | 158 kB 00:00 2024-09-11T14:18:17.768 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:18:17.779 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:18:17.779 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:18:17.840 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:18:17.840 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:18:18.003 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:18:18.085 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:18:18.111 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:18:18.111 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:18:18.111 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T14:18:18.111 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:18.285 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:18:18.313 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 34/37 2024-09-11T14:18:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:18:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T14:18:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:18:18.314 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T14:18:18.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:18.885 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:18:18.911 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 35/37 2024-09-11T14:18:18.911 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:18:18.911 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T14:18:18.911 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:18:18.911 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T14:18:18.911 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:19.099 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:18:19.100 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:19.100 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:18:19.100 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:19.100 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:19.100 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:19.152 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:18:19.177 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 36/37 2024-09-11T14:18:19.178 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:18:19.178 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T14:18:19.178 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:18:19.178 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T14:18:19.178 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:19.245 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:18:19.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr 2024-09-11T14:18:19.918 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:33 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:18:20.014 INFO:teuthology.orchestra.run.smithi047.stdout:Package ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:18:20.059 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:18:20.060 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-11T14:18:20.060 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:20.135 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T14:18:20.723 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:18:20.863 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:18:20.864 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 14 M 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 34 k 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 16 k 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T14:18:20.865 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T14:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T14:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T14:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T14:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout:Install 11 Packages 2024-09-11T14:18:20.866 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 18 M 2024-09-11T14:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 155 M 2024-09-11T14:18:20.867 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:18:21.212 INFO:teuthology.orchestra.run.smithi047.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4884.ge7 233 kB/s | 34 kB 00:00 2024-09-11T14:18:21.238 INFO:teuthology.orchestra.run.smithi047.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4884.ge7a 95 kB/s | 16 kB 00:00 2024-09-11T14:18:21.546 INFO:teuthology.orchestra.run.smithi047.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.7 MB/s | 863 kB 00:00 2024-09-11T14:18:21.597 INFO:teuthology.orchestra.run.smithi047.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:18:21.622 INFO:teuthology.orchestra.run.smithi047.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-11T14:18:21.689 INFO:teuthology.orchestra.run.smithi047.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-11T14:18:21.714 INFO:teuthology.orchestra.run.smithi047.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-11T14:18:21.740 INFO:teuthology.orchestra.run.smithi047.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-11T14:18:21.765 INFO:teuthology.orchestra.run.smithi047.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-11T14:18:21.882 INFO:teuthology.orchestra.run.smithi047.stdout:(10/11): python3-protobuf-3.14.0-13.el9.noarch. 402 kB/s | 269 kB 00:00 2024-09-11T14:18:22.565 INFO:teuthology.orchestra.run.smithi047.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4884.ge7a65b 9.4 MB/s | 14 MB 00:01 2024-09-11T14:18:22.568 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:22.568 INFO:teuthology.orchestra.run.smithi047.stdout:Total 11 MB/s | 18 MB 00:01 2024-09-11T14:18:22.599 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:18:22.619 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:18:22.619 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:18:22.892 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:18:22.892 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:18:23.459 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:18:23.665 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-11T14:18:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-11T14:18:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-11T14:18:23.927 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-11T14:18:23.981 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-11T14:18:24.069 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-11T14:18:24.144 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-11T14:18:24.177 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:18:24.212 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 9/11 2024-09-11T14:18:25.823 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 37/37 2024-09-11T14:18:25.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/37 2024-09-11T14:18:25.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/37 2024-09-11T14:18:25.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 3/37 2024-09-11T14:18:25.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 4/37 2024-09-11T14:18:25.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 5/37 2024-09-11T14:18:25.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9. 6/37 2024-09-11T14:18:25.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T14:18:25.823 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T14:18:25.824 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T14:18:25.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T14:18:25.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T14:18:25.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T14:18:25.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T14:18:25.825 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T14:18:25.827 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T14:18:26.766 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T14:18:26.767 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T14:18:26.768 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T14:18:26.769 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T14:18:26.770 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T14:18:26.770 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T14:18:26.770 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:26.770 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:18:27.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-base 2024-09-11T14:18:27.621 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:24 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:18:27.642 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 10/11 2024-09-11T14:18:27.706 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:18:27.718 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-base-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:18:27.763 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:18:27.764 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-11T14:18:27.764 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:18:27.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install cephadm 2024-09-11T14:18:28.420 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:25 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:18:28.557 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:18:28.558 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:28.558 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:18:28.558 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:28.558 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:18:28.558 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 784 k 2024-09-11T14:18:28.558 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:28.558 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:18:28.559 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:28.559 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-11T14:18:28.559 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:28.559 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 784 k 2024-09-11T14:18:28.559 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 791 k 2024-09-11T14:18:28.559 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:18:28.845 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm-19.3.0-4884.ge7a65bf9.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-11T14:18:28.845 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:28.845 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-11T14:18:28.846 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:18:28.851 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:18:28.851 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:18:28.857 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:18:28.858 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:18:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:18:29.452 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:18:29.559 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:18:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:18:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 1/11 2024-09-11T14:18:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 2/11 2024-09-11T14:18:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 3/11 2024-09-11T14:18:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-11T14:18:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-11T14:18:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-11T14:18:29.594 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-11T14:18:29.595 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:18:29.595 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-11T14:18:29.595 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-11T14:18:29.915 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T14:18:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T14:18:29.917 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T14:18:29.917 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T14:18:29.917 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:29.917 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:30.028 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:18:30.192 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T14:18:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:18:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:30.298 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:18:30.298 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:30.299 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:30.299 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:18:30.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T14:18:30.779 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:01:44 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:18:30.919 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 7.4 M 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T14:18:30.920 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout:Install 12 Packages 2024-09-11T14:18:30.921 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:30.922 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 38 M 2024-09-11T14:18:30.922 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 212 M 2024-09-11T14:18:30.922 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:18:31.127 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:18:31.265 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 158 k 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 158 k 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 644 k 2024-09-11T14:18:31.266 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:18:31.422 INFO:teuthology.orchestra.run.smithi047.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 997 kB/s | 191 kB 00:00 2024-09-11T14:18:31.468 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-immutable-object-cache-19.3.0-4884.ge7a65b 788 kB/s | 158 kB 00:00 2024-09-11T14:18:31.469 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:31.469 INFO:teuthology.orchestra.run.smithi046.stdout:Total 781 kB/s | 158 kB 00:00 2024-09-11T14:18:31.469 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:18:31.480 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:18:31.480 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:18:31.488 INFO:teuthology.orchestra.run.smithi047.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-09-11T14:18:31.531 INFO:teuthology.orchestra.run.smithi047.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-11T14:18:31.540 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:18:31.541 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:18:31.589 INFO:teuthology.orchestra.run.smithi047.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 314 kB/s | 18 kB 00:00 2024-09-11T14:18:31.698 INFO:teuthology.orchestra.run.smithi047.stdout:(5/12): ceph-mgr-diskprediction-local-19.3.0-48 16 MB/s | 7.4 MB 00:00 2024-09-11T14:18:31.698 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:18:31.715 INFO:teuthology.orchestra.run.smithi047.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 307 kB/s | 38 kB 00:00 2024-09-11T14:18:31.769 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:18:31.795 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:18:31.795 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:18:31.795 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T14:18:31.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:31.806 INFO:teuthology.orchestra.run.smithi047.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-11T14:18:32.165 INFO:teuthology.orchestra.run.smithi047.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.4 MB/s | 3.0 MB 00:00 2024-09-11T14:18:32.266 INFO:teuthology.orchestra.run.smithi047.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 250 kB 00:00 2024-09-11T14:18:32.764 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9. 1/1 2024-09-11T14:18:32.765 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:32.765 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:18:32.765 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:18:32.765 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:32.765 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:18:32.974 INFO:teuthology.orchestra.run.smithi047.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.9 MB/s | 4.9 MB 00:01 2024-09-11T14:18:33.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr 2024-09-11T14:18:33.041 INFO:teuthology.orchestra.run.smithi047.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-11T14:18:33.604 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:30 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:18:33.698 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-mgr-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:18:33.743 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:18:33.744 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-11T14:18:33.744 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:18:33.812 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T14:18:34.389 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:18:34.528 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:18:34.529 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:34.529 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:18:34.529 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:34.529 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:18:34.529 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 14 M 2024-09-11T14:18:34.529 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-11T14:18:34.529 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 34 k 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 16 k 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:34.530 INFO:teuthology.orchestra.run.smithi046.stdout:Install 11 Packages 2024-09-11T14:18:34.531 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:34.531 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 18 M 2024-09-11T14:18:34.531 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 155 M 2024-09-11T14:18:34.531 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:18:35.032 INFO:teuthology.orchestra.run.smithi046.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4884.ge7a 110 kB/s | 16 kB 00:00 2024-09-11T14:18:35.052 INFO:teuthology.orchestra.run.smithi046.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4884.ge7 206 kB/s | 34 kB 00:00 2024-09-11T14:18:35.183 INFO:teuthology.orchestra.run.smithi046.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.8 MB/s | 269 kB 00:00 2024-09-11T14:18:35.233 INFO:teuthology.orchestra.run.smithi046.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:18:35.258 INFO:teuthology.orchestra.run.smithi046.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-11T14:18:35.325 INFO:teuthology.orchestra.run.smithi046.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-11T14:18:35.359 INFO:teuthology.orchestra.run.smithi046.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-11T14:18:35.384 INFO:teuthology.orchestra.run.smithi046.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-11T14:18:35.426 INFO:teuthology.orchestra.run.smithi046.stdout:(9/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.2 MB/s | 863 kB 00:00 2024-09-11T14:18:35.460 INFO:teuthology.orchestra.run.smithi046.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-09-11T14:18:35.635 INFO:teuthology.orchestra.run.smithi046.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4884.ge7a65b 19 MB/s | 14 MB 00:00 2024-09-11T14:18:35.639 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:35.639 INFO:teuthology.orchestra.run.smithi046.stdout:Total 16 MB/s | 18 MB 00:01 2024-09-11T14:18:35.670 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:18:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:18:35.691 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:18:35.956 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:18:35.956 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:18:36.521 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:18:36.549 INFO:teuthology.orchestra.run.smithi047.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-11T14:18:36.550 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:36.550 INFO:teuthology.orchestra.run.smithi047.stdout:Total 6.8 MB/s | 38 MB 00:05 2024-09-11T14:18:36.610 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-11T14:18:36.639 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-11T14:18:36.766 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-11T14:18:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-11T14:18:36.924 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:18:36.951 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-11T14:18:36.952 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:18:36.952 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:18:37.038 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-11T14:18:37.087 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-11T14:18:37.122 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:18:37.155 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 9/11 2024-09-11T14:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:18:37.401 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:18:38.315 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:18:38.403 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T14:18:38.448 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:18:38.553 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:18:38.599 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T14:18:38.792 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T14:18:38.822 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T14:18:38.901 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T14:18:39.606 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T14:18:39.732 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T14:18:40.522 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 10/11 2024-09-11T14:18:40.576 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:18:41.083 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:18:42.178 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T14:18:42.205 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:18:42.465 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 11/11 2024-09-11T14:18:42.465 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el 1/11 2024-09-11T14:18:42.465 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noa 2/11 2024-09-11T14:18:42.465 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9 3/11 2024-09-11T14:18:42.465 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-11T14:18:42.466 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-11T14:18:42.466 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-11T14:18:42.466 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-11T14:18:42.466 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-11T14:18:42.466 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-11T14:18:42.466 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-11T14:18:42.789 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-11T14:18:42.789 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:42.789 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T14:18:42.790 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T14:18:42.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:42.791 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:18:43.074 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T14:18:43.662 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:18:43.802 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:18:43.803 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-09-11T14:18:43.803 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:18:43.803 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-09-11T14:18:43.803 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:18:43.803 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 7.4 M 2024-09-11T14:18:43.803 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:18:43.804 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-09-11T14:18:43.805 INFO:teuthology.orchestra.run.smithi046.stdout:Install 12 Packages 2024-09-11T14:18:43.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:43.805 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 38 M 2024-09-11T14:18:43.805 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 212 M 2024-09-11T14:18:43.805 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:18:44.575 INFO:teuthology.orchestra.run.smithi046.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-48 17 MB/s | 7.4 MB 00:00 2024-09-11T14:18:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 283 kB/s | 33 kB 00:00 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 1/12 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T14:18:44.871 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T14:18:44.872 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:18:44.872 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T14:18:44.984 INFO:teuthology.orchestra.run.smithi046.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 225 kB/s | 191 kB 00:00 2024-09-11T14:18:45.100 INFO:teuthology.orchestra.run.smithi046.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 157 kB/s | 18 kB 00:00 2024-09-11T14:18:45.193 INFO:teuthology.orchestra.run.smithi046.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 419 kB/s | 38 kB 00:00 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T14:18:45.258 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T14:18:45.259 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T14:18:45.259 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T14:18:45.259 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T14:18:45.259 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T14:18:45.259 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:45.259 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:45.409 INFO:teuthology.orchestra.run.smithi046.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 628 kB/s | 801 kB 00:01 2024-09-11T14:18:45.610 INFO:teuthology.orchestra.run.smithi046.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-11T14:18:45.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-rook 2024-09-11T14:18:45.743 INFO:teuthology.orchestra.run.smithi046.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-11T14:18:45.902 INFO:teuthology.orchestra.run.smithi046.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.5 MB/s | 250 kB 00:00 2024-09-11T14:18:46.227 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:00 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:18:46.370 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:18:46.371 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:46.371 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:18:46.371 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:46.371 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:18:46.371 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 49 k 2024-09-11T14:18:46.371 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-11T14:18:46.371 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T14:18:46.371 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:46.372 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:18:46.373 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:46.373 INFO:teuthology.orchestra.run.smithi047.stdout:Install 13 Packages 2024-09-11T14:18:46.373 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:46.373 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 2.2 M 2024-09-11T14:18:46.373 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 26 M 2024-09-11T14:18:46.373 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:18:46.673 INFO:teuthology.orchestra.run.smithi047.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 273 kB/s | 26 kB 00:00 2024-09-11T14:18:46.690 INFO:teuthology.orchestra.run.smithi047.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 173 kB/s | 19 kB 00:00 2024-09-11T14:18:46.890 INFO:teuthology.orchestra.run.smithi047.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 797 kB/s | 159 kB 00:00 2024-09-11T14:18:46.916 INFO:teuthology.orchestra.run.smithi047.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 990 kB/s | 222 kB 00:00 2024-09-11T14:18:46.932 INFO:teuthology.orchestra.run.smithi047.stdout:(5/13): ceph-mgr-rook-19.3.0-4884.ge7a65bf9.el9 139 kB/s | 49 kB 00:00 2024-09-11T14:18:46.949 INFO:teuthology.orchestra.run.smithi047.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.6 MB/s | 54 kB 00:00 2024-09-11T14:18:46.969 INFO:teuthology.orchestra.run.smithi046.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.8 MB/s | 4.9 MB 00:01 2024-09-11T14:18:46.975 INFO:teuthology.orchestra.run.smithi047.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.2 MB/s | 279 kB 00:00 2024-09-11T14:18:47.017 INFO:teuthology.orchestra.run.smithi047.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 384 kB/s | 32 kB 00:00 2024-09-11T14:18:47.034 INFO:teuthology.orchestra.run.smithi047.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 168 kB/s | 14 kB 00:00 2024-09-11T14:18:47.051 INFO:teuthology.orchestra.run.smithi047.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-11T14:18:47.076 INFO:teuthology.orchestra.run.smithi047.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.5 MB/s | 220 kB 00:00 2024-09-11T14:18:47.101 INFO:teuthology.orchestra.run.smithi047.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-11T14:18:47.135 INFO:teuthology.orchestra.run.smithi047.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.8 MB/s | 1.0 MB 00:00 2024-09-11T14:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:47.138 INFO:teuthology.orchestra.run.smithi047.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-11T14:18:47.207 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:18:47.223 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:18:47.223 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:18:47.321 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:18:47.328 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:18:47.394 INFO:teuthology.orchestra.run.smithi046.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-09-11T14:18:47.841 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:18:48.007 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T14:18:48.063 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T14:18:48.119 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T14:18:48.157 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T14:18:48.447 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T14:18:48.552 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T14:18:48.672 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T14:18:48.723 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T14:18:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T14:18:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T14:18:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T14:18:49.610 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T14:18:49.639 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:18:50.319 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:18:50.319 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T14:18:50.320 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T14:18:50.327 INFO:teuthology.orchestra.run.smithi046.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-11T14:18:50.329 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:50.329 INFO:teuthology.orchestra.run.smithi046.stdout:Total 5.9 MB/s | 38 MB 00:06 2024-09-11T14:18:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T14:18:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T14:18:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T14:18:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T14:18:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T14:18:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:50.665 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:50.694 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:18:50.723 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:18:50.723 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:18:50.974 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T14:18:51.177 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:18:51.178 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:18:51.570 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:05 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:18:51.711 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:18:51.711 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:51.711 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 154 k 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:51.712 INFO:teuthology.orchestra.run.smithi047.stdout:Install 6 Packages 2024-09-11T14:18:51.713 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:51.713 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 7.0 M 2024-09-11T14:18:51.713 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 33 M 2024-09-11T14:18:51.713 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:18:52.000 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:18:52.078 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T14:18:52.118 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:18:52.222 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:18:52.253 INFO:teuthology.orchestra.run.smithi047.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-11T14:18:52.261 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T14:18:52.303 INFO:teuthology.orchestra.run.smithi047.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-11T14:18:52.329 INFO:teuthology.orchestra.run.smithi047.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-11T14:18:52.354 INFO:teuthology.orchestra.run.smithi047.stdout:(4/6): ceph-mgr-cephadm-19.3.0-4884.ge7a65bf9.e 668 kB/s | 154 kB 00:00 2024-09-11T14:18:52.379 INFO:teuthology.orchestra.run.smithi047.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-11T14:18:52.453 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T14:18:52.484 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T14:18:52.563 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T14:18:53.279 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T14:18:53.411 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T14:18:53.654 INFO:teuthology.orchestra.run.smithi047.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2024-09-11T14:18:53.657 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:53.657 INFO:teuthology.orchestra.run.smithi047.stdout:Total 3.6 MB/s | 7.0 MB 00:01 2024-09-11T14:18:53.733 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:18:53.746 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:18:53.746 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:18:53.855 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:18:53.856 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:18:54.176 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:18:54.346 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T14:18:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T14:18:54.749 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:18:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T14:18:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T14:18:55.130 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T14:18:55.168 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:18:55.832 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T14:18:55.859 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:18:55.989 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:18:55.989 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/6 2024-09-11T14:18:55.989 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T14:18:55.989 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T14:18:55.989 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T14:18:55.989 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T14:18:56.304 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T14:18:56.304 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:56.304 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:18:56.304 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:56.304 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T14:18:56.305 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T14:18:56.305 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T14:18:56.305 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T14:18:56.305 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T14:18:56.305 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:56.305 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:56.610 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-fuse 2024-09-11T14:18:57.202 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:11 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:18:57.343 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:18:57.343 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:18:57.343 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:57.343 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:18:57.343 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 883 k 2024-09-11T14:18:57.343 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-09-11T14:18:57.344 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T14:18:57.344 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:57.344 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:18:57.344 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:18:57.344 INFO:teuthology.orchestra.run.smithi047.stdout:Install 2 Packages 2024-09-11T14:18:57.344 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:57.345 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 962 k 2024-09-11T14:18:57.345 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 4.1 M 2024-09-11T14:18:57.345 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:18:57.515 INFO:teuthology.orchestra.run.smithi047.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 539 kB/s | 80 kB 00:00 2024-09-11T14:18:57.640 INFO:teuthology.orchestra.run.smithi047.stdout:(2/2): ceph-fuse-19.3.0-4884.ge7a65bf9.el9.x86_ 3.2 MB/s | 883 kB 00:00 2024-09-11T14:18:57.641 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:18:57.641 INFO:teuthology.orchestra.run.smithi047.stdout:Total 3.2 MB/s | 962 kB 00:00 2024-09-11T14:18:57.653 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:18:57.678 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:18:57.678 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:18:57.764 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:18:57.765 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:18:57.957 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:18:58.106 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T14:18:58.184 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:18:58.307 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 12/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65 1/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T14:18:58.308 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T14:18:58.727 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T14:18:58.727 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:58.727 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:18:58.727 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:18:58.727 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T14:18:58.727 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T14:18:58.727 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:58.728 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:18:58.859 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:18:58.860 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/2 2024-09-11T14:18:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T14:18:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:59.138 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:18:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T14:18:59.138 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:18:59.138 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:18:59.165 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-rook 2024-09-11T14:18:59.415 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-volume 2024-09-11T14:18:59.764 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:56 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:18:59.906 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:18:59.907 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:59.907 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:18:59.907 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:59.907 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:18:59.907 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 49 k 2024-09-11T14:18:59.907 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T14:18:59.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:18:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:18:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Install 13 Packages 2024-09-11T14:18:59.909 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:18:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.2 M 2024-09-11T14:18:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 26 M 2024-09-11T14:18:59.909 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:19:00.011 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:14 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:00.152 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:00.152 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:00.152 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 285 k 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 285 k 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 1.3 M 2024-09-11T14:19:00.153 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:19:00.184 INFO:teuthology.orchestra.run.smithi046.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 218 kB/s | 19 kB 00:00 2024-09-11T14:19:00.209 INFO:teuthology.orchestra.run.smithi046.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 226 kB/s | 26 kB 00:00 2024-09-11T14:19:00.268 INFO:teuthology.orchestra.run.smithi046.stdout:(3/13): ceph-mgr-rook-19.3.0-4884.ge7a65bf9.el9 287 kB/s | 49 kB 00:00 2024-09-11T14:19:00.302 INFO:teuthology.orchestra.run.smithi046.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-09-11T14:19:00.336 INFO:teuthology.orchestra.run.smithi046.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T14:19:00.361 INFO:teuthology.orchestra.run.smithi046.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 911 kB/s | 54 kB 00:00 2024-09-11T14:19:00.387 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-volume-19.3.0-4884.ge7a65bf9.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-11T14:19:00.387 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:00.388 INFO:teuthology.orchestra.run.smithi047.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-11T14:19:00.388 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:19:00.397 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:19:00.397 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:19:00.403 INFO:teuthology.orchestra.run.smithi046.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-11T14:19:00.427 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:19:00.427 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:19:00.428 INFO:teuthology.orchestra.run.smithi046.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-11T14:19:00.453 INFO:teuthology.orchestra.run.smithi046.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-11T14:19:00.479 INFO:teuthology.orchestra.run.smithi046.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.3 MB/s | 279 kB 00:00 2024-09-11T14:19:00.512 INFO:teuthology.orchestra.run.smithi046.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-11T14:19:00.563 INFO:teuthology.orchestra.run.smithi046.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-11T14:19:00.588 INFO:teuthology.orchestra.run.smithi046.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 825 kB/s | 90 kB 00:00 2024-09-11T14:19:00.591 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:00.591 INFO:teuthology.orchestra.run.smithi046.stdout:Total 3.2 MB/s | 2.2 MB 00:00 2024-09-11T14:19:00.655 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:19:00.664 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:19:00.671 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:19:00.671 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:19:00.730 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:19:00.748 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:19:00.748 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:19:00.748 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T14:19:00.748 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:00.768 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:19:00.769 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:19:01.421 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:19:01.593 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T14:19:01.649 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T14:19:01.705 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T14:19:01.741 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T14:19:01.761 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:19:01.761 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:01.761 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:19:01.761 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:19:01.761 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:01.761 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:01.792 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T14:19:01.898 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T14:19:02.007 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T14:19:02.060 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T14:19:02.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados-devel 2024-09-11T14:19:02.703 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:16 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:02.818 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T14:19:02.843 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:02.844 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:02.844 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-11T14:19:02.844 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:02.844 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:19:02.844 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 125 k 2024-09-11T14:19:02.844 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:02.844 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:19:02.845 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:02.845 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-11T14:19:02.845 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:02.845 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 125 k 2024-09-11T14:19:02.845 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 445 k 2024-09-11T14:19:02.845 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:19:02.881 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T14:19:02.923 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T14:19:02.980 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T14:19:03.009 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:19:03.058 INFO:teuthology.orchestra.run.smithi047.stdout:librados-devel-19.3.0-4884.ge7a65bf9.el9.x86_64 586 kB/s | 125 kB 00:00 2024-09-11T14:19:03.059 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:03.059 INFO:teuthology.orchestra.run.smithi047.stdout:Total 582 kB/s | 125 kB 00:00 2024-09-11T14:19:03.059 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:19:03.065 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:19:03.065 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:19:03.133 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:19:03.170 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:19:03.288 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:19:03.384 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:03.761 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 13/13 2024-09-11T14:19:03.761 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/13 2024-09-11T14:19:03.761 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T14:19:03.761 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T14:19:03.761 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T14:19:03.761 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T14:19:03.762 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T14:19:03.762 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T14:19:03.762 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T14:19:03.762 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T14:19:03.762 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T14:19:03.762 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T14:19:03.762 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T14:19:03.820 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:04.093 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:19:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:04.093 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:04.132 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T14:19:04.132 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:04.132 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:19:04.132 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:19:04.132 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:04.353 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs2 2024-09-11T14:19:04.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T14:19:04.949 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:18 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:05.000 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:01 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:05.043 INFO:teuthology.orchestra.run.smithi047.stdout:Package libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:05.089 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:05.090 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-11T14:19:05.091 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:05.140 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:05.141 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:05.141 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:19:05.141 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:05.141 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:19:05.141 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 154 k 2024-09-11T14:19:05.141 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout:Install 6 Packages 2024-09-11T14:19:05.142 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:05.143 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 7.0 M 2024-09-11T14:19:05.143 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 33 M 2024-09-11T14:19:05.143 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:19:05.205 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install libcephfs-devel 2024-09-11T14:19:05.440 INFO:teuthology.orchestra.run.smithi046.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4884.ge7a65bf9.e 727 kB/s | 154 kB 00:00 2024-09-11T14:19:05.499 INFO:teuthology.orchestra.run.smithi046.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-11T14:19:05.541 INFO:teuthology.orchestra.run.smithi046.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.1 MB/s | 58 kB 00:00 2024-09-11T14:19:05.566 INFO:teuthology.orchestra.run.smithi046.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-11T14:19:05.791 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:19 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:05.931 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 32 k 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:05.932 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 32 k 2024-09-11T14:19:05.933 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 142 k 2024-09-11T14:19:05.933 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:19:06.071 INFO:teuthology.orchestra.run.smithi047.stdout:libcephfs-devel-19.3.0-4884.ge7a65bf9.el9.x86_6 230 kB/s | 32 kB 00:00 2024-09-11T14:19:06.071 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:06.071 INFO:teuthology.orchestra.run.smithi047.stdout:Total 228 kB/s | 32 kB 00:00 2024-09-11T14:19:06.072 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:19:06.075 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:19:06.075 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:19:06.103 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:19:06.104 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:19:06.116 INFO:teuthology.orchestra.run.smithi046.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 279 kB/s | 248 kB 00:00 2024-09-11T14:19:06.199 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:19:06.313 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:06.508 INFO:teuthology.orchestra.run.smithi046.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-11T14:19:06.511 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:06.511 INFO:teuthology.orchestra.run.smithi046.stdout:Total 5.1 MB/s | 7.0 MB 00:01 2024-09-11T14:19:06.588 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:19:06.601 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:19:06.601 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:19:06.704 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:06.709 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:19:06.710 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:19:06.953 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:06.953 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:06.953 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:19:06.953 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:06.953 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:06.953 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:07.028 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:19:07.154 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librados2 2024-09-11T14:19:07.207 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T14:19:07.262 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T14:19:07.746 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:21 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:07.818 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T14:19:07.840 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:07.886 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:07.887 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-11T14:19:07.887 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:07.908 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T14:19:07.963 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install librbd1 2024-09-11T14:19:07.984 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T14:19:08.014 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:19:08.558 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:22 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:08.652 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:08.699 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:08.700 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-11T14:19:08.700 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:08.771 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rados 2024-09-11T14:19:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 6/6 2024-09-11T14:19:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/6 2024-09-11T14:19:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T14:19:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T14:19:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T14:19:08.792 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T14:19:09.081 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T14:19:09.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:09.081 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:19:09.081 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:19:09.081 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T14:19:09.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T14:19:09.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T14:19:09.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T14:19:09.082 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T14:19:09.082 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:09.082 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:09.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-fuse 2024-09-11T14:19:09.363 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:23 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:09.458 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:09.504 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:09.505 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-11T14:19:09.505 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:09.582 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rgw 2024-09-11T14:19:09.939 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:06 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 883 k 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:Install 2 Packages 2024-09-11T14:19:10.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:10.079 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 962 k 2024-09-11T14:19:10.079 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 4.1 M 2024-09-11T14:19:10.079 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:19:10.171 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:24 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:10.266 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:10.312 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:10.313 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-11T14:19:10.313 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:10.386 INFO:teuthology.orchestra.run.smithi046.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 423 kB/s | 80 kB 00:00 2024-09-11T14:19:10.388 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-cephfs 2024-09-11T14:19:10.477 INFO:teuthology.orchestra.run.smithi046.stdout:(2/2): ceph-fuse-19.3.0-4884.ge7a65bf9.el9.x86_ 3.1 MB/s | 883 kB 00:00 2024-09-11T14:19:10.478 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:10.478 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.4 MB/s | 962 kB 00:00 2024-09-11T14:19:10.490 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:19:10.515 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:19:10.515 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:19:10.600 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:19:10.600 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:19:10.794 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:19:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T14:19:10.979 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:24 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:11.013 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:19:11.073 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:11.119 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:11.120 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-11T14:19:11.120 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:11.197 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install python3-rbd 2024-09-11T14:19:11.720 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2/2 2024-09-11T14:19:11.720 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/2 2024-09-11T14:19:11.789 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:25 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:11.883 INFO:teuthology.orchestra.run.smithi047.stdout:Package python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:11.928 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:11.929 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-09-11T14:19:11.929 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:11.984 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T14:19:11.984 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:11.984 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:19:11.984 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T14:19:11.984 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:11.984 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:12.002 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-fuse 2024-09-11T14:19:12.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-volume 2024-09-11T14:19:12.601 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:26 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:12.745 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:12.745 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 91 k 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 91 k 2024-09-11T14:19:12.746 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 321 k 2024-09-11T14:19:12.747 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:19:12.885 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:09 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:12.941 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-fuse-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 468 kB/s | 91 kB 00:00 2024-09-11T14:19:12.941 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:12.942 INFO:teuthology.orchestra.run.smithi047.stdout:Total 463 kB/s | 91 kB 00:00 2024-09-11T14:19:12.942 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:19:12.952 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:19:12.952 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:19:13.019 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:19:13.019 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:19:13.027 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:13.027 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:13.027 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-11T14:19:13.027 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:13.027 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:19:13.027 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.3.0-4884.ge7a65bf9.el9 ceph-noarch 285 k 2024-09-11T14:19:13.028 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:13.028 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:19:13.028 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:13.028 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-11T14:19:13.028 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:13.028 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 285 k 2024-09-11T14:19:13.029 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 1.3 M 2024-09-11T14:19:13.029 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:19:13.175 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:19:13.274 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-volume-19.3.0-4884.ge7a65bf9.el9.noarch.rp 1.1 MB/s | 285 kB 00:00 2024-09-11T14:19:13.275 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:13.275 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:13.275 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-11T14:19:13.275 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:19:13.284 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:19:13.284 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:19:13.317 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:19:13.317 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:19:13.549 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:19:13.655 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:19:13.655 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:19:13.655 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:19:13.655 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T14:19:13.656 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:13.795 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:14.060 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:14.060 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:14.060 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:19:14.060 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:14.060 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:14.060 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:14.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-mirror 2024-09-11T14:19:14.788 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 1/1 2024-09-11T14:19:14.788 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:14.788 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:19:14.788 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.3.0-4884.ge7a65bf9.el9.noarch 2024-09-11T14:19:14.789 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:14.789 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:14.927 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:28 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:15.070 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-11T14:19:15.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:15.072 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 3.5 M 2024-09-11T14:19:15.072 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 30 M 2024-09-11T14:19:15.072 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:19:15.091 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados-devel 2024-09-11T14:19:15.702 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:12 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:15.761 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-mirror-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 5.1 MB/s | 3.5 MB 00:00 2024-09-11T14:19:15.762 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:15.762 INFO:teuthology.orchestra.run.smithi047.stdout:Total 5.1 MB/s | 3.5 MB 00:00 2024-09-11T14:19:15.762 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:19:15.776 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:19:15.776 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:19:15.843 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:15.843 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 125 k 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 125 k 2024-09-11T14:19:15.844 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 445 k 2024-09-11T14:19:15.845 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:19:15.865 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:19:15.866 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:19:16.046 INFO:teuthology.orchestra.run.smithi046.stdout:librados-devel-19.3.0-4884.ge7a65bf9.el9.x86_64 620 kB/s | 125 kB 00:00 2024-09-11T14:19:16.046 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:16.047 INFO:teuthology.orchestra.run.smithi046.stdout:Total 616 kB/s | 125 kB 00:00 2024-09-11T14:19:16.047 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:19:16.052 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:19:16.053 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:19:16.119 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:19:16.120 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:19:16.275 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:19:16.397 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:16.486 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:19:16.553 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:16.582 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:16.582 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:19:16.582 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T14:19:16.582 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:19:16.582 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:19:16.582 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:16.864 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:17.145 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:17.146 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:17.146 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:19:17.146 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:17.146 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:17.146 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:17.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs2 2024-09-11T14:19:17.855 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:17.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:17.856 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:19:17.856 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:17.856 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:17.856 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:17.998 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:14 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:18.092 INFO:teuthology.orchestra.run.smithi046.stdout:Package libcephfs2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:18.108 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install rbd-nbd 2024-09-11T14:19:18.140 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:18.142 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-11T14:19:18.142 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:18.203 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs-devel 2024-09-11T14:19:18.701 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:02:32 ago on Wed 11 Sep 2024 02:16:46 PM UTC. 2024-09-11T14:19:18.792 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:15 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:18.841 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: Package Architecture Version Repository Size 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 177 k 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout:Install 1 Package 2024-09-11T14:19:18.842 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:18.843 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 177 k 2024-09-11T14:19:18.843 INFO:teuthology.orchestra.run.smithi047.stdout:Installed size: 685 k 2024-09-11T14:19:18.843 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-09-11T14:19:18.932 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:18.933 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:18.933 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-11T14:19:18.934 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:18.934 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:19:18.934 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 32 k 2024-09-11T14:19:18.934 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:18.934 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:19:18.934 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:18.934 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-11T14:19:18.934 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:18.934 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 32 k 2024-09-11T14:19:18.935 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 142 k 2024-09-11T14:19:18.935 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:19:19.073 INFO:teuthology.orchestra.run.smithi047.stdout:rbd-nbd-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 769 kB/s | 177 kB 00:00 2024-09-11T14:19:19.074 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:19.074 INFO:teuthology.orchestra.run.smithi047.stdout:Total 763 kB/s | 177 kB 00:00 2024-09-11T14:19:19.074 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-09-11T14:19:19.084 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-09-11T14:19:19.084 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-09-11T14:19:19.099 INFO:teuthology.orchestra.run.smithi046.stdout:libcephfs-devel-19.3.0-4884.ge7a65bf9.el9.x86_6 192 kB/s | 32 kB 00:00 2024-09-11T14:19:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:Total 190 kB/s | 32 kB 00:00 2024-09-11T14:19:19.100 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:19:19.104 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:19:19.104 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:19:19.117 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:19:19.117 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:19:19.152 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-09-11T14:19:19.153 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-09-11T14:19:19.211 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:19:19.334 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-09-11T14:19:19.343 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:19.734 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:19.893 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:19.989 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:19:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:19.989 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:20.142 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:20.142 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:20.142 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-09-11T14:19:20.143 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:20.143 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:20.143 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-09-11T14:19:20.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados2 2024-09-11T14:19:20.523 DEBUG:teuthology.parallel:result is None 2024-09-11T14:19:20.759 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:17 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:20.853 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:20.898 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:20.899 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-11T14:19:20.899 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:20.965 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librbd1 2024-09-11T14:19:21.554 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:18 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:21.648 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:21.694 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:21.695 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-11T14:19:21.695 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:21.767 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rados 2024-09-11T14:19:22.360 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:19 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:22.454 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rados-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:22.500 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:22.501 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-11T14:19:22.502 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:22.567 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rgw 2024-09-11T14:19:23.153 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:23.246 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rgw-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:23.292 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:23.293 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-11T14:19:23.293 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:23.354 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-cephfs 2024-09-11T14:19:23.940 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:20 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:24.033 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-cephfs-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:24.080 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:24.081 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-11T14:19:24.081 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:24.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rbd 2024-09-11T14:19:24.735 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:21 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:24.829 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 is already installed. 2024-09-11T14:19:24.875 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-11T14:19:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:24.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-fuse 2024-09-11T14:19:25.526 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:22 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:25.665 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:25.666 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:25.666 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-11T14:19:25.666 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 91 k 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 91 k 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 321 k 2024-09-11T14:19:25.667 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:19:25.870 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-fuse-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 449 kB/s | 91 kB 00:00 2024-09-11T14:19:25.870 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:25.871 INFO:teuthology.orchestra.run.smithi046.stdout:Total 446 kB/s | 91 kB 00:00 2024-09-11T14:19:25.871 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:19:25.880 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:19:25.880 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:19:25.947 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:19:25.947 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:19:26.112 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:19:26.212 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:26.887 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:26.887 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:26.888 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:19:26.888 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:26.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:26.888 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:27.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-mirror 2024-09-11T14:19:27.785 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:24 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:27.927 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 3.5 M 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 3.5 M 2024-09-11T14:19:27.928 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 30 M 2024-09-11T14:19:27.929 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:19:28.273 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-mirror-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2024-09-11T14:19:28.274 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:28.274 INFO:teuthology.orchestra.run.smithi046.stdout:Total 10 MB/s | 3.5 MB 00:00 2024-09-11T14:19:28.274 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:19:28.287 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:19:28.287 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:19:28.376 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:19:28.376 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:19:28.989 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:19:29.058 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:29.085 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:29.085 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T14:19:29.085 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T14:19:29.085 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:19:29.085 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T14:19:29.085 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:30.369 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:19:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:30.369 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:30.369 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:30.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-nbd 2024-09-11T14:19:31.215 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:28 ago on Wed 11 Sep 2024 02:17:03 PM UTC. 2024-09-11T14:19:31.356 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-11T14:19:31.357 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:31.357 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-11T14:19:31.357 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:31.357 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-11T14:19:31.357 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.3.0-4884.ge7a65bf9.el9 ceph 177 k 2024-09-11T14:19:31.357 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:31.357 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-11T14:19:31.357 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-11T14:19:31.357 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-11T14:19:31.358 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:31.358 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 177 k 2024-09-11T14:19:31.358 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 685 k 2024-09-11T14:19:31.358 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-11T14:19:31.604 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-nbd-19.3.0-4884.ge7a65bf9.el9.x86_64.rpm 719 kB/s | 177 kB 00:00 2024-09-11T14:19:31.604 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-11T14:19:31.604 INFO:teuthology.orchestra.run.smithi046.stdout:Total 714 kB/s | 177 kB 00:00 2024-09-11T14:19:31.605 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-11T14:19:31.615 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-11T14:19:31.616 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-11T14:19:31.685 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-11T14:19:31.685 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-11T14:19:31.846 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-11T14:19:31.963 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:32.396 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 1/1 2024-09-11T14:19:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:32.653 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-11T14:19:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.3.0-4884.ge7a65bf9.el9.x86_64 2024-09-11T14:19:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:32.654 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-11T14:19:32.931 DEBUG:teuthology.parallel:result is None 2024-09-11T14:19:32.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:19:33.081 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T14:19:33.104 INFO:teuthology.orchestra.run.smithi046.stdout:19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:19:33.104 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:19:33.105 INFO:teuthology.task.install:The correct ceph version 19.3.0-4884.ge7a65bf9 is installed. 2024-09-11T14:19:33.106 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=e7a65bf96d25c503998be3c193e951647cc62cab 2024-09-11T14:19:33.257 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T14:19:33.284 INFO:teuthology.orchestra.run.smithi047.stdout:19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:19:33.284 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4884.ge7a65bf9.el9 2024-09-11T14:19:33.285 INFO:teuthology.task.install:The correct ceph version 19.3.0-4884.ge7a65bf9 is installed. 2024-09-11T14:19:33.287 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T14:19:33.287 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:33.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T14:19:33.316 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:33.316 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T14:19:33.356 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T14:19:33.356 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:33.356 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T14:19:33.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T14:19:33.449 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:33.449 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T14:19:33.480 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T14:19:33.549 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T14:19:33.549 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:33.549 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T14:19:33.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T14:19:33.662 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:33.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T14:19:33.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T14:19:33.762 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T14:19:33.762 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:33.762 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T14:19:33.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T14:19:33.855 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:33.856 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T14:19:33.886 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T14:19:33.957 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T14:19:34.045 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T14:19:34.046 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-09-11T14:19:34.048 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-09-11T14:19:34.079 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T14:19:34.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T14:19:34.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T14:19:34.150 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T14:19:34.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T14:19:34.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T14:19:34.230 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T14:19:34.230 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T14:19:34.230 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333', 'branch': 'wip-matanb-crimson-testing-sep11', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7901333', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-sep11'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2853, 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBciRswQ6Ro+VTB/yWOGTrtyoye+vLL57GuiFMzBj8wQOo7TbNsy4YtjnD26OsXDKm0UBZiVgO40jU5l2cx8hkc=', 'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM65ieD3QnF3miVm7fi4RfvXicTvcGwCwVkGskEih49//jgWvjS2usKgIK18WhtMRpoLq4Ute2BfBdmCkxo3aCw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'e7a65bf96d25c503998be3c193e951647cc62cab', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_13:53:46', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T14:19:34.231 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T14:19:34.245 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T14:19:34.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T14:19:34.301 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T14:19:34.351 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:34.351 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T14:19:34.382 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T14:19:34.382 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-09-11T14:19:34.438 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T14:19:34.438 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:19:34.438 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-11T14:19:34.438 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:19:34.438 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:19:34.438 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-11 14:19:29.336685573 +0000 2024-09-11T14:19:34.438 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-11 14:15:58.975093409 +0000 2024-09-11T14:19:34.438 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-11 14:15:58.975093409 +0000 2024-09-11T14:19:34.438 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-11 14:15:58.975093409 +0000 2024-09-11T14:19:34.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T14:19:34.502 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-11T14:19:34.502 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-11T14:19:34.502 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000104165 s, 4.9 MB/s 2024-09-11T14:19:34.504 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T14:19:34.561 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-09-11T14:19:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T14:19:34.617 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:19:34.617 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-11T14:19:34.617 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:19:34.617 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:19:34.617 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-11 14:19:29.337685562 +0000 2024-09-11T14:19:34.618 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-11 14:15:59.293089758 +0000 2024-09-11T14:19:34.618 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-11 14:15:59.293089758 +0000 2024-09-11T14:19:34.618 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-11 14:15:59.293089758 +0000 2024-09-11T14:19:34.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T14:19:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-11T14:19:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-11T14:19:34.681 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.9945e-05 s, 5.1 MB/s 2024-09-11T14:19:34.683 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T14:19:34.740 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-09-11T14:19:34.796 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T14:19:34.797 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:19:34.797 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T14:19:34.797 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:19:34.797 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:19:34.797 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-11 14:19:29.337685562 +0000 2024-09-11T14:19:34.797 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-11 14:15:59.632085866 +0000 2024-09-11T14:19:34.797 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-11 14:15:59.632085866 +0000 2024-09-11T14:19:34.797 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-11 14:15:59.632085866 +0000 2024-09-11T14:19:34.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T14:19:34.861 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-11T14:19:34.861 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-11T14:19:34.861 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 7.9851e-05 s, 6.4 MB/s 2024-09-11T14:19:34.862 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T14:19:34.919 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-09-11T14:19:34.974 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T14:19:34.975 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:19:34.975 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T14:19:34.975 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:19:34.975 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:19:34.975 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-11 14:19:29.337685562 +0000 2024-09-11T14:19:34.975 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-11 14:15:59.942082307 +0000 2024-09-11T14:19:34.975 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-11 14:15:59.942082307 +0000 2024-09-11T14:19:34.975 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-11 14:15:59.942082307 +0000 2024-09-11T14:19:34.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T14:19:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-11T14:19:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-11T14:19:35.039 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 7.9504e-05 s, 6.4 MB/s 2024-09-11T14:19:35.040 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T14:19:35.096 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:19:35.096 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:35.096 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T14:19:35.116 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T14:19:35.116 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-09-11T14:19:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T14:19:35.176 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:19:35.176 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T14:19:35.176 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:19:35.176 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:19:35.176 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-11 14:19:16.837789447 +0000 2024-09-11T14:19:35.177 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-11 14:16:06.389458481 +0000 2024-09-11T14:19:35.177 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-11 14:16:06.389458481 +0000 2024-09-11T14:19:35.177 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-11 14:16:06.389458481 +0000 2024-09-11T14:19:35.177 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T14:19:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-11T14:19:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-11T14:19:35.246 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000122344 s, 4.2 MB/s 2024-09-11T14:19:35.247 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T14:19:35.306 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-09-11T14:19:35.364 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T14:19:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:19:35.365 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-11T14:19:35.365 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:19:35.365 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:19:35.365 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-11 14:19:16.838789427 +0000 2024-09-11T14:19:35.365 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-11 14:16:06.704451992 +0000 2024-09-11T14:19:35.365 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-11 14:16:06.704451992 +0000 2024-09-11T14:19:35.365 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-11 14:16:06.704451992 +0000 2024-09-11T14:19:35.365 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T14:19:35.434 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-11T14:19:35.434 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-11T14:19:35.434 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000103443 s, 4.9 MB/s 2024-09-11T14:19:35.435 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T14:19:35.495 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-09-11T14:19:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T14:19:35.553 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:19:35.553 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T14:19:35.553 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:19:35.553 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:19:35.553 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-11 14:19:16.838789427 +0000 2024-09-11T14:19:35.554 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-11 14:16:07.021445461 +0000 2024-09-11T14:19:35.554 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-11 14:16:07.021445461 +0000 2024-09-11T14:19:35.554 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-11 14:16:07.021445461 +0000 2024-09-11T14:19:35.554 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T14:19:35.620 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-11T14:19:35.620 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-11T14:19:35.620 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 9.8181e-05 s, 5.2 MB/s 2024-09-11T14:19:35.621 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T14:19:35.680 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-09-11T14:19:35.738 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T14:19:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T14:19:35.739 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-11T14:19:35.739 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T14:19:35.739 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T14:19:35.739 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-11 14:19:16.839789405 +0000 2024-09-11T14:19:35.739 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-11 14:16:07.350438683 +0000 2024-09-11T14:19:35.739 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-11 14:16:07.350438683 +0000 2024-09-11T14:19:35.739 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-09-11 14:16:07.350438683 +0000 2024-09-11T14:19:35.739 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T14:19:35.806 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-11T14:19:35.806 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-11T14:19:35.806 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000111023 s, 4.6 MB/s 2024-09-11T14:19:35.807 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T14:19:35.865 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:19:35.866 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-11T14:19:35.866 INFO:tasks.ceph:Generating config... 2024-09-11T14:19:35.867 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-11T14:19:35.867 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-11T14:19:35.867 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-11T14:19:35.867 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-11T14:19:35.867 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-11T14:19:35.867 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T14:19:35.868 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T14:19:35.868 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T14:19:35.868 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-11T14:19:35.868 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-11T14:19:35.868 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-11T14:19:35.868 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-11T14:19:35.868 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-11T14:19:35.868 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T14:19:35.868 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T14:19:35.868 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T14:19:35.868 INFO:tasks.ceph:[osd] osd class default list = * 2024-09-11T14:19:35.868 INFO:tasks.ceph:[osd] osd class load list = * 2024-09-11T14:19:35.868 INFO:tasks.ceph:[osd] osd objectstore = seastore 2024-09-11T14:19:35.869 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-11T14:19:35.869 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T14:19:35.869 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:19:35.869 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-11T14:19:35.869 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-11T14:19:35.869 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-11T14:19:35.869 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-11T14:19:35.869 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-11T14:19:35.869 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-11T14:19:35.869 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T14:19:35.869 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T14:19:35.870 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-11T14:19:35.870 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-11T14:19:35.870 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-11T14:19:35.870 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-11T14:19:35.870 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-11T14:19:35.870 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T14:19:35.870 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T14:19:35.929 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T14:19:35.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T14:19:35.987 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:19:36.012 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46')] 2024-09-11T14:19:36.013 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-11T14:19:36.014 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:36.014 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:19:36.068 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:19:36.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:36.159+0000 7f77782d4f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:36.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:36.159+0000 7f77782d4f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:36.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:36.159+0000 7f77782d4f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 1036f700-a934-4ca9-974c-2362e4adfb5d 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 1036f700-a934-4ca9-974c-2362e4adfb5d 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-09-11T14:19:36.161020+0000 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-11T14:19:36.161020+0000 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 17 (quincy) 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-11T14:19:36.162 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-11T14:19:36.164 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T14:19:36.179 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1036f700-a934-4ca9-974c-2362e4adfb5d... 2024-09-11T14:19:36.180 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T14:19:36.222 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T14:19:36.263 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-09-11T14:19:36.263 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-09-11T14:19:36.264 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-09-11T14:19:36.265 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-09-11T14:19:36.266 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = 172.21.15.46 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: ms client mode = crc 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: ms cluster mode = crc 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: ms mon client mode = crc 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: ms mon cluster mode = crc 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: ms mon service mode = crc 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: ms service mode = crc 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 1036f700-a934-4ca9-974c-2362e4adfb5d 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-09-11T14:19:36.267 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2024-09-11T14:19:36.268 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-09-11T14:19:36.269 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: debug monc = 20 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: crimson alien thread cpu cores = 6-7 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: crimson osd obc lru size = 10 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: osd blocked scrub grace period = 3600 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: osd class default list = * 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: osd class load list = * 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = seastore 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: osd shutdown pgref assert = True 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-09-11T14:19:36.270 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: mgr stats period = 30 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-09-11T14:19:36.271 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-09-11T14:19:36.272 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: mon min osdmap epochs = 50 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: mon osdmap full prune interval = 2 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: mon osdmap full prune min = 15 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: mon osdmap full prune txsize = 2 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: paxos service trim min = 10 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on pool no app = False 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default crimson = True 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-09-11T14:19:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-09-11T14:19:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:19:36.275 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-09-11T14:19:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-09-11T14:19:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T14:19:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-09-11T14:19:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-09-11T14:19:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = 172.21.15.46 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: ms client mode = crc 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: ms cluster mode = crc 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: ms mon client mode = crc 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: ms mon cluster mode = crc 2024-09-11T14:19:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: ms mon service mode = crc 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: ms service mode = crc 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 1036f700-a934-4ca9-974c-2362e4adfb5d 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-09-11T14:19:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: debug monc = 20 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: crimson alien thread cpu cores = 6-7 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: crimson osd obc lru size = 10 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: osd blocked scrub grace period = 3600 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: osd class default list = * 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: osd class load list = * 2024-09-11T14:19:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = seastore 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: osd shutdown pgref assert = True 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: mgr stats period = 30 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.282 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T14:19:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: mon min osdmap epochs = 50 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: mon osdmap full prune interval = 2 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: mon osdmap full prune min = 15 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: mon osdmap full prune txsize = 2 2024-09-11T14:19:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: paxos service trim min = 10 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on pool no app = False 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default crimson = True 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:19:36.285 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-09-11T14:19:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:19:36.286 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-09-11T14:19:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: crimson seastar cpu cores = 0-2 2024-09-11T14:19:36.286 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-09-11T14:19:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: crimson seastar cpu cores = 3-5 2024-09-11T14:19:36.287 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T14:19:36.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T14:19:36.393 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T14:19:36.393 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:36.393 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T14:19:36.409 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:36.409 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T14:19:36.464 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-09-11T14:19:36.465 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:36.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T14:19:36.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:19:36.540 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:36.540 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:19:36.596 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-09-11T14:19:36.596 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:36.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T14:19:36.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T14:19:36.639 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:36.639 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:19:36.698 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T14:19:36.698 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T14:19:36.699 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:19:36.821 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T14:19:36.824 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T14:19:36.824 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T14:19:36.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T14:19:36.876 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T14:19:36.890 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T14:19:36.944 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T14:19:36.958 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T14:19:36.958 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-11T14:19:36.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T14:19:36.984 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:19:36.984 INFO:tasks.ceph:role: osd.0 2024-09-11T14:19:36.984 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-09-11T14:19:36.985 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T14:19:37.050 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:19:37.050 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:19:37.050 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:19:37.050 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:19:37.050 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:19:37.050 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:19:37.050 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:19:37.051 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:19:37.051 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:19:37.051 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:19:37.081 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-09-11T14:19:37.083 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-09-11T14:19:37.083 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T14:19:37.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T14:19:37.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T14:19:37.289 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-11T14:19:37.289 INFO:tasks.ceph:role: osd.1 2024-09-11T14:19:37.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-09-11T14:19:37.289 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T14:19:37.354 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:19:37.354 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:19:37.354 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:19:37.354 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:19:37.354 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:19:37.354 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:19:37.354 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:19:37.355 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:19:37.355 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:19:37.355 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:19:37.387 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-09-11T14:19:37.389 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-09-11T14:19:37.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T14:19:37.459 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T14:19:37.529 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:19:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:19:37.850 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-09-11 14:19:37,850 seastar - Reactor backend: linux-aio 2024-09-11T14:19:37.861 INFO:teuthology.orchestra.run.smithi046.stderr:==27759==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:19:37.987 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-09-11 14:19:37,987 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:19:37.987 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-09-11 14:19:37,987 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-11T14:19:37.988 INFO:teuthology.orchestra.run.smithi046.stderr:DEBUG 2024-09-11 14:19:37,988 [shard 0:main] seastar - reactor::drain 2024-09-11T14:19:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-09-11T14:19:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:Suppressions used: 2024-09-11T14:19:38.534 INFO:teuthology.orchestra.run.smithi046.stderr: count bytes template 2024-09-11T14:19:38.534 INFO:teuthology.orchestra.run.smithi046.stderr: 1 8 MallocExtension::Register 2024-09-11T14:19:38.534 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-09-11T14:19:38.534 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:19:38.592 INFO:teuthology.orchestra.run.smithi046.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:19:38.596 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-09-11 14:19:38,596 seastar - Reactor backend: linux-aio 2024-09-11T14:19:38.606 INFO:teuthology.orchestra.run.smithi046.stderr:==27757==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:19:38.671 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4b1e1 0x416ea59 0x5f9be94 0x5f9c090 0x5f9c61c 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:38.671 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:38.903 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x15979c 0xc928c 0xc9e39 0x36074f8 0x3b8bf76 0x3b8c16e 0xb9d303b 0xb9d32f0 0xb9bb6c1 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:38.903 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xba03285 0xba0ddad 0xba0df79 0xb9b508b 0xb9b5584 0xb9bb547 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:38.903 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:38.903 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:38.936 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xb9e76e2 0xb9e84f9 0xba16daf 0xba173f9 0xb9b1b84 0x9826801 0x9adc9e4 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:38.936 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x125008 0x421f3 0x3ecea 0xfc9b1 0x3869151 0x9826724 0x9a94640 0x9ae12f6 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x8b56c 0x10d76c 0x10a21a 0xfca1b 0x3869151 0xba09262 0xba0b407 0xba0b68f 0xba0b73f 0xb9bb10d 0xb9bf768 0xb9aa706 0xb9aaaea 0x9a95667 0x9ae1162 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:38.961 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:38.994 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133c2d 0xdd332 0x4ab1c 0xb9cc173 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9cff97 0xb9bbafc 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:38.994 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:39.034 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133cca 0xdd332 0x4b14c 0x3b8bfed 0x3b8c16e 0xb9cc2d7 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9e534f 0xba14441 0xba14a88 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:39.034 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:39.035 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xfd4af 0x361a453 0x361a65c 0x36292bb 0x382a110 0x4551048 0xb9b51da 0xb9b5584 0xb9bb547 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:39.035 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:39.092 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 123 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x3779719 0x3ac728c 0x3b8c163 0xb9cc10a 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9e50c4 0xba14441 0xba14a88 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:39.092 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:39.093 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x159587 0xc928c 0xc9e39 0x36074f8 0x3b8bf76 0x3b8c16e 0xb9d303b 0xb9d32f0 0xb9bb6c1 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:39.093 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:39.111 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x55250d1 0x9e169c9 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:39.111 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:39.169 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x10d778 0xdd31a 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:39.169 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:39.184 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xdd323 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:39.184 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525ea3 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:40.595 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-09-11T14:19:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:Suppressions used: 2024-09-11T14:19:40.596 INFO:teuthology.orchestra.run.smithi046.stderr: count bytes template 2024-09-11T14:19:40.596 INFO:teuthology.orchestra.run.smithi046.stderr: 1 8 MallocExtension::Register 2024-09-11T14:19:40.596 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-09-11T14:19:40.596 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:19:40.623 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T14:19:40.649 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:19:40.948 INFO:teuthology.orchestra.run.smithi046.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:19:40.949 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-09-11 14:19:40,949 seastar - Reactor backend: linux-aio 2024-09-11T14:19:40.955 INFO:teuthology.orchestra.run.smithi046.stderr:==27806==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:19:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x3816d8d 0x46228d8 0x5fbf1a1 0x5fbf3d2 0x5f9c46b 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3961af8 0x39632d2 0x3803c28 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:41.063 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:41.082 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-09-11 14:19:41,082 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:19:41.082 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-09-11 14:19:41,082 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-11T14:19:41.083 INFO:teuthology.orchestra.run.smithi046.stderr:DEBUG 2024-09-11 14:19:41,083 [shard 0:main] seastar - reactor::drain 2024-09-11T14:19:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-09-11T14:19:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:Suppressions used: 2024-09-11T14:19:41.629 INFO:teuthology.orchestra.run.smithi046.stderr: count bytes template 2024-09-11T14:19:41.629 INFO:teuthology.orchestra.run.smithi046.stderr: 1 8 MallocExtension::Register 2024-09-11T14:19:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-09-11T14:19:41.630 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:19:41.689 INFO:teuthology.orchestra.run.smithi046.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:19:41.693 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-09-11 14:19:41,693 seastar - Reactor backend: linux-aio 2024-09-11T14:19:41.703 INFO:teuthology.orchestra.run.smithi046.stderr:==27804==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:19:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x381936d 0x5de40fc 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xdd2f7 0x4ab1c 0x5c38e75 0x76be7f4 0xba0df35 0xb9b5055 0xb9b5584 0xb9bb547 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4ab3d 0xb9cc173 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9cf787 0xb9cf983 0xba1486d 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.037 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4b20c 0xb9cd878 0xb9cd9cc 0xb9e50c4 0xba14441 0xba14a88 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:42.037 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.062 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x37796e0 0x3b8beca 0x3b8c16e 0xb9e0c7e 0xba1c193 0xba1c51e 0xb9bc918 0xb9bf768 0xb9aa706 0xb9aaaea 0x9a95667 0x9ae1162 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.062 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x3765979 0x3765be5 0xb9c9657 0xb9c9790 0xb9bc401 0xb9bf768 0xb9aa706 0xb9aaaea 0x9a92ede 0x9ae12f6 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.062 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.062 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x10797f 0xdd2e1 0x4ab1c 0x3ac7312 0x3b8c163 0xb9cc2d7 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9d885b 0xb9d8d1e 0xba144ad 0xba14a88 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.136 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x60f75d8 0x60f76d7 0x60f795f 0xba1787f 0xba17966 0xba17b9c 0xba17d38 0xba180ce 0xba182e0 0xb9b515f 0xb9b5584 0xb9bb547 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.136 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.136 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xfd4bb 0xb8364fd 0xb8365b0 0xb8366c6 0xb8367a6 0xb836e66 0xb836fd1 0xb8373dc 0xb83769b 0xba13980 0xba13c1c 0xba13de3 0xba14057 0xba14160 0xba142dc 0xba14a88 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.137 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.194 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xb9cc25d 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9cf787 0xb9cf983 0xba1486d 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.194 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 123 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133c2b 0xdd332 0x4ab1c 0xb9cc173 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xba14d21 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9adb927 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.194 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.194 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.214 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525efa 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:42.214 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x9e169de 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.310 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x55252cf 0x9e169c9 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.310 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:42.310 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x9e169d6 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:42.310 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-09-11T14:19:43.681 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-09-11T14:19:43.681 INFO:teuthology.orchestra.run.smithi046.stderr:Suppressions used: 2024-09-11T14:19:43.681 INFO:teuthology.orchestra.run.smithi046.stderr: count bytes template 2024-09-11T14:19:43.681 INFO:teuthology.orchestra.run.smithi046.stderr: 1 8 MallocExtension::Register 2024-09-11T14:19:43.681 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-09-11T14:19:43.682 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:19:43.710 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T14:19:43.735 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T14:19:43.766 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:19:43.766 INFO:tasks.ceph:role: osd.2 2024-09-11T14:19:43.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-11T14:19:43.766 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T14:19:43.837 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:19:43.837 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:19:43.837 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:19:43.838 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:19:43.838 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:19:43.838 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:19:43.838 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:19:43.838 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:19:43.838 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:19:43.838 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:19:43.868 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-11T14:19:43.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-11T14:19:43.870 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-11T14:19:43.943 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T14:19:44.015 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T14:19:44.084 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-11T14:19:44.140 INFO:tasks.ceph:role: osd.3 2024-09-11T14:19:44.140 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-11T14:19:44.140 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T14:19:44.165 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T14:19:44.165 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T14:19:44.165 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T14:19:44.165 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T14:19:44.165 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T14:19:44.165 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-11T14:19:44.165 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T14:19:44.166 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T14:19:44.166 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T14:19:44.166 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T14:19:44.198 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-11T14:19:44.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-11T14:19:44.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-11T14:19:44.273 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T14:19:44.344 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:19:44.683 INFO:teuthology.orchestra.run.smithi047.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:19:44.684 INFO:teuthology.orchestra.run.smithi047.stderr:INFO 2024-09-11 14:19:44,684 seastar - Reactor backend: linux-aio 2024-09-11T14:19:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:==27882==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:19:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x10a29f 0xfe63e 0x3626879 0x3626993 0x5f9cc34 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3961af8 0x39632d2 0x3803c28 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:44.827 INFO:teuthology.orchestra.run.smithi047.stderr:INFO 2024-09-11 14:19:44,827 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:19:44.828 INFO:teuthology.orchestra.run.smithi047.stderr:INFO 2024-09-11 14:19:44,827 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-11T14:19:44.828 INFO:teuthology.orchestra.run.smithi047.stderr:DEBUG 2024-09-11 14:19:44,828 [shard 0:main] seastar - reactor::drain 2024-09-11T14:19:45.374 INFO:teuthology.orchestra.run.smithi047.stderr:----------------------------------------------------- 2024-09-11T14:19:45.375 INFO:teuthology.orchestra.run.smithi047.stderr:Suppressions used: 2024-09-11T14:19:45.375 INFO:teuthology.orchestra.run.smithi047.stderr: count bytes template 2024-09-11T14:19:45.375 INFO:teuthology.orchestra.run.smithi047.stderr: 1 8 MallocExtension::Register 2024-09-11T14:19:45.375 INFO:teuthology.orchestra.run.smithi047.stderr:----------------------------------------------------- 2024-09-11T14:19:45.375 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-11T14:19:45.435 INFO:teuthology.orchestra.run.smithi047.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:19:45.439 INFO:teuthology.orchestra.run.smithi047.stderr:INFO 2024-09-11 14:19:45,438 seastar - Reactor backend: linux-aio 2024-09-11T14:19:45.449 INFO:teuthology.orchestra.run.smithi047.stderr:==27873==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:19:45.514 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x8b56c 0x10d76c 0xdd31a 0x4ab1c 0x5c38e75 0x601bce1 0x5f9beb6 0x5f9c090 0x5f9c61c 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:45.514 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.745 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x125008 0x421f3 0x3ef7b 0xfd531 0xb8364fd 0xba1699c 0xba16ace 0xba16c4a 0xba173f9 0xb9b1b84 0x9826801 0x9adc9e4 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x377972b 0x3b8beca 0x3b8c16e 0xb9cc10a 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9cf787 0xb9cfbd2 0xb9bbafc 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.746 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.778 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4c686 0x9bff1bd 0x9bff4f4 0x9adcc6f 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:45.779 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.803 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x361cc1a 0xb82f28c 0xb9ae996 0xba0b448 0xba0b68f 0xba0b73f 0xb9bb10d 0xb9bf768 0xb9aa706 0xb9aaaea 0x9a95667 0x9ae12f6 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:45.803 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.803 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x124f5f 0x44735 0xfb4fb 0x3767eab 0x98268c2 0x9a94b4a 0x9ae12f6 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:45.803 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.836 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x42198 0x3ef7b 0xfd531 0xb8364fd 0xb8365b0 0xb8366c6 0xb8367a6 0xb836e66 0xb836fd1 0xb8373dc 0xb83769b 0xba13980 0xba13c1c 0xba13de3 0xba14057 0xba14160 0xba142dc 0xba14a88 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:45.836 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffa061f38f 0xffffffffa0620be9 0xffffffffa058e0bc 0xffffffffa0596a3b 0xffffffffa0596ebc 0xffffffffa028c884 0xffffffffa0ed1d62 0xffffffffa1000bb2 2024-09-11T14:19:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x60f5267 0x60fc3ac 0x60fc49c 0x60fc503 0x60fc979 0x60fca36 0xb9b5143 0xb9b5584 0xb9bb547 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4b8a1 0xba16e92 0xba173f9 0xb9b1b84 0x9826801 0x9adcfca 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.934 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 123 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xb9b121e 0x9826801 0x9adcfca 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:45.935 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.935 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xdd323 0x4b14c 0x60f7553 0x60f76d7 0x60f795f 0xba1787f 0xba17966 0xba17b9c 0xba17d38 0xba180ce 0xba182e0 0xb9b515f 0xb9b5584 0xb9bb547 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:45.935 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:45.954 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525da3 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:45.954 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133d09 0xdd332 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:46.012 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525479 0x9e169de 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525912 0x9e169eb 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:46.049 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:47.418 INFO:teuthology.orchestra.run.smithi047.stderr:----------------------------------------------------- 2024-09-11T14:19:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:Suppressions used: 2024-09-11T14:19:47.419 INFO:teuthology.orchestra.run.smithi047.stderr: count bytes template 2024-09-11T14:19:47.419 INFO:teuthology.orchestra.run.smithi047.stderr: 1 8 MallocExtension::Register 2024-09-11T14:19:47.419 INFO:teuthology.orchestra.run.smithi047.stderr:----------------------------------------------------- 2024-09-11T14:19:47.419 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-11T14:19:47.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T14:19:47.473 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:19:47.769 INFO:teuthology.orchestra.run.smithi047.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:19:47.770 INFO:teuthology.orchestra.run.smithi047.stderr:INFO 2024-09-11 14:19:47,770 seastar - Reactor backend: linux-aio 2024-09-11T14:19:47.776 INFO:teuthology.orchestra.run.smithi047.stderr:==27932==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:19:47.884 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x10d767 0xdd31a 0x4ab1c 0x5fccd96 0x5fccf5e 0x5fcd18f 0x5fcd465 0x601bb63 0x601bd69 0x5f9beb6 0x5f9c3ea 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3961af8 0x39632d2 0x3803c28 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:47.885 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:INFO 2024-09-11 14:19:47,903 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-11T14:19:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:INFO 2024-09-11 14:19:47,903 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-11T14:19:47.904 INFO:teuthology.orchestra.run.smithi047.stderr:DEBUG 2024-09-11 14:19:47,904 [shard 0:main] seastar - reactor::drain 2024-09-11T14:19:48.431 INFO:teuthology.orchestra.run.smithi047.stderr:----------------------------------------------------- 2024-09-11T14:19:48.431 INFO:teuthology.orchestra.run.smithi047.stderr:Suppressions used: 2024-09-11T14:19:48.431 INFO:teuthology.orchestra.run.smithi047.stderr: count bytes template 2024-09-11T14:19:48.431 INFO:teuthology.orchestra.run.smithi047.stderr: 1 8 MallocExtension::Register 2024-09-11T14:19:48.431 INFO:teuthology.orchestra.run.smithi047.stderr:----------------------------------------------------- 2024-09-11T14:19:48.431 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-11T14:19:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-11T14:19:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:INFO 2024-09-11 14:19:48,495 seastar - Reactor backend: linux-aio 2024-09-11T14:19:48.506 INFO:teuthology.orchestra.run.smithi047.stderr:==27930==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-11T14:19:48.571 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5da4ec2 0x5fccf6b 0x5fcd18f 0x5fcd465 0x601bb63 0x601bd69 0x5f9beb6 0x5f9c3ea 0x5de41ab 0x5dfc3ed 0x713aa42 0x714c215 0x714d6b2 0x714d737 0x714d839 0x714d931 0x714db3e 0x714dd24 0x714e073 0x714e417 0x714e647 0x714e8b1 0x714eb7e 0x714ed9c 0x714ee54 0x714ef1a 0x714effb 0x5c46fec 0x5c470f6 0x5c471b2 0x5c4726e 0x5c4732a 0x5c47477 0x5c47602 0x5c479c3 0x5c617c6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:48.571 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:48.812 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133d18 0xdd332 0x4b14c 0x3b8bfed 0x3b8c16e 0xb9cc10a 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9cf787 0xb9cfbd2 0xb9bbafc 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:48.812 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:48.812 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4ab0c 0xb9cc173 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9cf787 0xb9cfbd2 0xb9bbafc 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:48.812 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:48.845 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x124fdf 0x421f3 0x3ecea 0xfc9b1 0x387c2f3 0x387c5ba 0xb9b559c 0xb9bb547 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:48.845 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:48.870 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4218a 0x3ecea 0xfc9b1 0x3869151 0xb837ac3 0xba08e26 0xb9adfe1 0x9a93c27 0x9ae0fce 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:48.870 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffa028c7a4 0xffffffffa0ed1d62 0xffffffffa1000bb2 2024-09-11T14:19:48.870 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 90 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xba1c47d 0xb9bc918 0xb9bf768 0xb9aa706 0xb9aaaea 0x9a92ede 0x9ae0fce 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x931105d 0x9311ffc 0x931207f 0x9312104 0x9312206 0x93122fe 0x9312384 0x931243d 0x93125f3 0x931272b 0x93127a6 0x931282b 0x9312986 0x9312aa0 0x9312b25 0x9312c03 0x95358f6 0x95fe663 0x95fe7e0 0x96bf541 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:48.870 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:48.903 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 123 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4ab10 0x3ac7312 0x3b8c163 0xb9cc2d7 0xb9cd5aa 0xb9cd824 0xb9cd9cc 0xb9e534f 0xba14441 0xba14a88 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:48.903 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:48.946 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x4aba4 0x3ac7312 0x3b8c163 0xb9d303b 0xb9d6aa9 0xba1a4cc 0xb9bb752 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:48.946 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 66 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x3b8bf88 0x3b8c16e 0xb9e0f26 0xba1c193 0xba1c51e 0xb9bc918 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:48.946 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:48.946 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 123 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xb9c8c3c 0xba14ccf 0xb9bbd3f 0xb9bf768 0xb9aa706 0xb9aaaea 0x9add093 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 123 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0xba0334c 0xba0ddad 0xba0df79 0xb9b508b 0xb9b5584 0xb9bb547 0xb9bf768 0xb9aa706 0xb9aaaea 0x9adde94 0x9af4be2 0x99851d8 0x99259c1 0x925770d 0x9257e22 0x925833e 0x92584c7 0x925870e 0x92589e6 0x9258a9b 0x9575d58 0x9575fbd 0x95adfa3 0x96b258e 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:49.004 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x133d18 0xdd332 0x4ab1c 0x5525fb7 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:49.024 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:49.081 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 122 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x5525fac 0x9e169b0 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc3f06d 0xb90d93d 0xb90e175 0x3804438 0x2958f 0x2963f 0x35eb9b4 2024-09-11T14:19:49.082 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:49.122 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x55254bc 0x9e169de 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:49.122 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:49.122 INFO:teuthology.orchestra.run.smithi047.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: 0x82dff 0xbc8b3bf 0xbb63d49 0xbb652b4 0xbb654ca 0xbb65620 0xbb65ae9 0x3e6ef 0x552586d 0x9e169eb 0x9e85ea9 0x9eb66a1 0x9e1dc34 0x993c1c7 0x985b5d2 0x987fc92 0x987fdf1 0x989168e 0x989185e 0x9891b6c 0x9891e7b 0x9891fda 0x9892055 0x989229c 0x9892560 0x98925f0 0x9892694 0x95a6522 0x95a6787 0x95aed2c 0x96a13d6 0xbb782f7 0xbb90175 0xbc3da1f 0xbc5001b 0xbc5069d 0x7b13cb5 0xc5e5db4 0x5e669 0x89c51 0x10ec7f 2024-09-11T14:19:49.122 INFO:teuthology.orchestra.run.smithi047.stderr:kernel callstack: 2024-09-11T14:19:50.500 INFO:teuthology.orchestra.run.smithi047.stderr:----------------------------------------------------- 2024-09-11T14:19:50.500 INFO:teuthology.orchestra.run.smithi047.stderr:Suppressions used: 2024-09-11T14:19:50.500 INFO:teuthology.orchestra.run.smithi047.stderr: count bytes template 2024-09-11T14:19:50.500 INFO:teuthology.orchestra.run.smithi047.stderr: 1 8 MallocExtension::Register 2024-09-11T14:19:50.500 INFO:teuthology.orchestra.run.smithi047.stderr:----------------------------------------------------- 2024-09-11T14:19:50.500 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-11T14:19:50.527 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T14:19:50.553 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T14:19:50.553 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:50.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T14:19:50.585 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:50.585 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T14:19:50.656 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:50.656 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T14:19:50.682 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:50.682 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T14:19:50.748 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:50.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T14:19:50.814 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:50.814 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T14:19:50.833 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:50.833 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T14:19:50.869 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T14:19:50.869 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T14:19:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-09-11T14:19:50.901 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQD6puFmvuFXLRAAp+W3IRa0FxX/708xQmqC6Q== 2024-09-11T14:19:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-09-11T14:19:50.901 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQD9puFmgNNSMxAArTS3pVEY6Qx1Qw4+xEg3Pg== 2024-09-11T14:19:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-09-11T14:19:50.902 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQD4puFmcibuMBAAEKOQZO0p+iCAeb2sbiylYg== 2024-09-11T14:19:50.902 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-09-11T14:19:50.902 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQABp+Fmx8z3IxAAa8Rc8ZJov2jafioLZpxvTg== 2024-09-11T14:19:50.902 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-09-11T14:19:50.902 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAEp+FmpP6qJxAAr+d2iWam8MooOHzHiGLLdQ== 2024-09-11T14:19:50.902 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-09-11T14:19:50.902 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQD4puFmqBU7NBAA3xJQOfOupielIlWYQRaPvw== 2024-09-11T14:19:50.902 INFO:teuthology.orchestra.run.smithi046.stdout:[client.1] 2024-09-11T14:19:50.902 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQD4puFml/k/OBAAQnIU7hzi9CVXe5H2oLSouw== 2024-09-11T14:19:50.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:19:51.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:19:51.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T14:19:51.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:19:51.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T14:19:51.266 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T14:19:51.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T14:19:51.401 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T14:19:51.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T14:19:51.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T14:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.538+0000 7fe81f165c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.538+0000 7fe81f165c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T14:19:51.578 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T14:19:51.634 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T14:19:51.635 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T14:19:51.635 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T14:19:51.676 INFO:tasks.ceph.mon.a:Started 2024-09-11T14:19:51.676 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T14:19:51.676 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T14:19:51.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T14:19:51.679 INFO:tasks.ceph.mgr.x:Started 2024-09-11T14:19:51.679 DEBUG:tasks.ceph:set 0 configs 2024-09-11T14:19:51.679 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T14:19:51.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T14:19:51.759 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-09-11T14:19:51.757+0000 7f7817eefc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.759 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-09-11T14:19:51.758+0000 7f7817eefc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.759 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-09-11T14:19:51.758+0000 7f7817eefc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.786 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-11T14:19:51.785+0000 7f45cb5c2000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.783+0000 7fe014474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.790+0000 7fe014474640 1 Processor -- start 2024-09-11T14:19:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.790+0000 7fe014474640 1 -- start start 2024-09-11T14:19:51.793 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-11T14:19:51.792+0000 7f45cb5c2000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.794 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-11T14:19:51.792+0000 7f45cb5c2000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.792+0000 7fe014474640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe00c138720 0x7fe00c13ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.792+0000 7fe014474640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe00c133040 con 0x7fe00c132520 2024-09-11T14:19:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.792+0000 7fe014474640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fe00c06f6d0 con 0x7fe00c138720 2024-09-11T14:19:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.792+0000 7fe012210640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe00c132520 0x7fe00c132930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58684/0 (socket says 172.21.15.46:58684) 2024-09-11T14:19:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.792+0000 7fe012210640 1 -- 172.21.15.46:0/3026864279 learned_addr learned my addr 172.21.15.46:0/3026864279 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:19:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.792+0000 7fe011a0f640 1 --2- 172.21.15.46:0/3026864279 >> v2:172.21.15.46:3300/0 conn(0x7fe00c138720 0x7fe00c13ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.793+0000 7fe01120e640 1 -- 172.21.15.46:0/3026864279 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515806384 0 0) 0x7fe008001110 con 0x7fe00c132520 2024-09-11T14:19:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.793+0000 7fe01120e640 1 -- 172.21.15.46:0/3026864279 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdff8003580 con 0x7fe00c132520 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.793+0000 7fe01120e640 1 -- 172.21.15.46:0/3026864279 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 27649985 0 0) 0x7fdff8003580 con 0x7fe00c132520 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.793+0000 7fe011a0f640 1 -- 172.21.15.46:0/3026864279 >> v1:172.21.15.46:6789/0 conn(0x7fe00c132520 legacy=0x7fe00c132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.793+0000 7fe011a0f640 1 -- 172.21.15.46:0/3026864279 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c06f3d0 con 0x7fe00c138720 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.793+0000 7fe011a0f640 1 --2- 172.21.15.46:0/3026864279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c138720 0x7fe00c13ab40 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3e2c2686933272 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.793+0000 7fe01120e640 1 -- 172.21.15.46:0/3026864279 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe0080017b0 con 0x7fe00c138720 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.793+0000 7fe01120e640 1 -- 172.21.15.46:0/3026864279 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdffc009b50 con 0x7fe00c138720 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.793+0000 7fe01120e640 1 -- 172.21.15.46:0/3026864279 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdffc009df0 con 0x7fe00c138720 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.794+0000 7fe014474640 1 -- 172.21.15.46:0/3026864279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c138720 msgr2=0x7fe00c13ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.794+0000 7fe014474640 1 --2- 172.21.15.46:0/3026864279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c138720 0x7fe00c13ab40 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.794+0000 7fe014474640 1 -- 172.21.15.46:0/3026864279 shutdown_connections 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.794+0000 7fe014474640 1 --2- 172.21.15.46:0/3026864279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c138720 0x7fe00c13ab40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.794+0000 7fe014474640 1 -- 172.21.15.46:0/3026864279 >> 172.21.15.46:0/3026864279 conn(0x7fe00c06e490 msgr2=0x7fe00c06e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.794+0000 7fe014474640 1 -- 172.21.15.46:0/3026864279 shutdown_connections 2024-09-11T14:19:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.794+0000 7fe014474640 1 -- 172.21.15.46:0/3026864279 wait complete. 2024-09-11T14:19:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.795+0000 7fe014474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.796+0000 7fe014474640 1 Processor -- start 2024-09-11T14:19:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.796+0000 7fe014474640 1 -- start start 2024-09-11T14:19:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.798+0000 7fe014474640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c132520 0x7fe00c11f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.798+0000 7fe014474640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe00c1210f0 con 0x7fe00c132520 2024-09-11T14:19:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.798+0000 7fe012210640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c132520 0x7fe00c11f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.798+0000 7fe012210640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c132520 0x7fe00c11f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52874/0 (socket says 172.21.15.46:52874) 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.798+0000 7fe012210640 1 -- 172.21.15.46:0/3617966194 learned_addr learned my addr 172.21.15.46:0/3617966194 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.798+0000 7fe012210640 1 -- 172.21.15.46:0/3617966194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00c11f2a0 con 0x7fe00c132520 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.798+0000 7fe012210640 1 --2- 172.21.15.46:0/3617966194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c132520 0x7fe00c11f660 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.799+0000 7fe002ffd640 1 -- 172.21.15.46:0/3617966194 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe008004b80 con 0x7fe00c132520 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.799+0000 7fe002ffd640 1 -- 172.21.15.46:0/3617966194 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe008004ce0 con 0x7fe00c132520 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.799+0000 7fe014474640 1 -- 172.21.15.46:0/3617966194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00c11eca0 con 0x7fe00c132520 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.799+0000 7fe002ffd640 1 -- 172.21.15.46:0/3617966194 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe008007120 con 0x7fe00c132520 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.799+0000 7fe014474640 1 -- 172.21.15.46:0/3617966194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00c121580 con 0x7fe00c132520 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.799+0000 7fe002ffd640 1 -- 172.21.15.46:0/3617966194 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fe00800c600 con 0x7fe00c132520 2024-09-11T14:19:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.799+0000 7fe002ffd640 1 -- 172.21.15.46:0/3617966194 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7fe00800fb10 con 0x7fe00c132520 2024-09-11T14:19:51.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.800+0000 7fe014474640 1 -- 172.21.15.46:0/3617966194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe00c06a300 con 0x7fe00c132520 2024-09-11T14:19:51.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.802+0000 7fe002ffd640 1 -- 172.21.15.46:0/3617966194 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fe00c133040 con 0x7fe00c132520 2024-09-11T14:19:51.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.868+0000 7fe014474640 1 -- 172.21.15.46:0/3617966194 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe00c132930 con 0x7fe00c132520 2024-09-11T14:19:51.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.868+0000 7fe002ffd640 1 -- 172.21.15.46:0/3617966194 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7fe008007660 con 0x7fe00c132520 2024-09-11T14:19:51.870 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-09-11T14:19:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.869+0000 7fe014474640 1 -- 172.21.15.46:0/3617966194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c132520 msgr2=0x7fe00c11f660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.869+0000 7fe014474640 1 --2- 172.21.15.46:0/3617966194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c132520 0x7fe00c11f660 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.869+0000 7fe014474640 1 -- 172.21.15.46:0/3617966194 shutdown_connections 2024-09-11T14:19:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.869+0000 7fe014474640 1 --2- 172.21.15.46:0/3617966194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe00c132520 0x7fe00c11f660 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.869+0000 7fe014474640 1 -- 172.21.15.46:0/3617966194 >> 172.21.15.46:0/3617966194 conn(0x7fe00c06e490 msgr2=0x7fe00c0a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.869+0000 7fe014474640 1 -- 172.21.15.46:0/3617966194 shutdown_connections 2024-09-11T14:19:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.869+0000 7fe014474640 1 -- 172.21.15.46:0/3617966194 wait complete. 2024-09-11T14:19:51.882 INFO:tasks.ceph:check_enable_crimson: True 2024-09-11T14:19:51.882 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-11T14:19:51.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-11T14:19:51.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.985+0000 7f895f311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.991+0000 7f895f311640 1 Processor -- start 2024-09-11T14:19:51.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.992+0000 7f895f311640 1 -- start start 2024-09-11T14:19:51.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.993+0000 7f895f311640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f89581365a0 0x7f89581389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:51.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.993+0000 7f895f311640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8958074a00 con 0x7f8958130420 2024-09-11T14:19:51.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.993+0000 7f895f311640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f8958074c30 con 0x7f89581365a0 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.993+0000 7f895c8ac640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f89581365a0 0x7f89581389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.993+0000 7f895c8ac640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f89581365a0 0x7f89581389c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52878/0 (socket says 172.21.15.46:52878) 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.993+0000 7f895d0ad640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8958130420 0x7f8958130830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58686/0 (socket says 172.21.15.46:58686) 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.993+0000 7f895c8ac640 1 -- 172.21.15.46:0/4051826955 learned_addr learned my addr 172.21.15.46:0/4051826955 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.994+0000 7f895c8ac640 1 -- 172.21.15.46:0/4051826955 >> v1:172.21.15.46:6789/0 conn(0x7f8958130420 legacy=0x7f8958130830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.994+0000 7f8957fff640 1 -- 172.21.15.46:0/4051826955 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947026854 0 0) 0x7f8958074a00 con 0x7f8958130420 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.994+0000 7f895c8ac640 1 -- 172.21.15.46:0/4051826955 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8958071930 con 0x7f89581365a0 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.994+0000 7f895c8ac640 1 --2- 172.21.15.46:0/4051826955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89581365a0 0x7f89581389c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc9e8ee2290d9b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.994+0000 7f8957fff640 1 -- 172.21.15.46:0/4051826955 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f894c009e50 con 0x7f89581365a0 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.994+0000 7f8957fff640 1 -- 172.21.15.46:0/4051826955 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f894c00e230 con 0x7f89581365a0 2024-09-11T14:19:51.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.994+0000 7f8957fff640 1 -- 172.21.15.46:0/4051826955 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f894c00e4d0 con 0x7f89581365a0 2024-09-11T14:19:51.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.995+0000 7f895f311640 1 -- 172.21.15.46:0/4051826955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89581365a0 msgr2=0x7f89581389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:51.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.995+0000 7f895f311640 1 --2- 172.21.15.46:0/4051826955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89581365a0 0x7f89581389c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:51.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.995+0000 7f895f311640 1 -- 172.21.15.46:0/4051826955 shutdown_connections 2024-09-11T14:19:51.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.995+0000 7f895f311640 1 --2- 172.21.15.46:0/4051826955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89581365a0 0x7f89581389c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:51.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.995+0000 7f895f311640 1 -- 172.21.15.46:0/4051826955 >> 172.21.15.46:0/4051826955 conn(0x7f89580a0320 msgr2=0x7f89580a0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:51.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.995+0000 7f895f311640 1 -- 172.21.15.46:0/4051826955 shutdown_connections 2024-09-11T14:19:51.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.995+0000 7f895f311640 1 -- 172.21.15.46:0/4051826955 wait complete. 2024-09-11T14:19:51.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.995+0000 7f895f311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:51.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.997+0000 7f895f311640 1 Processor -- start 2024-09-11T14:19:51.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.997+0000 7f895f311640 1 -- start start 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.998+0000 7f895f311640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958130420 0x7f895812fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.998+0000 7f895f311640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f895811df50 con 0x7f8958130420 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f895d0ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958130420 0x7f895812fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f895d0ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958130420 0x7f895812fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52894/0 (socket says 172.21.15.46:52894) 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f895d0ad640 1 -- 172.21.15.46:0/1198598739 learned_addr learned my addr 172.21.15.46:0/1198598739 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f895d0ad640 1 -- 172.21.15.46:0/1198598739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8958120bf0 con 0x7f8958130420 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f895d0ad640 1 --2- 172.21.15.46:0/1198598739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958130420 0x7f895812fb70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f8955ffb640 1 -- 172.21.15.46:0/1198598739 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8948004b80 con 0x7f8958130420 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f8955ffb640 1 -- 172.21.15.46:0/1198598739 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8948004ce0 con 0x7f8958130420 2024-09-11T14:19:52.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f895f311640 1 -- 172.21.15.46:0/1198598739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895811e690 con 0x7f8958130420 2024-09-11T14:19:52.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f8955ffb640 1 -- 172.21.15.46:0/1198598739 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8948007120 con 0x7f8958130420 2024-09-11T14:19:52.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f8955ffb640 1 -- 172.21.15.46:0/1198598739 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f894800c520 con 0x7f8958130420 2024-09-11T14:19:52.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:51.999+0000 7f895f311640 1 -- 172.21.15.46:0/1198598739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8958120030 con 0x7f8958130420 2024-09-11T14:19:52.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.000+0000 7f8955ffb640 1 -- 172.21.15.46:0/1198598739 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7f894800cd90 con 0x7f8958130420 2024-09-11T14:19:52.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.000+0000 7f895f311640 1 -- 172.21.15.46:0/1198598739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f895806a300 con 0x7f8958130420 2024-09-11T14:19:52.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.003+0000 7f8955ffb640 1 -- 172.21.15.46:0/1198598739 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f8948007660 con 0x7f8958130420 2024-09-11T14:19:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.078+0000 7f895f311640 1 -- 172.21.15.46:0/1198598739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7f8958130830 con 0x7f8958130420 2024-09-11T14:19:52.080 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-09-11T14:19:52.078+0000 7f780ebf4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-11T14:19:52.080 INFO:tasks.ceph.mon.a.smithi046.stderr:Please be aware that this feature is experimental, untested, 2024-09-11T14:19:52.080 INFO:tasks.ceph.mon.a.smithi046.stderr:unsupported, and may result in data corruption, data loss, 2024-09-11T14:19:52.080 INFO:tasks.ceph.mon.a.smithi046.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-11T14:19:52.080 INFO:tasks.ceph.mon.a.smithi046.stderr:feature with important data. 2024-09-11T14:19:52.080 INFO:tasks.ceph.mon.a.smithi046.stderr: 2024-09-11T14:19:52.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.869+0000 7f8955ffb640 1 -- 172.21.15.46:0/1198598739 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7f894800e290 con 0x7f8958130420 2024-09-11T14:19:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.870+0000 7f895f311640 1 -- 172.21.15.46:0/1198598739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958130420 msgr2=0x7f895812fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.870+0000 7f895f311640 1 --2- 172.21.15.46:0/1198598739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958130420 0x7f895812fb70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.870+0000 7f895f311640 1 -- 172.21.15.46:0/1198598739 shutdown_connections 2024-09-11T14:19:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.870+0000 7f895f311640 1 --2- 172.21.15.46:0/1198598739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958130420 0x7f895812fb70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.870+0000 7f895f311640 1 -- 172.21.15.46:0/1198598739 >> 172.21.15.46:0/1198598739 conn(0x7f89580a0320 msgr2=0x7f895809ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.871+0000 7f895f311640 1 -- 172.21.15.46:0/1198598739 shutdown_connections 2024-09-11T14:19:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:52.871+0000 7f895f311640 1 -- 172.21.15.46:0/1198598739 wait complete. 2024-09-11T14:19:52.885 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T14:19:52.886 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:52.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T14:19:52.914 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:19:52.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T14:19:52.982 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:52.982 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T14:19:53.009 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-11T14:19:53.009 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T14:19:53.074 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 38ba4d14-fba0-43ad-8341-3a4dff407458 0 2024-09-11T14:19:53.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.219+0000 7feb5d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:53.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.225+0000 7feb5d551640 1 Processor -- start 2024-09-11T14:19:53.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.226+0000 7feb5d551640 1 -- start start 2024-09-11T14:19:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.226+0000 7feb5d551640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feb581191d0 0x7feb581195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.226+0000 7feb5d551640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb58114ff0 con 0x7feb581144d0 2024-09-11T14:19:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.226+0000 7feb5d551640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7feb58115180 con 0x7feb581191d0 2024-09-11T14:19:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.226+0000 7feb56ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feb581191d0 0x7feb581195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.227+0000 7feb56ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7feb581191d0 0x7feb581195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.47:35370/0 (socket says 172.21.15.47:35370) 2024-09-11T14:19:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.227+0000 7feb56ffd640 1 -- 172.21.15.47:0/2713644560 learned_addr learned my addr 172.21.15.47:0/2713644560 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-11T14:19:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.227+0000 7feb56ffd640 1 -- 172.21.15.47:0/2713644560 >> v1:172.21.15.46:6789/0 conn(0x7feb581144d0 legacy=0x7feb581148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.227+0000 7feb56ffd640 1 -- 172.21.15.47:0/2713644560 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb581152f0 con 0x7feb581191d0 2024-09-11T14:19:53.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.227+0000 7feb56ffd640 1 --2- 172.21.15.47:0/2713644560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581191d0 0x7feb581195e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fbfd86ef95c056 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.227+0000 7feb55ffb640 1 -- 172.21.15.47:0/2713644560 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb48009e50 con 0x7feb581191d0 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.227+0000 7feb55ffb640 1 -- 172.21.15.47:0/2713644560 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb4800e230 con 0x7feb581191d0 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.227+0000 7feb55ffb640 1 -- 172.21.15.47:0/2713644560 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb4800e4d0 con 0x7feb581191d0 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.228+0000 7feb5d551640 1 -- 172.21.15.47:0/2713644560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581191d0 msgr2=0x7feb581195e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.228+0000 7feb5d551640 1 --2- 172.21.15.47:0/2713644560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581191d0 0x7feb581195e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.228+0000 7feb5d551640 1 -- 172.21.15.47:0/2713644560 shutdown_connections 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.228+0000 7feb5d551640 1 --2- 172.21.15.47:0/2713644560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581191d0 0x7feb581195e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.228+0000 7feb5d551640 1 -- 172.21.15.47:0/2713644560 >> 172.21.15.47:0/2713644560 conn(0x7feb5806ff60 msgr2=0x7feb58112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.228+0000 7feb5d551640 1 -- 172.21.15.47:0/2713644560 shutdown_connections 2024-09-11T14:19:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.228+0000 7feb5d551640 1 -- 172.21.15.47:0/2713644560 wait complete. 2024-09-11T14:19:53.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.228+0000 7feb5d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:53.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.229+0000 7feb5d551640 1 Processor -- start 2024-09-11T14:19:53.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.229+0000 7feb5d551640 1 -- start start 2024-09-11T14:19:53.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.230+0000 7feb5d551640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581144d0 0x7feb581a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:53.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.230+0000 7feb5d551640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feb581a96c0 con 0x7feb581144d0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.230+0000 7feb56ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581144d0 0x7feb581a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.230+0000 7feb56ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581144d0 0x7feb581a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.47:35384/0 (socket says 172.21.15.47:35384) 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.230+0000 7feb56ffd640 1 -- 172.21.15.47:0/476932735 learned_addr learned my addr 172.21.15.47:0/476932735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.230+0000 7feb56ffd640 1 -- 172.21.15.47:0/476932735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb581a9800 con 0x7feb581144d0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.230+0000 7feb56ffd640 1 --2- 172.21.15.47:0/476932735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581144d0 0x7feb581a90f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.231+0000 7feb3f7fe640 1 -- 172.21.15.47:0/476932735 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb4800eea0 con 0x7feb581144d0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.231+0000 7feb3f7fe640 1 -- 172.21.15.47:0/476932735 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb48015420 con 0x7feb581144d0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.231+0000 7feb5d551640 1 -- 172.21.15.47:0/476932735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb581a9a50 con 0x7feb581144d0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.231+0000 7feb3f7fe640 1 -- 172.21.15.47:0/476932735 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb48015710 con 0x7feb581144d0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.231+0000 7feb5d551640 1 -- 172.21.15.47:0/476932735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb581ae9d0 con 0x7feb581144d0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.231+0000 7feb3f7fe640 1 -- 172.21.15.47:0/476932735 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7feb48015c00 con 0x7feb581144d0 2024-09-11T14:19:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.231+0000 7feb3f7fe640 1 -- 172.21.15.47:0/476932735 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7feb480116d0 con 0x7feb581144d0 2024-09-11T14:19:53.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.232+0000 7feb5d551640 1 -- 172.21.15.47:0/476932735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb581203d0 con 0x7feb581144d0 2024-09-11T14:19:53.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.234+0000 7feb3f7fe640 1 -- 172.21.15.47:0/476932735 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7feb48011930 con 0x7feb581144d0 2024-09-11T14:19:53.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.306+0000 7feb5d551640 1 -- 172.21.15.47:0/476932735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "38ba4d14-fba0-43ad-8341-3a4dff407458", "id": 0} v 0) -- 0x7feb581205d0 con 0x7feb581144d0 2024-09-11T14:19:53.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.308+0000 7feb3f7fe640 1 -- 172.21.15.47:0/476932735 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38ba4d14-fba0-43ad-8341-3a4dff407458", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7feb48011b50 con 0x7feb581144d0 2024-09-11T14:19:53.309 INFO:teuthology.orchestra.run.smithi047.stdout:0 2024-09-11T14:19:53.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.309+0000 7feb5d551640 1 -- 172.21.15.47:0/476932735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581144d0 msgr2=0x7feb581a90f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.309+0000 7feb5d551640 1 --2- 172.21.15.47:0/476932735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581144d0 0x7feb581a90f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.309+0000 7feb5d551640 1 -- 172.21.15.47:0/476932735 shutdown_connections 2024-09-11T14:19:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.309+0000 7feb5d551640 1 --2- 172.21.15.47:0/476932735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb581144d0 0x7feb581a90f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.309+0000 7feb5d551640 1 -- 172.21.15.47:0/476932735 >> 172.21.15.47:0/476932735 conn(0x7feb5806ff60 msgr2=0x7feb58117920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.309+0000 7feb5d551640 1 -- 172.21.15.47:0/476932735 shutdown_connections 2024-09-11T14:19:53.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.309+0000 7feb5d551640 1 -- 172.21.15.47:0/476932735 wait complete. 2024-09-11T14:19:53.321 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 981ffb3f-b14b-49fd-bbed-bc853a1bb77e 1 2024-09-11T14:19:53.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.427+0000 7f9a6bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:53.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.433+0000 7f9a6bf91640 1 Processor -- start 2024-09-11T14:19:53.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.434+0000 7f9a6bf91640 1 -- start start 2024-09-11T14:19:53.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.434+0000 7f9a6bf91640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a6411d110 0x7f9a6411f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.434+0000 7f9a6bf91640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6411fb00 con 0x7f9a641191d0 2024-09-11T14:19:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.434+0000 7f9a6bf91640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f9a64120cc0 con 0x7f9a6411d110 2024-09-11T14:19:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.434+0000 7f9a6952c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a6411d110 0x7f9a6411f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.434+0000 7f9a6952c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9a6411d110 0x7f9a6411f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.47:35390/0 (socket says 172.21.15.47:35390) 2024-09-11T14:19:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.434+0000 7f9a69d2d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9a641191d0 0x7f9a641195e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.47:57728/0 (socket says 172.21.15.47:57728) 2024-09-11T14:19:53.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.434+0000 7f9a6952c640 1 -- 172.21.15.47:0/10576212 learned_addr learned my addr 172.21.15.47:0/10576212 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-11T14:19:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.435+0000 7f9a6952c640 1 -- 172.21.15.47:0/10576212 >> v1:172.21.15.46:6789/0 conn(0x7f9a641191d0 legacy=0x7f9a641195e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.435+0000 7f9a6952c640 1 -- 172.21.15.47:0/10576212 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a64120e30 con 0x7f9a6411d110 2024-09-11T14:19:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.435+0000 7f9a6952c640 1 --2- 172.21.15.47:0/10576212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6411d110 0x7f9a6411f530 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c6720101b4c67c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.435+0000 7f9a68d2b640 1 -- 172.21.15.47:0/10576212 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a54009e50 con 0x7f9a6411d110 2024-09-11T14:19:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.435+0000 7f9a68d2b640 1 -- 172.21.15.47:0/10576212 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a5400e230 con 0x7f9a6411d110 2024-09-11T14:19:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.435+0000 7f9a68d2b640 1 -- 172.21.15.47:0/10576212 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a5400e4d0 con 0x7f9a6411d110 2024-09-11T14:19:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.436+0000 7f9a6bf91640 1 -- 172.21.15.47:0/10576212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6411d110 msgr2=0x7f9a6411f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.436+0000 7f9a6bf91640 1 --2- 172.21.15.47:0/10576212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6411d110 0x7f9a6411f530 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.436+0000 7f9a6bf91640 1 -- 172.21.15.47:0/10576212 shutdown_connections 2024-09-11T14:19:53.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.436+0000 7f9a6bf91640 1 --2- 172.21.15.47:0/10576212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a6411d110 0x7f9a6411f530 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.436+0000 7f9a6bf91640 1 -- 172.21.15.47:0/10576212 >> 172.21.15.47:0/10576212 conn(0x7f9a6406ff60 msgr2=0x7f9a64112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:53.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.436+0000 7f9a6bf91640 1 -- 172.21.15.47:0/10576212 shutdown_connections 2024-09-11T14:19:53.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.436+0000 7f9a6bf91640 1 -- 172.21.15.47:0/10576212 wait complete. 2024-09-11T14:19:53.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.436+0000 7f9a6bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:53.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.437+0000 7f9a6bf91640 1 Processor -- start 2024-09-11T14:19:53.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.437+0000 7f9a6bf91640 1 -- start start 2024-09-11T14:19:53.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.437+0000 7f9a6bf91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a641191d0 0x7f9a641a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.437+0000 7f9a6bf91640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641a9770 con 0x7f9a641191d0 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.438+0000 7f9a69d2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a641191d0 0x7f9a641a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.438+0000 7f9a69d2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a641191d0 0x7f9a641a91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.47:35404/0 (socket says 172.21.15.47:35404) 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.438+0000 7f9a69d2d640 1 -- 172.21.15.47:0/639598731 learned_addr learned my addr 172.21.15.47:0/639598731 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.438+0000 7f9a69d2d640 1 -- 172.21.15.47:0/639598731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a641a98b0 con 0x7f9a641191d0 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.438+0000 7f9a69d2d640 1 --2- 172.21.15.47:0/639598731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a641191d0 0x7f9a641a91a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.438+0000 7f9a5a7fc640 1 -- 172.21.15.47:0/639598731 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a600059a0 con 0x7f9a641191d0 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.439+0000 7f9a5a7fc640 1 -- 172.21.15.47:0/639598731 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a60005b00 con 0x7f9a641191d0 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.439+0000 7f9a6bf91640 1 -- 172.21.15.47:0/639598731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a641a9b60 con 0x7f9a641191d0 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.439+0000 7f9a5a7fc640 1 -- 172.21.15.47:0/639598731 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a60005da0 con 0x7f9a641191d0 2024-09-11T14:19:53.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.439+0000 7f9a6bf91640 1 -- 172.21.15.47:0/639598731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a641aea00 con 0x7f9a641191d0 2024-09-11T14:19:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.439+0000 7f9a5a7fc640 1 -- 172.21.15.47:0/639598731 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f9a6000cba0 con 0x7f9a641191d0 2024-09-11T14:19:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.439+0000 7f9a5a7fc640 1 -- 172.21.15.47:0/639598731 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7f9a6000fa50 con 0x7f9a641191d0 2024-09-11T14:19:53.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.439+0000 7f9a6bf91640 1 -- 172.21.15.47:0/639598731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a64120750 con 0x7f9a641191d0 2024-09-11T14:19:53.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.442+0000 7f9a5a7fc640 1 -- 172.21.15.47:0/639598731 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f9a6000f230 con 0x7f9a641191d0 2024-09-11T14:19:53.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.514+0000 7f9a6bf91640 1 -- 172.21.15.47:0/639598731 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "981ffb3f-b14b-49fd-bbed-bc853a1bb77e", "id": 1} v 0) -- 0x7f9a641af650 con 0x7f9a641191d0 2024-09-11T14:19:53.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.515+0000 7f9a5a7fc640 1 -- 172.21.15.47:0/639598731 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "981ffb3f-b14b-49fd-bbed-bc853a1bb77e", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7f9a6000fd80 con 0x7f9a641191d0 2024-09-11T14:19:53.517 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-09-11T14:19:53.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.516+0000 7f9a6bf91640 1 -- 172.21.15.47:0/639598731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a641191d0 msgr2=0x7f9a641a91a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.516+0000 7f9a6bf91640 1 --2- 172.21.15.47:0/639598731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a641191d0 0x7f9a641a91a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.516+0000 7f9a6bf91640 1 -- 172.21.15.47:0/639598731 shutdown_connections 2024-09-11T14:19:53.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.516+0000 7f9a6bf91640 1 --2- 172.21.15.47:0/639598731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a641191d0 0x7f9a641a91a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.516+0000 7f9a6bf91640 1 -- 172.21.15.47:0/639598731 >> 172.21.15.47:0/639598731 conn(0x7f9a6406ff60 msgr2=0x7f9a6411ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:53.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.516+0000 7f9a6bf91640 1 -- 172.21.15.47:0/639598731 shutdown_connections 2024-09-11T14:19:53.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.516+0000 7f9a6bf91640 1 -- 172.21.15.47:0/639598731 wait complete. 2024-09-11T14:19:53.528 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 3e1c22fb-cf45-43cd-a45c-d546b44d973b 2 2024-09-11T14:19:53.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.631+0000 7f461869c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.638+0000 7f461869c640 1 Processor -- start 2024-09-11T14:19:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.638+0000 7f461869c640 1 -- start start 2024-09-11T14:19:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.638+0000 7f461869c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f461011d110 0x7f461011f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:53.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.638+0000 7f461869c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461011fb00 con 0x7f46101191d0 2024-09-11T14:19:53.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.638+0000 7f461869c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f4610120cc0 con 0x7f461011d110 2024-09-11T14:19:53.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.639+0000 7f4615c37640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f461011d110 0x7f461011f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:53.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.639+0000 7f4616438640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f46101191d0 0x7f46101195e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.47:57732/0 (socket says 172.21.15.47:57732) 2024-09-11T14:19:53.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.639+0000 7f4616438640 1 -- 172.21.15.47:0/819758696 learned_addr learned my addr 172.21.15.47:0/819758696 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-11T14:19:53.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.639+0000 7f4615c37640 1 -- 172.21.15.47:0/819758696 >> v1:172.21.15.46:6789/0 conn(0x7f46101191d0 legacy=0x7f46101195e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.639+0000 7f4615c37640 1 -- 172.21.15.47:0/819758696 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4610120e30 con 0x7f461011d110 2024-09-11T14:19:53.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.639+0000 7f4615c37640 1 --2- 172.21.15.47:0/819758696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461011d110 0x7f461011f530 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3267c2aaaa9c3bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:53.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.639+0000 7f4615436640 1 -- 172.21.15.47:0/819758696 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4600009d90 con 0x7f461011d110 2024-09-11T14:19:53.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.639+0000 7f4615436640 1 -- 172.21.15.47:0/819758696 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f460000e230 con 0x7f461011d110 2024-09-11T14:19:53.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.639+0000 7f4615436640 1 -- 172.21.15.47:0/819758696 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f460000e4d0 con 0x7f461011d110 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.640+0000 7f461869c640 1 -- 172.21.15.47:0/819758696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461011d110 msgr2=0x7f461011f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.640+0000 7f461869c640 1 --2- 172.21.15.47:0/819758696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461011d110 0x7f461011f530 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.640+0000 7f461869c640 1 -- 172.21.15.47:0/819758696 shutdown_connections 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.640+0000 7f461869c640 1 --2- 172.21.15.47:0/819758696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f461011d110 0x7f461011f530 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.640+0000 7f461869c640 1 -- 172.21.15.47:0/819758696 >> 172.21.15.47:0/819758696 conn(0x7f461006ff60 msgr2=0x7f4610112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.640+0000 7f461869c640 1 -- 172.21.15.47:0/819758696 shutdown_connections 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.640+0000 7f461869c640 1 -- 172.21.15.47:0/819758696 wait complete. 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.640+0000 7f461869c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.641+0000 7f461869c640 1 Processor -- start 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.641+0000 7f461869c640 1 -- start start 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.642+0000 7f461869c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101191d0 0x7f46101a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.642+0000 7f461869c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f46101a9790 con 0x7f46101191d0 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.642+0000 7f4616438640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101191d0 0x7f46101a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.642+0000 7f4616438640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101191d0 0x7f46101a91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.47:35422/0 (socket says 172.21.15.47:35422) 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.642+0000 7f4616438640 1 -- 172.21.15.47:0/2318484268 learned_addr learned my addr 172.21.15.47:0/2318484268 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.642+0000 7f4616438640 1 -- 172.21.15.47:0/2318484268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46101a98d0 con 0x7f46101191d0 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.643+0000 7f4616438640 1 --2- 172.21.15.47:0/2318484268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101191d0 0x7f46101a91c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.643+0000 7f4606ffd640 1 -- 172.21.15.47:0/2318484268 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f460c005a60 con 0x7f46101191d0 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.643+0000 7f461869c640 1 -- 172.21.15.47:0/2318484268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46101a9b80 con 0x7f46101191d0 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.643+0000 7f4606ffd640 1 -- 172.21.15.47:0/2318484268 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f460c005bc0 con 0x7f46101191d0 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.643+0000 7f4606ffd640 1 -- 172.21.15.47:0/2318484268 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f460c005e60 con 0x7f46101191d0 2024-09-11T14:19:53.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.643+0000 7f461869c640 1 -- 172.21.15.47:0/2318484268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46101aea20 con 0x7f46101191d0 2024-09-11T14:19:53.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.643+0000 7f4606ffd640 1 -- 172.21.15.47:0/2318484268 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f460c00cba0 con 0x7f46101191d0 2024-09-11T14:19:53.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.643+0000 7f4606ffd640 1 -- 172.21.15.47:0/2318484268 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7f460c00fbc0 con 0x7f46101191d0 2024-09-11T14:19:53.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.644+0000 7f461869c640 1 -- 172.21.15.47:0/2318484268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4610120750 con 0x7f46101191d0 2024-09-11T14:19:53.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.646+0000 7f4606ffd640 1 -- 172.21.15.47:0/2318484268 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f460c00fe30 con 0x7f46101191d0 2024-09-11T14:19:53.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.719+0000 7f461869c640 1 -- 172.21.15.47:0/2318484268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3e1c22fb-cf45-43cd-a45c-d546b44d973b", "id": 2} v 0) -- 0x7f461011fff0 con 0x7f46101191d0 2024-09-11T14:19:53.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.720+0000 7f4606ffd640 1 -- 172.21.15.47:0/2318484268 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e1c22fb-cf45-43cd-a45c-d546b44d973b", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7f460c00f300 con 0x7f46101191d0 2024-09-11T14:19:53.722 INFO:teuthology.orchestra.run.smithi047.stdout:2 2024-09-11T14:19:53.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.721+0000 7f461869c640 1 -- 172.21.15.47:0/2318484268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101191d0 msgr2=0x7f46101a91c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.721+0000 7f461869c640 1 --2- 172.21.15.47:0/2318484268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101191d0 0x7f46101a91c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.721+0000 7f461869c640 1 -- 172.21.15.47:0/2318484268 shutdown_connections 2024-09-11T14:19:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.721+0000 7f461869c640 1 --2- 172.21.15.47:0/2318484268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46101191d0 0x7f46101a91c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.721+0000 7f461869c640 1 -- 172.21.15.47:0/2318484268 >> 172.21.15.47:0/2318484268 conn(0x7f461006ff60 msgr2=0x7f461011ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.721+0000 7f461869c640 1 -- 172.21.15.47:0/2318484268 shutdown_connections 2024-09-11T14:19:53.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.721+0000 7f461869c640 1 -- 172.21.15.47:0/2318484268 wait complete. 2024-09-11T14:19:53.733 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 9c1ff14e-10e9-4e46-9343-d3368a835700 3 2024-09-11T14:19:53.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.838+0000 7f74eb951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:53.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.844+0000 7f74eb951640 1 Processor -- start 2024-09-11T14:19:53.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.845+0000 7f74eb951640 1 -- start start 2024-09-11T14:19:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.845+0000 7f74eb951640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74e41191d0 0x7f74e41195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.845+0000 7f74eb951640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e4114ff0 con 0x7f74e41144d0 2024-09-11T14:19:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.845+0000 7f74eb951640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f74e4115180 con 0x7f74e41191d0 2024-09-11T14:19:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.845+0000 7f74e96ed640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74e41191d0 0x7f74e41195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.846+0000 7f74e8eec640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f74e41144d0 0x7f74e41148e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.47:57742/0 (socket says 172.21.15.47:57742) 2024-09-11T14:19:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.846+0000 7f74e8eec640 1 -- 172.21.15.47:0/1724852289 learned_addr learned my addr 172.21.15.47:0/1724852289 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-09-11T14:19:53.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.846+0000 7f74e96ed640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74e41191d0 0x7f74e41195e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.47:35432/0 (socket says 172.21.15.47:35432) 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.846+0000 7f74e96ed640 1 -- 172.21.15.47:0/1724852289 >> v1:172.21.15.46:6789/0 conn(0x7f74e41144d0 legacy=0x7f74e41148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.846+0000 7f74e96ed640 1 -- 172.21.15.47:0/1724852289 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e41152f0 con 0x7f74e41191d0 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.846+0000 7f74e96ed640 1 --2- 172.21.15.47:0/1724852289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41191d0 0x7f74e41195e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d10d1fb02508305 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.846+0000 7f74dbfff640 1 -- 172.21.15.47:0/1724852289 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74e0009d90 con 0x7f74e41191d0 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.846+0000 7f74dbfff640 1 -- 172.21.15.47:0/1724852289 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f74e000e230 con 0x7f74e41191d0 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.846+0000 7f74dbfff640 1 -- 172.21.15.47:0/1724852289 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74e000e4d0 con 0x7f74e41191d0 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.847+0000 7f74eb951640 1 -- 172.21.15.47:0/1724852289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41191d0 msgr2=0x7f74e41195e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.847+0000 7f74eb951640 1 --2- 172.21.15.47:0/1724852289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41191d0 0x7f74e41195e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.847+0000 7f74eb951640 1 -- 172.21.15.47:0/1724852289 shutdown_connections 2024-09-11T14:19:53.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.847+0000 7f74eb951640 1 --2- 172.21.15.47:0/1724852289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41191d0 0x7f74e41195e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.847+0000 7f74eb951640 1 -- 172.21.15.47:0/1724852289 >> 172.21.15.47:0/1724852289 conn(0x7f74e406ff60 msgr2=0x7f74e4112db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.847+0000 7f74eb951640 1 -- 172.21.15.47:0/1724852289 shutdown_connections 2024-09-11T14:19:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.847+0000 7f74eb951640 1 -- 172.21.15.47:0/1724852289 wait complete. 2024-09-11T14:19:53.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.847+0000 7f74eb951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:53.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.848+0000 7f74eb951640 1 Processor -- start 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.848+0000 7f74eb951640 1 -- start start 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.849+0000 7f74eb951640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41144d0 0x7f74e41a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.849+0000 7f74eb951640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f74e41a96a0 con 0x7f74e41144d0 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.849+0000 7f74e96ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41144d0 0x7f74e41a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.849+0000 7f74e96ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41144d0 0x7f74e41a90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.47:35446/0 (socket says 172.21.15.47:35446) 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.849+0000 7f74e96ed640 1 -- 172.21.15.47:0/2795743690 learned_addr learned my addr 172.21.15.47:0/2795743690 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.849+0000 7f74e96ed640 1 -- 172.21.15.47:0/2795743690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e41a97e0 con 0x7f74e41144d0 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.850+0000 7f74e96ed640 1 --2- 172.21.15.47:0/2795743690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41144d0 0x7f74e41a90d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.850+0000 7f74d9ffb640 1 -- 172.21.15.47:0/2795743690 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74e0014620 con 0x7f74e41144d0 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.850+0000 7f74d9ffb640 1 -- 172.21.15.47:0/2795743690 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f74e0014780 con 0x7f74e41144d0 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.850+0000 7f74eb951640 1 -- 172.21.15.47:0/2795743690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e41a9a30 con 0x7f74e41144d0 2024-09-11T14:19:53.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.850+0000 7f74d9ffb640 1 -- 172.21.15.47:0/2795743690 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74e0014a20 con 0x7f74e41144d0 2024-09-11T14:19:53.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.850+0000 7f74d9ffb640 1 -- 172.21.15.47:0/2795743690 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f74e0013400 con 0x7f74e41144d0 2024-09-11T14:19:53.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.850+0000 7f74eb951640 1 -- 172.21.15.47:0/2795743690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e41ae9b0 con 0x7f74e41144d0 2024-09-11T14:19:53.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.850+0000 7f74d9ffb640 1 -- 172.21.15.47:0/2795743690 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7f74e0019040 con 0x7f74e41144d0 2024-09-11T14:19:53.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.851+0000 7f74eb951640 1 -- 172.21.15.47:0/2795743690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e41203d0 con 0x7f74e41144d0 2024-09-11T14:19:53.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.854+0000 7f74d9ffb640 1 -- 172.21.15.47:0/2795743690 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f74e0011380 con 0x7f74e41144d0 2024-09-11T14:19:53.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.926+0000 7f74eb951640 1 -- 172.21.15.47:0/2795743690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9c1ff14e-10e9-4e46-9343-d3368a835700", "id": 3} v 0) -- 0x7f74e41191d0 con 0x7f74e41144d0 2024-09-11T14:19:53.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.927+0000 7f74d9ffb640 1 -- 172.21.15.47:0/2795743690 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c1ff14e-10e9-4e46-9343-d3368a835700", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7f74e0011920 con 0x7f74e41144d0 2024-09-11T14:19:53.929 INFO:teuthology.orchestra.run.smithi047.stdout:3 2024-09-11T14:19:53.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.928+0000 7f74eb951640 1 -- 172.21.15.47:0/2795743690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41144d0 msgr2=0x7f74e41a90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:53.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.928+0000 7f74eb951640 1 --2- 172.21.15.47:0/2795743690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41144d0 0x7f74e41a90d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.928+0000 7f74eb951640 1 -- 172.21.15.47:0/2795743690 shutdown_connections 2024-09-11T14:19:53.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.928+0000 7f74eb951640 1 --2- 172.21.15.47:0/2795743690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74e41144d0 0x7f74e41a90d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:53.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.928+0000 7f74eb951640 1 -- 172.21.15.47:0/2795743690 >> 172.21.15.47:0/2795743690 conn(0x7f74e406ff60 msgr2=0x7f74e4117960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:53.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.928+0000 7f74eb951640 1 -- 172.21.15.47:0/2795743690 shutdown_connections 2024-09-11T14:19:53.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-11T14:19:53.928+0000 7f74eb951640 1 -- 172.21.15.47:0/2795743690 wait complete. 2024-09-11T14:19:53.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-11T14:19:53.976 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T14:19:53.976 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-11T14:19:54.018 INFO:tasks.ceph.osd.0:Started 2024-09-11T14:19:54.019 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-11T14:19:54.052 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T14:19:54.052 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-11T14:19:54.094 INFO:tasks.ceph.osd.1:Started 2024-09-11T14:19:54.095 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-11T14:19:54.128 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T14:19:54.128 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-11T14:19:54.170 INFO:tasks.ceph.osd.2:Started 2024-09-11T14:19:54.170 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-11T14:19:54.201 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T14:19:54.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-11T14:19:54.243 INFO:tasks.ceph.osd.3:Started 2024-09-11T14:19:54.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:19:54.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.356+0000 7f869bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:54.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.361+0000 7f869bed1640 1 Processor -- start 2024-09-11T14:19:54.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.362+0000 7f869bed1640 1 -- start start 2024-09-11T14:19:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.363+0000 7f869bed1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8694138720 0x7f869413ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.363+0000 7f869bed1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8694133040 con 0x7f8694132520 2024-09-11T14:19:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.363+0000 7f869bed1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f869406f6d0 con 0x7f8694138720 2024-09-11T14:19:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.363+0000 7f869946c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8694138720 0x7f869413ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.363+0000 7f8699c6d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8694132520 0x7f8694132930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58694/0 (socket says 172.21.15.46:58694) 2024-09-11T14:19:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.363+0000 7f8699c6d640 1 -- 172.21.15.46:0/3722182269 learned_addr learned my addr 172.21.15.46:0/3722182269 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:19:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.364+0000 7f869946c640 1 -- 172.21.15.46:0/3722182269 >> v1:172.21.15.46:6789/0 conn(0x7f8694132520 legacy=0x7f8694132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.364+0000 7f869946c640 1 -- 172.21.15.46:0/3722182269 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869406f3d0 con 0x7f8694138720 2024-09-11T14:19:54.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.364+0000 7f869946c640 1 --2- 172.21.15.46:0/3722182269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694138720 0x7f869413ab40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ddcc315d9bc7d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.364+0000 7f8698c6b640 1 -- 172.21.15.46:0/3722182269 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f868800e040 con 0x7f8694138720 2024-09-11T14:19:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.364+0000 7f8698c6b640 1 -- 172.21.15.46:0/3722182269 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8688007670 con 0x7f8694138720 2024-09-11T14:19:54.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.364+0000 7f8698c6b640 1 -- 172.21.15.46:0/3722182269 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8688007910 con 0x7f8694138720 2024-09-11T14:19:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.365+0000 7f869bed1640 1 -- 172.21.15.46:0/3722182269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694138720 msgr2=0x7f869413ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.365+0000 7f869bed1640 1 --2- 172.21.15.46:0/3722182269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694138720 0x7f869413ab40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.365+0000 7f869bed1640 1 -- 172.21.15.46:0/3722182269 shutdown_connections 2024-09-11T14:19:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.365+0000 7f869bed1640 1 --2- 172.21.15.46:0/3722182269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694138720 0x7f869413ab40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.365+0000 7f869bed1640 1 -- 172.21.15.46:0/3722182269 >> 172.21.15.46:0/3722182269 conn(0x7f869406e490 msgr2=0x7f869406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.365+0000 7f869bed1640 1 -- 172.21.15.46:0/3722182269 shutdown_connections 2024-09-11T14:19:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.365+0000 7f869bed1640 1 -- 172.21.15.46:0/3722182269 wait complete. 2024-09-11T14:19:54.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.365+0000 7f869bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:54.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.367+0000 7f869bed1640 1 Processor -- start 2024-09-11T14:19:54.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.367+0000 7f869bed1640 1 -- start start 2024-09-11T14:19:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f869bed1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694132520 0x7f8694130c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f869bed1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f86941313d0 con 0x7f8694132520 2024-09-11T14:19:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f8699c6d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694132520 0x7f8694130c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f8699c6d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694132520 0x7f8694130c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52912/0 (socket says 172.21.15.46:52912) 2024-09-11T14:19:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f8699c6d640 1 -- 172.21.15.46:0/1174028639 learned_addr learned my addr 172.21.15.46:0/1174028639 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:19:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f8699c6d640 1 -- 172.21.15.46:0/1174028639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86940a07b0 con 0x7f8694132520 2024-09-11T14:19:54.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f8699c6d640 1 --2- 172.21.15.46:0/1174028639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694132520 0x7f8694130c70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f86927fc640 1 -- 172.21.15.46:0/1174028639 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8684005a60 con 0x7f8694132520 2024-09-11T14:19:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f86927fc640 1 -- 172.21.15.46:0/1174028639 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8684005bc0 con 0x7f8694132520 2024-09-11T14:19:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f869bed1640 1 -- 172.21.15.46:0/1174028639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8694120bc0 con 0x7f8694132520 2024-09-11T14:19:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f86927fc640 1 -- 172.21.15.46:0/1174028639 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8684005e60 con 0x7f8694132520 2024-09-11T14:19:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.369+0000 7f869bed1640 1 -- 172.21.15.46:0/1174028639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8694120030 con 0x7f8694132520 2024-09-11T14:19:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.370+0000 7f86927fc640 1 -- 172.21.15.46:0/1174028639 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f868400cb80 con 0x7f8694132520 2024-09-11T14:19:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.370+0000 7f86927fc640 1 -- 172.21.15.46:0/1174028639 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f868400fc00 con 0x7f8694132520 2024-09-11T14:19:54.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.371+0000 7f869bed1640 1 -- 172.21.15.46:0/1174028639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f869406a300 con 0x7f8694132520 2024-09-11T14:19:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.373+0000 7f86927fc640 1 -- 172.21.15.46:0/1174028639 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f8694133040 con 0x7f8694132520 2024-09-11T14:19:54.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.435+0000 7f869bed1640 1 -- 172.21.15.46:0/1174028639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8694132930 con 0x7f8694132520 2024-09-11T14:19:54.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.435+0000 7f86927fc640 1 -- 172.21.15.46:0/1174028639 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f868400f230 con 0x7f8694132520 2024-09-11T14:19:54.437 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:19:54.437 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"fsid":"1036f700-a934-4ca9-974c-2362e4adfb5d","created":"2024-09-11T14:19:51.780788+0000","modified":"2024-09-11T14:19:53.927574+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:19:53.927574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"38ba4d14-fba0-43ad-8341-3a4dff407458","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"981ffb3f-b14b-49fd-bbed-bc853a1bb77e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3e1c22fb-cf45-43cd-a45c-d546b44d973b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c1ff14e-10e9-4e46-9343-d3368a835700","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:19:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.436+0000 7f869bed1640 1 -- 172.21.15.46:0/1174028639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694132520 msgr2=0x7f8694130c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.436+0000 7f869bed1640 1 --2- 172.21.15.46:0/1174028639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694132520 0x7f8694130c70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.436+0000 7f869bed1640 1 -- 172.21.15.46:0/1174028639 shutdown_connections 2024-09-11T14:19:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.436+0000 7f869bed1640 1 --2- 172.21.15.46:0/1174028639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8694132520 0x7f8694130c70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.436+0000 7f869bed1640 1 -- 172.21.15.46:0/1174028639 >> 172.21.15.46:0/1174028639 conn(0x7f869406e490 msgr2=0x7f86940a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.437+0000 7f869bed1640 1 -- 172.21.15.46:0/1174028639 shutdown_connections 2024-09-11T14:19:54.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:19:54.437+0000 7f869bed1640 1 -- 172.21.15.46:0/1174028639 wait complete. 2024-09-11T14:19:54.449 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T14:19:54.449 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T14:19:54.853 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:19:54.960 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.954+0000 7f2968551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:54.961 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.960+0000 7f2968551640 1 Processor -- start 2024-09-11T14:19:54.961 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.960+0000 7f2968551640 1 -- start start 2024-09-11T14:19:54.963 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.961+0000 7f2968551640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2960135d80 0x7f296013ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:54.963 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.961+0000 7f2968551640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296006a7b0 con 0x7f29600a0c70 2024-09-11T14:19:54.963 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.961+0000 7f2968551640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f296009f9f0 con 0x7f2960135d80 2024-09-11T14:19:54.963 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.961+0000 7f2965aec640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2960135d80 0x7f296013ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:54.963 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.961+0000 7f29662ed640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f29600a0c70 0x7f2960135670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58702/0 (socket says 172.21.15.46:58702) 2024-09-11T14:19:54.963 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.962+0000 7f29662ed640 1 -- 172.21.15.46:0/4285521735 learned_addr learned my addr 172.21.15.46:0/4285521735 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:19:54.964 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.962+0000 7f2965aec640 1 -- 172.21.15.46:0/4285521735 >> v1:172.21.15.46:6789/0 conn(0x7f29600a0c70 legacy=0x7f2960135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:54.964 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.962+0000 7f2965aec640 1 -- 172.21.15.46:0/4285521735 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296009f6e0 con 0x7f2960135d80 2024-09-11T14:19:54.964 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.962+0000 7f29652eb640 1 -- 172.21.15.46:0/4285521735 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848475249 0 0) 0x7f296006a7b0 con 0x7f29600a0c70 2024-09-11T14:19:54.964 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.962+0000 7f2965aec640 1 --2- 172.21.15.46:0/4285521735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 0x7f296013ac50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c72a4f9e39e9b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:54.964 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.962+0000 7f29652eb640 1 -- 172.21.15.46:0/4285521735 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2950009d80 con 0x7f2960135d80 2024-09-11T14:19:54.964 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.962+0000 7f29652eb640 1 -- 172.21.15.46:0/4285521735 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f295000e230 con 0x7f2960135d80 2024-09-11T14:19:54.965 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.962+0000 7f29652eb640 1 -- 172.21.15.46:0/4285521735 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f295000e4d0 con 0x7f2960135d80 2024-09-11T14:19:54.965 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.963+0000 7f2968551640 1 -- 172.21.15.46:0/4285521735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 msgr2=0x7f296013ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:54.966 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.963+0000 7f2968551640 1 --2- 172.21.15.46:0/4285521735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 0x7f296013ac50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:54.966 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.963+0000 7f2968551640 1 -- 172.21.15.46:0/4285521735 shutdown_connections 2024-09-11T14:19:54.966 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.963+0000 7f2968551640 1 --2- 172.21.15.46:0/4285521735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 0x7f296013ac50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:54.966 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.963+0000 7f2968551640 1 -- 172.21.15.46:0/4285521735 >> 172.21.15.46:0/4285521735 conn(0x7f29600a5f60 msgr2=0x7f29600a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:54.966 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.963+0000 7f2968551640 1 -- 172.21.15.46:0/4285521735 shutdown_connections 2024-09-11T14:19:54.966 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.963+0000 7f2968551640 1 -- 172.21.15.46:0/4285521735 wait complete. 2024-09-11T14:19:54.966 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.964+0000 7f2968551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:19:54.967 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.965+0000 7f2968551640 1 Processor -- start 2024-09-11T14:19:54.967 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.966+0000 7f2968551640 1 -- start start 2024-09-11T14:19:54.969 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.967+0000 7f2968551640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 0x7f29601308f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.967+0000 7f2968551640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f29601324d0 con 0x7f2960135d80 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.967+0000 7f29662ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 0x7f29601308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.967+0000 7f29662ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 0x7f29601308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52918/0 (socket says 172.21.15.46:52918) 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.967+0000 7f29662ed640 1 -- 172.21.15.46:0/2928348323 learned_addr learned my addr 172.21.15.46:0/2928348323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.968+0000 7f29662ed640 1 -- 172.21.15.46:0/2928348323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29601317d0 con 0x7f2960135d80 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.968+0000 7f29662ed640 1 --2- 172.21.15.46:0/2928348323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 0x7f29601308f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.968+0000 7f2956ffd640 1 -- 172.21.15.46:0/2928348323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f295c004b80 con 0x7f2960135d80 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.968+0000 7f2956ffd640 1 -- 172.21.15.46:0/2928348323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f295c004ce0 con 0x7f2960135d80 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.968+0000 7f2968551640 1 -- 172.21.15.46:0/2928348323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2960130450 con 0x7f2960135d80 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.968+0000 7f2956ffd640 1 -- 172.21.15.46:0/2928348323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f295c007120 con 0x7f2960135d80 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.968+0000 7f2968551640 1 -- 172.21.15.46:0/2928348323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2960091e90 con 0x7f2960135d80 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.968+0000 7f2956ffd640 1 -- 172.21.15.46:0/2928348323 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f295c00c520 con 0x7f2960135d80 2024-09-11T14:19:54.970 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.968+0000 7f2956ffd640 1 -- 172.21.15.46:0/2928348323 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f295c00fc50 con 0x7f2960135d80 2024-09-11T14:19:54.971 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.969+0000 7f2968551640 1 -- 172.21.15.46:0/2928348323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29600a0c70 con 0x7f2960135d80 2024-09-11T14:19:54.973 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:54.972+0000 7f2956ffd640 1 -- 172.21.15.46:0/2928348323 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f295c0076b0 con 0x7f2960135d80 2024-09-11T14:19:55.035 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:55.034+0000 7f2968551640 1 -- 172.21.15.46:0/2928348323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f296006de50 con 0x7f2960135d80 2024-09-11T14:19:55.036 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:55.034+0000 7f2956ffd640 1 -- 172.21.15.46:0/2928348323 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f295c00f230 con 0x7f2960135d80 2024-09-11T14:19:55.036 INFO:teuthology.misc.health.smithi046.stdout: 2024-09-11T14:19:55.036 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":7,"fsid":"1036f700-a934-4ca9-974c-2362e4adfb5d","created":"2024-09-11T14:19:51.780788+0000","modified":"2024-09-11T14:19:53.927574+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T14:19:53.927574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"38ba4d14-fba0-43ad-8341-3a4dff407458","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"981ffb3f-b14b-49fd-bbed-bc853a1bb77e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3e1c22fb-cf45-43cd-a45c-d546b44d973b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c1ff14e-10e9-4e46-9343-d3368a835700","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:19:55.037 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:55.035+0000 7f2968551640 1 -- 172.21.15.46:0/2928348323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 msgr2=0x7f29601308f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:19:55.037 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:55.035+0000 7f2968551640 1 --2- 172.21.15.46:0/2928348323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 0x7f29601308f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:55.037 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:55.035+0000 7f2968551640 1 -- 172.21.15.46:0/2928348323 shutdown_connections 2024-09-11T14:19:55.037 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:55.035+0000 7f2968551640 1 --2- 172.21.15.46:0/2928348323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2960135d80 0x7f29601308f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:19:55.037 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:55.035+0000 7f2968551640 1 -- 172.21.15.46:0/2928348323 >> 172.21.15.46:0/2928348323 conn(0x7f29600a5f60 msgr2=0x7f2960133500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:19:55.037 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:55.036+0000 7f2968551640 1 -- 172.21.15.46:0/2928348323 shutdown_connections 2024-09-11T14:19:55.038 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:19:55.036+0000 7f2968551640 1 -- 172.21.15.46:0/2928348323 wait complete. 2024-09-11T14:19:55.046 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-11T14:19:57.343 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-11T14:19:57.340+0000 7f45687d7640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-11T14:20:01.451 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T14:20:01.561 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.555+0000 7f72b0551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:01.562 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.560+0000 7f72b0551640 1 Processor -- start 2024-09-11T14:20:01.562 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.561+0000 7f72b0551640 1 -- start start 2024-09-11T14:20:01.564 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.562+0000 7f72b0551640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f72a8135d80 0x7f72a813ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.562+0000 7f72b0551640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a806a7b0 con 0x7f72a80a0c70 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.562+0000 7f72b0551640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f72a809f9f0 con 0x7f72a8135d80 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.562+0000 7f72adaec640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f72a8135d80 0x7f72a813ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.562+0000 7f72ae2ed640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f72a80a0c70 0x7f72a8135670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51056/0 (socket says 172.21.15.46:51056) 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.562+0000 7f72ae2ed640 1 -- 172.21.15.46:0/73104421 learned_addr learned my addr 172.21.15.46:0/73104421 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.563+0000 7f72adaec640 1 -- 172.21.15.46:0/73104421 >> v1:172.21.15.46:6789/0 conn(0x7f72a80a0c70 legacy=0x7f72a8135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.563+0000 7f72adaec640 1 -- 172.21.15.46:0/73104421 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a809f6e0 con 0x7f72a8135d80 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.563+0000 7f72ad2eb640 1 -- 172.21.15.46:0/73104421 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859241716 0 0) 0x7f72a806a7b0 con 0x7f72a80a0c70 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.563+0000 7f72adaec640 1 --2- 172.21.15.46:0/73104421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 0x7f72a813ac50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2715fc2d8c66d90b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.563+0000 7f72ad2eb640 1 -- 172.21.15.46:0/73104421 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f72a4009d80 con 0x7f72a8135d80 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.563+0000 7f72ad2eb640 1 -- 172.21.15.46:0/73104421 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f72a400e230 con 0x7f72a8135d80 2024-09-11T14:20:01.565 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.563+0000 7f72ad2eb640 1 -- 172.21.15.46:0/73104421 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f72a400e4d0 con 0x7f72a8135d80 2024-09-11T14:20:01.566 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.564+0000 7f72b0551640 1 -- 172.21.15.46:0/73104421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 msgr2=0x7f72a813ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:01.566 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.564+0000 7f72b0551640 1 --2- 172.21.15.46:0/73104421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 0x7f72a813ac50 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:01.566 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.564+0000 7f72b0551640 1 -- 172.21.15.46:0/73104421 shutdown_connections 2024-09-11T14:20:01.566 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.564+0000 7f72b0551640 1 --2- 172.21.15.46:0/73104421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 0x7f72a813ac50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:01.566 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.564+0000 7f72b0551640 1 -- 172.21.15.46:0/73104421 >> 172.21.15.46:0/73104421 conn(0x7f72a80a5f60 msgr2=0x7f72a80a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:01.567 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.564+0000 7f72b0551640 1 -- 172.21.15.46:0/73104421 shutdown_connections 2024-09-11T14:20:01.567 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.564+0000 7f72b0551640 1 -- 172.21.15.46:0/73104421 wait complete. 2024-09-11T14:20:01.567 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.565+0000 7f72b0551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:01.568 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.566+0000 7f72b0551640 1 Processor -- start 2024-09-11T14:20:01.568 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.566+0000 7f72b0551640 1 -- start start 2024-09-11T14:20:01.570 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.568+0000 7f72b0551640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 0x7f72a81308f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:01.570 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.568+0000 7f72b0551640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f72a81324d0 con 0x7f72a8135d80 2024-09-11T14:20:01.570 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.568+0000 7f72ae2ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 0x7f72a81308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:01.571 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.568+0000 7f72ae2ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 0x7f72a81308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40778/0 (socket says 172.21.15.46:40778) 2024-09-11T14:20:01.571 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.568+0000 7f72ae2ed640 1 -- 172.21.15.46:0/3829260676 learned_addr learned my addr 172.21.15.46:0/3829260676 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:01.571 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.569+0000 7f72ae2ed640 1 -- 172.21.15.46:0/3829260676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a81317d0 con 0x7f72a8135d80 2024-09-11T14:20:01.571 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.569+0000 7f72ae2ed640 1 --2- 172.21.15.46:0/3829260676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 0x7f72a81308f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:01.571 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.569+0000 7f729effd640 1 -- 172.21.15.46:0/3829260676 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7298004b80 con 0x7f72a8135d80 2024-09-11T14:20:01.571 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.569+0000 7f729effd640 1 -- 172.21.15.46:0/3829260676 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7298004ce0 con 0x7f72a8135d80 2024-09-11T14:20:01.571 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.569+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a8130450 con 0x7f72a8135d80 2024-09-11T14:20:01.571 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.569+0000 7f729effd640 1 -- 172.21.15.46:0/3829260676 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7298007120 con 0x7f72a8135d80 2024-09-11T14:20:01.571 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.569+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a8091e90 con 0x7f72a8135d80 2024-09-11T14:20:01.572 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.570+0000 7f729effd640 1 -- 172.21.15.46:0/3829260676 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7f72980072d0 con 0x7f72a8135d80 2024-09-11T14:20:01.572 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.570+0000 7f729effd640 1 --2- 172.21.15.46:0/3829260676 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f728c03e8f0 0x7f728c040e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:01.572 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.570+0000 7f729effd640 1 -- 172.21.15.46:0/3829260676 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f729804f5e0 con 0x7f72a8135d80 2024-09-11T14:20:01.572 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.570+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a80a0c70 con 0x7f72a8135d80 2024-09-11T14:20:01.572 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.570+0000 7f72adaec640 1 --2- 172.21.15.46:0/3829260676 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f728c03e8f0 0x7f728c040e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:01.572 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.571+0000 7f72adaec640 1 --2- 172.21.15.46:0/3829260676 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f728c03e8f0 0x7f728c040e00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:01.577 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.576+0000 7f729effd640 1 -- 172.21.15.46:0/3829260676 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f729800f420 con 0x7f72a8135d80 2024-09-11T14:20:01.766 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.765+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72a806de50 con 0x7f72a8135d80 2024-09-11T14:20:01.767 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.765+0000 7f729effd640 1 -- 172.21.15.46:0/3829260676 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6955 (crc 0 0 0) 0x7f729801f040 con 0x7f72a8135d80 2024-09-11T14:20:01.767 INFO:teuthology.misc.health.smithi046.stdout: 2024-09-11T14:20:01.767 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":11,"fsid":"1036f700-a934-4ca9-974c-2362e4adfb5d","created":"2024-09-11T14:19:51.780788+0000","modified":"2024-09-11T14:20:01.395356+0000","last_up_change":"2024-09-11T14:19:58.389280+0000","last_in_change":"2024-09-11T14:19:53.927574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:20:00.363613+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38ba4d14-fba0-43ad-8341-3a4dff407458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6801","nonce":1724049974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1724049974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1724049974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":1724049974}]},"public_addr":"172.21.15.46:6801/1724049974","cluster_addr":"172.21.15.46:6800/1724049974","heartbeat_back_addr":"172.21.15.46:6807/1724049974","heartbeat_front_addr":"172.21.15.46:6809/1724049974","state":["exists","up"]},{"osd":1,"uuid":"981ffb3f-b14b-49fd-bbed-bc853a1bb77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":1751227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1751227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1751227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":1751227380}]},"public_addr":"172.21.15.46:6805/1751227380","cluster_addr":"172.21.15.46:6804/1751227380","heartbeat_back_addr":"172.21.15.46:6816/1751227380","heartbeat_front_addr":"172.21.15.46:6815/1751227380","state":["exists","up"]},{"osd":2,"uuid":"3e1c22fb-cf45-43cd-a45c-d546b44d973b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":3757354244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3757354244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3757354244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":3757354244}]},"public_addr":"172.21.15.47:6803/3757354244","cluster_addr":"172.21.15.47:6802/3757354244","heartbeat_back_addr":"172.21.15.47:6810/3757354244","heartbeat_front_addr":"172.21.15.47:6811/3757354244","state":["exists","up"]},{"osd":3,"uuid":"9c1ff14e-10e9-4e46-9343-d3368a835700","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":1666238977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1666238977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1666238977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":1666238977}]},"public_addr":"172.21.15.47:6805/1666238977","cluster_addr":"172.21.15.47:6804/1666238977","heartbeat_back_addr":"172.21.15.47:6808/1666238977","heartbeat_front_addr":"172.21.15.47:6807/1666238977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:20:01.769 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.767+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f728c03e8f0 msgr2=0x7f728c040e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:01.769 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.767+0000 7f72b0551640 1 --2- 172.21.15.46:0/3829260676 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f728c03e8f0 0x7f728c040e00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:01.769 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.767+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 msgr2=0x7f72a81308f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:01.769 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.767+0000 7f72b0551640 1 --2- 172.21.15.46:0/3829260676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 0x7f72a81308f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:01.769 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.768+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 shutdown_connections 2024-09-11T14:20:01.770 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.768+0000 7f72b0551640 1 --2- 172.21.15.46:0/3829260676 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f728c03e8f0 0x7f728c040e00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:01.770 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.768+0000 7f72b0551640 1 --2- 172.21.15.46:0/3829260676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a8135d80 0x7f72a81308f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:01.770 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.768+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 >> 172.21.15.46:0/3829260676 conn(0x7f72a80a5f60 msgr2=0x7f72a8133500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:01.770 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.768+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 shutdown_connections 2024-09-11T14:20:01.770 INFO:teuthology.misc.health.smithi046.stderr:2024-09-11T14:20:01.768+0000 7f72b0551640 1 -- 172.21.15.46:0/3829260676 wait complete. 2024-09-11T14:20:01.778 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-11T14:20:01.778 INFO:tasks.ceph:Creating RBD pool 2024-09-11T14:20:01.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T14:20:01.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.885+0000 7fc7a76fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:01.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.894+0000 7fc7a76fd640 1 Processor -- start 2024-09-11T14:20:01.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.894+0000 7fc7a76fd640 1 -- start start 2024-09-11T14:20:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.896+0000 7fc7a76fd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7a0135e20 0x7fc7a013a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.896+0000 7fc7a76fd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a00a1bc0 con 0x7fc7a0135300 2024-09-11T14:20:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.896+0000 7fc7a76fd640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a006f800 con 0x7fc7a0135e20 2024-09-11T14:20:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.896+0000 7fc7a4c98640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7a0135e20 0x7fc7a013a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.896+0000 7fc7a4c98640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7a0135e20 0x7fc7a013a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40792/0 (socket says 172.21.15.46:40792) 2024-09-11T14:20:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.896+0000 7fc7a5499640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc7a0135300 0x7fc7a0135710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51062/0 (socket says 172.21.15.46:51062) 2024-09-11T14:20:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.896+0000 7fc7a4c98640 1 -- 172.21.15.46:0/743237738 learned_addr learned my addr 172.21.15.46:0/743237738 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.897+0000 7fc7a4c98640 1 -- 172.21.15.46:0/743237738 >> v1:172.21.15.46:6789/0 conn(0x7fc7a0135300 legacy=0x7fc7a0135710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.897+0000 7fc7a4c98640 1 -- 172.21.15.46:0/743237738 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a006f2b0 con 0x7fc7a0135e20 2024-09-11T14:20:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.897+0000 7fc7a4c98640 1 --2- 172.21.15.46:0/743237738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135e20 0x7fc7a013a870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7019e23d264257dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:01.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.949+0000 7fc793fff640 1 -- 172.21.15.46:0/743237738 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc794009e50 con 0x7fc7a0135e20 2024-09-11T14:20:01.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.949+0000 7fc793fff640 1 -- 172.21.15.46:0/743237738 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc79400e230 con 0x7fc7a0135e20 2024-09-11T14:20:01.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.949+0000 7fc793fff640 1 -- 172.21.15.46:0/743237738 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc79400e4d0 con 0x7fc7a0135e20 2024-09-11T14:20:01.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.950+0000 7fc7a76fd640 1 -- 172.21.15.46:0/743237738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135e20 msgr2=0x7fc7a013a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:01.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.950+0000 7fc7a76fd640 1 --2- 172.21.15.46:0/743237738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135e20 0x7fc7a013a870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:01.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.950+0000 7fc7a76fd640 1 -- 172.21.15.46:0/743237738 shutdown_connections 2024-09-11T14:20:01.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.950+0000 7fc7a76fd640 1 --2- 172.21.15.46:0/743237738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135e20 0x7fc7a013a870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:01.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.950+0000 7fc7a76fd640 1 -- 172.21.15.46:0/743237738 >> 172.21.15.46:0/743237738 conn(0x7fc7a006e3e0 msgr2=0x7fc7a006e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:01.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.950+0000 7fc7a76fd640 1 -- 172.21.15.46:0/743237738 shutdown_connections 2024-09-11T14:20:01.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.950+0000 7fc7a76fd640 1 -- 172.21.15.46:0/743237738 wait complete. 2024-09-11T14:20:01.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.950+0000 7fc7a76fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:01.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.952+0000 7fc7a76fd640 1 Processor -- start 2024-09-11T14:20:01.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.952+0000 7fc7a76fd640 1 -- start start 2024-09-11T14:20:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.953+0000 7fc7a76fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135300 0x7fc7a011fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.953+0000 7fc7a76fd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0121210 con 0x7fc7a0135300 2024-09-11T14:20:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.953+0000 7fc7a5499640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135300 0x7fc7a011fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.953+0000 7fc7a5499640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135300 0x7fc7a011fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40802/0 (socket says 172.21.15.46:40802) 2024-09-11T14:20:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.953+0000 7fc7a5499640 1 -- 172.21.15.46:0/2624615270 learned_addr learned my addr 172.21.15.46:0/2624615270 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.954+0000 7fc7a5499640 1 -- 172.21.15.46:0/2624615270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a00a38d0 con 0x7fc7a0135300 2024-09-11T14:20:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.954+0000 7fc7a5499640 1 --2- 172.21.15.46:0/2624615270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135300 0x7fc7a011fed0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.954+0000 7fc791ffb640 1 -- 172.21.15.46:0/2624615270 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc79c0059a0 con 0x7fc7a0135300 2024-09-11T14:20:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.954+0000 7fc791ffb640 1 -- 172.21.15.46:0/2624615270 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc79c005b00 con 0x7fc7a0135300 2024-09-11T14:20:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.954+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a0123b70 con 0x7fc7a0135300 2024-09-11T14:20:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.954+0000 7fc791ffb640 1 -- 172.21.15.46:0/2624615270 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc79c005da0 con 0x7fc7a0135300 2024-09-11T14:20:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.954+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a0121910 con 0x7fc7a0135300 2024-09-11T14:20:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.955+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a006a300 con 0x7fc7a0135300 2024-09-11T14:20:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.955+0000 7fc791ffb640 1 -- 172.21.15.46:0/2624615270 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7fc79c0070b0 con 0x7fc7a0135300 2024-09-11T14:20:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.956+0000 7fc791ffb640 1 --2- 172.21.15.46:0/2624615270 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc78403e8a0 0x7fc784040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.956+0000 7fc791ffb640 1 -- 172.21.15.46:0/2624615270 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7fc79c04f3d0 con 0x7fc7a0135300 2024-09-11T14:20:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.956+0000 7fc7a4c98640 1 --2- 172.21.15.46:0/2624615270 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc78403e8a0 0x7fc784040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.956+0000 7fc7a4c98640 1 --2- 172.21.15.46:0/2624615270 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc78403e8a0 0x7fc784040db0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:01.963+0000 7fc791ffb640 1 -- 172.21.15.46:0/2624615270 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc79c00f230 con 0x7fc7a0135300 2024-09-11T14:20:02.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.150+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fc7a0135710 con 0x7fc7a0135300 2024-09-11T14:20:02.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.402+0000 7fc791ffb640 1 -- 172.21.15.46:0/2624615270 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7fc79c00d150 con 0x7fc7a0135300 2024-09-11T14:20:02.404 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'rbd' created 2024-09-11T14:20:02.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.405+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc78403e8a0 msgr2=0x7fc784040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:02.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.405+0000 7fc7a76fd640 1 --2- 172.21.15.46:0/2624615270 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc78403e8a0 0x7fc784040db0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:02.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.405+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135300 msgr2=0x7fc7a011fed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:02.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.405+0000 7fc7a76fd640 1 --2- 172.21.15.46:0/2624615270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135300 0x7fc7a011fed0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:02.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.405+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 shutdown_connections 2024-09-11T14:20:02.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.405+0000 7fc7a76fd640 1 --2- 172.21.15.46:0/2624615270 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc78403e8a0 0x7fc784040db0 crc :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:02.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.405+0000 7fc7a76fd640 1 --2- 172.21.15.46:0/2624615270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7a0135300 0x7fc7a011fed0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:02.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.405+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 >> 172.21.15.46:0/2624615270 conn(0x7fc7a006e3e0 msgr2=0x7fc7a01bd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:02.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.406+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 shutdown_connections 2024-09-11T14:20:02.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.406+0000 7fc7a76fd640 1 -- 172.21.15.46:0/2624615270 wait complete. 2024-09-11T14:20:02.420 DEBUG:teuthology.orchestra.run.smithi046:> rbd --cluster ceph pool init rbd 2024-09-11T14:20:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.523+0000 7fe5b6e52ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.523+0000 7fe5b6e52ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.525+0000 7fe5b6e52ac0 1 Processor -- start 2024-09-11T14:20:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.525+0000 7fe5b6e52ac0 1 -- start start 2024-09-11T14:20:02.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.526+0000 7fe5b6e52ac0 1 --2- >> v2:172.21.15.46:3300/0 conn(0x10da1c0 0x10da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:02.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.526+0000 7fe5b6e52ac0 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0xf3f180 con 0x10dab10 2024-09-11T14:20:02.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.526+0000 7fe5b6e52ac0 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0xf7eb90 con 0x10da1c0 2024-09-11T14:20:02.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.527+0000 7fe5b0ff7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x10da1c0 0x10da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:02.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.527+0000 7fe5a3fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x10dab10 0x1176cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51070/0 (socket says 172.21.15.46:51070) 2024-09-11T14:20:02.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.527+0000 7fe5a3fff640 1 -- 172.21.15.46:0/2354190302 learned_addr learned my addr 172.21.15.46:0/2354190302 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:02.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.527+0000 7fe5b0ff7640 1 -- 172.21.15.46:0/2354190302 >> v1:172.21.15.46:6789/0 conn(0x10dab10 legacy=0x1176cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:02.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.527+0000 7fe5a37fe640 1 -- 172.21.15.46:0/2354190302 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3740859226 0 0) 0xf3f180 con 0x10dab10 2024-09-11T14:20:02.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.527+0000 7fe5b0ff7640 1 -- 172.21.15.46:0/2354190302 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0xf14f80 con 0x10da1c0 2024-09-11T14:20:02.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.528+0000 7fe5b0ff7640 1 --2- 172.21.15.46:0/2354190302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 0x10da5d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c710b1a9164172 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:02.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.528+0000 7fe5a37fe640 1 -- 172.21.15.46:0/2354190302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5a802d7f0 con 0x10da1c0 2024-09-11T14:20:02.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.528+0000 7fe5a37fe640 1 -- 172.21.15.46:0/2354190302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe5a802d950 con 0x10da1c0 2024-09-11T14:20:02.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.528+0000 7fe5a37fe640 1 -- 172.21.15.46:0/2354190302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5a802dbf0 con 0x10da1c0 2024-09-11T14:20:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.529+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/2354190302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 msgr2=0x10da5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.529+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/2354190302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 0x10da5d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.529+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/2354190302 shutdown_connections 2024-09-11T14:20:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.529+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/2354190302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 0x10da5d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.529+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/2354190302 >> 172.21.15.46:0/2354190302 conn(0xee7f70 msgr2=0x10d8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.529+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/2354190302 shutdown_connections 2024-09-11T14:20:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.529+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/2354190302 wait complete. 2024-09-11T14:20:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.529+0000 7fe5b6e52ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:02.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.531+0000 7fe5b6e52ac0 1 Processor -- start 2024-09-11T14:20:02.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.531+0000 7fe5b6e52ac0 1 -- start start 2024-09-11T14:20:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5b6e52ac0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 0x1184370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5b6e52ac0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xf898f0 con 0x10da1c0 2024-09-11T14:20:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5b0ff7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 0x1184370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5b0ff7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 0x1184370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40822/0 (socket says 172.21.15.46:40822) 2024-09-11T14:20:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5b0ff7640 1 -- 172.21.15.46:0/777164290 learned_addr learned my addr 172.21.15.46:0/777164290 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5b0ff7640 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf23800 con 0x10da1c0 2024-09-11T14:20:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5b0ff7640 1 --2- 172.21.15.46:0/777164290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 0x1184370 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5a802dbf0 con 0x10da1c0 2024-09-11T14:20:02.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe5a8009410 con 0x10da1c0 2024-09-11T14:20:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xf15310 con 0x10da1c0 2024-09-11T14:20:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe5a80096b0 con 0x10da1c0 2024-09-11T14:20:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.533+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xf14d70 con 0x10da1c0 2024-09-11T14:20:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.534+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (crc 0 0 0) 0x7fe5a8009810 con 0x10da1c0 2024-09-11T14:20:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.535+0000 7fe5a0ff9640 1 --2- 172.21.15.46:0/777164290 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe59003d130 0x7fe59003f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.535+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7fe5a8032040 con 0x10da1c0 2024-09-11T14:20:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.535+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x10c5ba0 con 0x10da1c0 2024-09-11T14:20:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.535+0000 7fe5a3fff640 1 --2- 172.21.15.46:0/777164290 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe59003d130 0x7fe59003f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:02.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:02.535+0000 7fe5a3fff640 1 --2- 172.21.15.46:0/777164290 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe59003d130 0x7fe59003f640 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:03.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.261+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe5a8036d20 con 0x10da1c0 2024-09-11T14:20:03.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.406+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 141+0+0 (crc 0 0 0) 0x7fe5a802ead0 con 0x10da1c0 2024-09-11T14:20:03.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.406+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0xf3c520 con 0x10da1c0 2024-09-11T14:20:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.409+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (crc 0 0 0) 0x7fe5a8039ae0 con 0x10da1c0 2024-09-11T14:20:03.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.409+0000 7fe5a2ffd640 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=13}) -- 0x7fe588002ae0 con 0x10da1c0 2024-09-11T14:20:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.409+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 9 ==== osd_map(13..13 src has 1..13) ==== 658+0+0 (crc 0 0 0) 0x7fe5a8037c50 con 0x10da1c0 2024-09-11T14:20:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.410+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6805/1751227380 conn(0x10dab10 0x1180f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.410+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) -- 0x1181490 con 0x10dab10 2024-09-11T14:20:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.415+0000 7fe5b2259640 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6805/1751227380 conn(0x10dab10 0x1180f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:20:03.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.475+0000 7fe5b2259640 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6805/1751227380 conn(0x10dab10 0x1180f50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:03.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.533+0000 7fe5b2259640 1 -- 172.21.15.46:0/777164290 <== osd.1 v2:172.21.15.46:6805/1751227380 1 ==== osd_op_reply(1 rbd_trash [create] v13'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fe5a400a4b0 con 0x10dab10 2024-09-11T14:20:03.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.537+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6801/1724049974 conn(0x11dbae0 0x11ddfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:03.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.537+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x11de590 con 0x11dbae0 2024-09-11T14:20:03.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.538+0000 7fe5b0ff7640 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6801/1724049974 conn(0x11dbae0 0x11ddfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:20:03.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.542+0000 7fe5b0ff7640 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6801/1724049974 conn(0x11dbae0 0x11ddfc0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:03.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.546+0000 7fe5b0ff7640 1 -- 172.21.15.46:0/777164290 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe5a8035040 con 0x11dbae0 2024-09-11T14:20:03.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.547+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x11dafa0 con 0x11dbae0 2024-09-11T14:20:03.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.550+0000 7fe5b0ff7640 1 -- 172.21.15.46:0/777164290 <== osd.0 v2:172.21.15.46:6801/1724049974 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe5a8035040 con 0x11dbae0 2024-09-11T14:20:03.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:03.550+0000 7fe5a27fc640 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fe58c001f60 con 0x10da1c0 2024-09-11T14:20:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:04.412+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v14) ==== 55+0+0 (crc 0 0 0) 0x7fe5a802f7a0 con 0x10da1c0 2024-09-11T14:20:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:04.412+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7fe5900423e0 con 0x10da1c0 2024-09-11T14:20:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:04.412+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 11 ==== osd_map(14..14 src has 1..14) ==== 626+0+0 (crc 0 0 0) 0x7fe5a802fd20 con 0x10da1c0 2024-09-11T14:20:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:04.412+0000 7fe5a2ffd640 1 -- 172.21.15.46:0/777164290 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x7fe588005640 con 0x11dbae0 2024-09-11T14:20:04.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:04.454+0000 7fe5b0ff7640 1 -- 172.21.15.46:0/777164290 <== osd.0 v2:172.21.15.46:6801/1724049974 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v14'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe5a8035040 con 0x11dbae0 2024-09-11T14:20:04.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:04.454+0000 7fe5a27fc640 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v14) -- 0x7fe58c003370 con 0x10da1c0 2024-09-11T14:20:05.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.416+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v15) ==== 43+0+0 (crc 0 0 0) 0x7fe5a802f990 con 0x10da1c0 2024-09-11T14:20:05.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.416+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7fe590042620 con 0x10da1c0 2024-09-11T14:20:05.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.416+0000 7fe5a0ff9640 1 -- 172.21.15.46:0/777164290 <== mon.0 v2:172.21.15.46:3300/0 13 ==== osd_map(15..15 src has 1..15) ==== 654+0+0 (crc 0 0 0) 0x7fe5a8008160 con 0x10da1c0 2024-09-11T14:20:05.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.416+0000 7fe5a2ffd640 1 -- 172.21.15.46:0/777164290 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7fe5880059a0 con 0x11dbae0 2024-09-11T14:20:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b0ff7640 1 -- 172.21.15.46:0/777164290 <== osd.0 v2:172.21.15.46:6801/1724049974 4 ==== osd_op_reply(7 rbd_info [write 0~19] v15'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5a8035040 con 0x11dbae0 2024-09-11T14:20:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6801/1724049974 conn(0x11dbae0 msgr2=0x11ddfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6801/1724049974 conn(0x11dbae0 0x11ddfc0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6805/1751227380 conn(0x10dab10 msgr2=0x1180f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6805/1751227380 conn(0x10dab10 0x1180f50 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe59003d130 msgr2=0x7fe59003f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe59003d130 0x7fe59003f640 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 msgr2=0x1184370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 0x1184370 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 shutdown_connections 2024-09-11T14:20:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6801/1724049974 conn(0x11dbae0 0x11ddfc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> v2:172.21.15.46:6805/1751227380 conn(0x10dab10 0x1180f50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe59003d130 0x7fe59003f640 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 --2- 172.21.15.46:0/777164290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x10da1c0 0x1184370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.463+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 >> 172.21.15.46:0/777164290 conn(0xee7f70 msgr2=0x10e3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.464+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 shutdown_connections 2024-09-11T14:20:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.464+0000 7fe5b6e52ac0 1 -- 172.21.15.46:0/777164290 wait complete. 2024-09-11T14:20:05.470 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T14:20:05.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-11T14:20:05.471 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T14:20:05.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.582+0000 7f1f82991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:05.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.589+0000 7f1f82991640 1 Processor -- start 2024-09-11T14:20:05.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.589+0000 7f1f82991640 1 -- start start 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.590+0000 7f1f82991640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f7c1326c0 0x7f1f7c132ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.590+0000 7f1f82991640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f7c1322b0 con 0x7f1f7c09cb60 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.590+0000 7f1f82991640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f1f7c06fda0 con 0x7f1f7c1326c0 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f7c1326c0 0x7f1f7c132ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1f7c09cb60 0x7f1f7c09cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51072/0 (socket says 172.21.15.46:51072) 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7b7fe640 1 -- 172.21.15.46:0/4050330011 learned_addr learned my addr 172.21.15.46:0/4050330011 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7bfff640 1 -- 172.21.15.46:0/4050330011 >> v1:172.21.15.46:6789/0 conn(0x7f1f7c09cb60 legacy=0x7f1f7c09cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7bfff640 1 -- 172.21.15.46:0/4050330011 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c09fda0 con 0x7f1f7c1326c0 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7affd640 1 -- 172.21.15.46:0/4050330011 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2252622152 0 0) 0x7f1f7c1322b0 con 0x7f1f7c09cb60 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7bfff640 1 --2- 172.21.15.46:0/4050330011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c1326c0 0x7f1f7c132ad0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493e5f1516b08ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7affd640 1 -- 172.21.15.46:0/4050330011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1f6c009d90 con 0x7f1f7c1326c0 2024-09-11T14:20:05.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7affd640 1 -- 172.21.15.46:0/4050330011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1f6c00e230 con 0x7f1f7c1326c0 2024-09-11T14:20:05.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.591+0000 7f1f7affd640 1 -- 172.21.15.46:0/4050330011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1f6c00e4d0 con 0x7f1f7c1326c0 2024-09-11T14:20:05.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.592+0000 7f1f82991640 1 -- 172.21.15.46:0/4050330011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c1326c0 msgr2=0x7f1f7c132ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.592+0000 7f1f82991640 1 --2- 172.21.15.46:0/4050330011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c1326c0 0x7f1f7c132ad0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.592+0000 7f1f82991640 1 -- 172.21.15.46:0/4050330011 shutdown_connections 2024-09-11T14:20:05.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.592+0000 7f1f82991640 1 --2- 172.21.15.46:0/4050330011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c1326c0 0x7f1f7c132ad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.592+0000 7f1f82991640 1 -- 172.21.15.46:0/4050330011 >> 172.21.15.46:0/4050330011 conn(0x7f1f7c0690e0 msgr2=0x7f1f7c0694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:05.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.592+0000 7f1f82991640 1 -- 172.21.15.46:0/4050330011 shutdown_connections 2024-09-11T14:20:05.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.592+0000 7f1f82991640 1 -- 172.21.15.46:0/4050330011 wait complete. 2024-09-11T14:20:05.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.592+0000 7f1f82991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:05.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.594+0000 7f1f82991640 1 Processor -- start 2024-09-11T14:20:05.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.594+0000 7f1f82991640 1 -- start start 2024-09-11T14:20:05.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f82991640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c09cb60 0x7f1f7c11de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:05.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f82991640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c11f150 con 0x7f1f7c09cb60 2024-09-11T14:20:05.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f7bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c09cb60 0x7f1f7c11de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:05.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f7bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c09cb60 0x7f1f7c11de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40840/0 (socket says 172.21.15.46:40840) 2024-09-11T14:20:05.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f7bfff640 1 -- 172.21.15.46:0/1960706038 learned_addr learned my addr 172.21.15.46:0/1960706038 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:05.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f7bfff640 1 -- 172.21.15.46:0/1960706038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c11f930 con 0x7f1f7c09cb60 2024-09-11T14:20:05.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f7bfff640 1 --2- 172.21.15.46:0/1960706038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c09cb60 0x7f1f7c11de80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:05.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f78ff9640 1 -- 172.21.15.46:0/1960706038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1f6c014540 con 0x7f1f7c09cb60 2024-09-11T14:20:05.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f78ff9640 1 -- 172.21.15.46:0/1960706038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1f6c0146a0 con 0x7f1f7c09cb60 2024-09-11T14:20:05.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7c1206e0 con 0x7f1f7c09cb60 2024-09-11T14:20:05.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.596+0000 7f1f78ff9640 1 -- 172.21.15.46:0/1960706038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1f6c014940 con 0x7f1f7c09cb60 2024-09-11T14:20:05.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.597+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f7c120170 con 0x7f1f7c09cb60 2024-09-11T14:20:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.597+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f7c0008d0 con 0x7f1f7c09cb60 2024-09-11T14:20:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.598+0000 7f1f78ff9640 1 -- 172.21.15.46:0/1960706038 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1f6c014af0 con 0x7f1f7c09cb60 2024-09-11T14:20:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.598+0000 7f1f78ff9640 1 --2- 172.21.15.46:0/1960706038 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1f5c03e930 0x7f1f5c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.598+0000 7f1f78ff9640 1 -- 172.21.15.46:0/1960706038 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f1f6c019040 con 0x7f1f7c09cb60 2024-09-11T14:20:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.598+0000 7f1f7b7fe640 1 --2- 172.21.15.46:0/1960706038 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1f5c03e930 0x7f1f5c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.599+0000 7f1f7b7fe640 1 --2- 172.21.15.46:0/1960706038 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1f5c03e930 0x7f1f5c040e40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:05.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.603+0000 7f1f78ff9640 1 -- 172.21.15.46:0/1960706038 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f1f6c018790 con 0x7f1f7c09cb60 2024-09-11T14:20:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.790+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f1f7c121d10 con 0x7f1f7c09cb60 2024-09-11T14:20:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.791+0000 7f1f78ff9640 1 -- 172.21.15.46:0/1960706038 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (crc 0 0 0) 0x7f1f6c00f2a0 con 0x7f1f7c09cb60 2024-09-11T14:20:05.792 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:20:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.793+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1f5c03e930 msgr2=0x7f1f5c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.793+0000 7f1f82991640 1 --2- 172.21.15.46:0/1960706038 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1f5c03e930 0x7f1f5c040e40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.793+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c09cb60 msgr2=0x7f1f7c11de80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.793+0000 7f1f82991640 1 --2- 172.21.15.46:0/1960706038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c09cb60 0x7f1f7c11de80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.793+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 shutdown_connections 2024-09-11T14:20:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.793+0000 7f1f82991640 1 --2- 172.21.15.46:0/1960706038 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1f5c03e930 0x7f1f5c040e40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.793+0000 7f1f82991640 1 --2- 172.21.15.46:0/1960706038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f7c09cb60 0x7f1f7c11de80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.793+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 >> 172.21.15.46:0/1960706038 conn(0x7f1f7c0690e0 msgr2=0x7f1f7c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.794+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 shutdown_connections 2024-09-11T14:20:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.794+0000 7f1f82991640 1 -- 172.21.15.46:0/1960706038 wait complete. 2024-09-11T14:20:05.805 INFO:teuthology.orchestra.run.smithi046.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-11T14:20:05.806 INFO:tasks.ceph_manager:config epoch is 1 2024-09-11T14:20:05.806 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T14:20:05.806 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T14:20:05.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T14:20:05.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.913+0000 7f4018311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:05.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.918+0000 7f4018311640 1 Processor -- start 2024-09-11T14:20:05.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.918+0000 7f4018311640 1 -- start start 2024-09-11T14:20:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f4018311640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4010130470 0x7f4010130880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f4018311640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40100745e0 con 0x7f4010133250 2024-09-11T14:20:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f4018311640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f40100740f0 con 0x7f4010130470 2024-09-11T14:20:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f40160ad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4010130470 0x7f4010130880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:05.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f40158ac640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4010133250 0x7f4010133660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51078/0 (socket says 172.21.15.46:51078) 2024-09-11T14:20:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f40158ac640 1 -- 172.21.15.46:0/4128551031 learned_addr learned my addr 172.21.15.46:0/4128551031 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f40160ad640 1 -- 172.21.15.46:0/4128551031 >> v1:172.21.15.46:6789/0 conn(0x7f4010133250 legacy=0x7f4010133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f40160ad640 1 -- 172.21.15.46:0/4128551031 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40100749a0 con 0x7f4010130470 2024-09-11T14:20:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f40150ab640 1 -- 172.21.15.46:0/4128551031 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917028672 0 0) 0x7f40100745e0 con 0x7f4010133250 2024-09-11T14:20:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.920+0000 7f40160ad640 1 --2- 172.21.15.46:0/4128551031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 0x7f4010130880 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c9374741750340 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.921+0000 7f40150ab640 1 -- 172.21.15.46:0/4128551031 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f400c009d90 con 0x7f4010130470 2024-09-11T14:20:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.921+0000 7f40150ab640 1 -- 172.21.15.46:0/4128551031 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f400c00e230 con 0x7f4010130470 2024-09-11T14:20:05.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.921+0000 7f40150ab640 1 -- 172.21.15.46:0/4128551031 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f400c00e4d0 con 0x7f4010130470 2024-09-11T14:20:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.921+0000 7f4018311640 1 -- 172.21.15.46:0/4128551031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 msgr2=0x7f4010130880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.921+0000 7f4018311640 1 --2- 172.21.15.46:0/4128551031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 0x7f4010130880 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.921+0000 7f4018311640 1 -- 172.21.15.46:0/4128551031 shutdown_connections 2024-09-11T14:20:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.921+0000 7f4018311640 1 --2- 172.21.15.46:0/4128551031 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 0x7f4010130880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.921+0000 7f4018311640 1 -- 172.21.15.46:0/4128551031 >> 172.21.15.46:0/4128551031 conn(0x7f40100690e0 msgr2=0x7f40100694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.922+0000 7f4018311640 1 -- 172.21.15.46:0/4128551031 shutdown_connections 2024-09-11T14:20:05.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.922+0000 7f4018311640 1 -- 172.21.15.46:0/4128551031 wait complete. 2024-09-11T14:20:05.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.922+0000 7f4018311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:05.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.923+0000 7f4018311640 1 Processor -- start 2024-09-11T14:20:05.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.924+0000 7f4018311640 1 -- start start 2024-09-11T14:20:05.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.925+0000 7f4018311640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 0x7f401011eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:05.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.925+0000 7f4018311640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f401012ff90 con 0x7f4010130470 2024-09-11T14:20:05.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.925+0000 7f40160ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 0x7f401011eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:05.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.925+0000 7f40160ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 0x7f401011eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40850/0 (socket says 172.21.15.46:40850) 2024-09-11T14:20:05.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.925+0000 7f40160ad640 1 -- 172.21.15.46:0/3052300963 learned_addr learned my addr 172.21.15.46:0/3052300963 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:05.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.925+0000 7f40160ad640 1 -- 172.21.15.46:0/3052300963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401011f640 con 0x7f4010130470 2024-09-11T14:20:05.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.926+0000 7f40160ad640 1 --2- 172.21.15.46:0/3052300963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 0x7f401011eed0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:05.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.926+0000 7f4006ffd640 1 -- 172.21.15.46:0/3052300963 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f400c013610 con 0x7f4010130470 2024-09-11T14:20:05.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.926+0000 7f4006ffd640 1 -- 172.21.15.46:0/3052300963 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f400c013770 con 0x7f4010130470 2024-09-11T14:20:05.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.926+0000 7f4006ffd640 1 -- 172.21.15.46:0/3052300963 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f400c013a10 con 0x7f4010130470 2024-09-11T14:20:05.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.926+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401011f900 con 0x7f4010130470 2024-09-11T14:20:05.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.926+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40100a4af0 con 0x7f4010130470 2024-09-11T14:20:05.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.927+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f401006a300 con 0x7f4010130470 2024-09-11T14:20:05.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.927+0000 7f4006ffd640 1 -- 172.21.15.46:0/3052300963 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f400c013bc0 con 0x7f4010130470 2024-09-11T14:20:05.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.927+0000 7f4006ffd640 1 --2- 172.21.15.46:0/3052300963 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3ff403e960 0x7f3ff4040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:05.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.927+0000 7f4006ffd640 1 -- 172.21.15.46:0/3052300963 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f400c018040 con 0x7f4010130470 2024-09-11T14:20:05.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.928+0000 7f40158ac640 1 --2- 172.21.15.46:0/3052300963 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3ff403e960 0x7f3ff4040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:05.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.928+0000 7f40158ac640 1 --2- 172.21.15.46:0/3052300963 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3ff403e960 0x7f3ff4040e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:05.933+0000 7f4006ffd640 1 -- 172.21.15.46:0/3052300963 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f400c011380 con 0x7f4010130470 2024-09-11T14:20:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.164+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4010073e40 con 0x7f4010130470 2024-09-11T14:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.166+0000 7f4006ffd640 1 -- 172.21.15.46:0/3052300963 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97898 (crc 0 0 0) 0x7f400c018a40 con 0x7f4010130470 2024-09-11T14:20:06.168 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3ff403e960 msgr2=0x7f3ff4040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 --2- 172.21.15.46:0/3052300963 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3ff403e960 0x7f3ff4040e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 msgr2=0x7f401011eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 --2- 172.21.15.46:0/3052300963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 0x7f401011eed0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 shutdown_connections 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 --2- 172.21.15.46:0/3052300963 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3ff403e960 0x7f3ff4040e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 --2- 172.21.15.46:0/3052300963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4010130470 0x7f401011eed0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 >> 172.21.15.46:0/3052300963 conn(0x7f40100690e0 msgr2=0x7f4010071660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 shutdown_connections 2024-09-11T14:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.168+0000 7f4018311640 1 -- 172.21.15.46:0/3052300963 wait complete. 2024-09-11T14:20:06.180 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":455983768},{"type":"v1","addr":"172.21.15.47:6801","nonce":455983768}]},"active_addr":"172.21.15.47:6801/455983768","active_change":"2024-09-11T14:19:56.328584+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":1392643410}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":1290933032}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2098133406}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2035012344}]}]} 2024-09-11T14:20:06.183 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T14:20:06.183 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T14:20:06.183 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:20:06.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.290+0000 7f40cf8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.295+0000 7f40cf8a3640 1 Processor -- start 2024-09-11T14:20:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.295+0000 7f40cf8a3640 1 -- start start 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40cf8a3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40c81365a0 0x7f40c81389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40cf8a3640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c8074a00 con 0x7f40c8130420 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40cf8a3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f40c8074c30 con 0x7f40c81365a0 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40cce3e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40c81365a0 0x7f40c81389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40cd63f640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f40c8130420 0x7f40c8130830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51088/0 (socket says 172.21.15.46:51088) 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40cd63f640 1 -- 172.21.15.46:0/3032415373 learned_addr learned my addr 172.21.15.46:0/3032415373 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40cce3e640 1 -- 172.21.15.46:0/3032415373 >> v1:172.21.15.46:6789/0 conn(0x7f40c8130420 legacy=0x7f40c8130830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40cce3e640 1 -- 172.21.15.46:0/3032415373 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c8071930 con 0x7f40c81365a0 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40bffff640 1 -- 172.21.15.46:0/3032415373 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941739182 0 0) 0x7f40c8074a00 con 0x7f40c8130420 2024-09-11T14:20:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40cce3e640 1 --2- 172.21.15.46:0/3032415373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c81365a0 0x7f40c81389c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00799eb45f8c254 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40bffff640 1 -- 172.21.15.46:0/3032415373 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40b8009d90 con 0x7f40c81365a0 2024-09-11T14:20:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40bffff640 1 -- 172.21.15.46:0/3032415373 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f40b800e230 con 0x7f40c81365a0 2024-09-11T14:20:06.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.297+0000 7f40bffff640 1 -- 172.21.15.46:0/3032415373 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40b800e4d0 con 0x7f40c81365a0 2024-09-11T14:20:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.298+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3032415373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c81365a0 msgr2=0x7f40c81389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.298+0000 7f40cf8a3640 1 --2- 172.21.15.46:0/3032415373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c81365a0 0x7f40c81389c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.298+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3032415373 shutdown_connections 2024-09-11T14:20:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.298+0000 7f40cf8a3640 1 --2- 172.21.15.46:0/3032415373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c81365a0 0x7f40c81389c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.298+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3032415373 >> 172.21.15.46:0/3032415373 conn(0x7f40c80a0320 msgr2=0x7f40c80a0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.298+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3032415373 shutdown_connections 2024-09-11T14:20:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.298+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3032415373 wait complete. 2024-09-11T14:20:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.299+0000 7f40cf8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.300+0000 7f40cf8a3640 1 Processor -- start 2024-09-11T14:20:06.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.300+0000 7f40cf8a3640 1 -- start start 2024-09-11T14:20:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40cf8a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c8130420 0x7f40c8120310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40cf8a3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f40c8122fa0 con 0x7f40c8130420 2024-09-11T14:20:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40cd63f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c8130420 0x7f40c8120310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40cd63f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c8130420 0x7f40c8120310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40870/0 (socket says 172.21.15.46:40870) 2024-09-11T14:20:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40cd63f640 1 -- 172.21.15.46:0/3555373097 learned_addr learned my addr 172.21.15.46:0/3555373097 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40cd63f640 1 -- 172.21.15.46:0/3555373097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c8121870 con 0x7f40c8130420 2024-09-11T14:20:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40cd63f640 1 --2- 172.21.15.46:0/3555373097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c8130420 0x7f40c8120310 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40bdffb640 1 -- 172.21.15.46:0/3555373097 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40c4004b80 con 0x7f40c8130420 2024-09-11T14:20:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40bdffb640 1 -- 172.21.15.46:0/3555373097 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f40c4004ce0 con 0x7f40c8130420 2024-09-11T14:20:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.302+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c8122880 con 0x7f40c8130420 2024-09-11T14:20:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.303+0000 7f40bdffb640 1 -- 172.21.15.46:0/3555373097 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40c4007120 con 0x7f40c8130420 2024-09-11T14:20:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.303+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c8136220 con 0x7f40c8130420 2024-09-11T14:20:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.303+0000 7f40bdffb640 1 -- 172.21.15.46:0/3555373097 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f40c40072d0 con 0x7f40c8130420 2024-09-11T14:20:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.304+0000 7f40bdffb640 1 --2- 172.21.15.46:0/3555373097 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f40ac03e930 0x7f40ac040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.304+0000 7f40bdffb640 1 -- 172.21.15.46:0/3555373097 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f40c404f8c0 con 0x7f40c8130420 2024-09-11T14:20:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.304+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c806a300 con 0x7f40c8130420 2024-09-11T14:20:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.304+0000 7f40cce3e640 1 --2- 172.21.15.46:0/3555373097 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f40ac03e930 0x7f40ac040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.305+0000 7f40cce3e640 1 --2- 172.21.15.46:0/3555373097 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f40ac03e930 0x7f40ac040e40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.309+0000 7f40bdffb640 1 -- 172.21.15.46:0/3555373097 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f40c400f420 con 0x7f40c8130420 2024-09-11T14:20:06.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.498+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40c8130830 con 0x7f40c8130420 2024-09-11T14:20:06.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.498+0000 7f40bdffb640 1 -- 172.21.15.46:0/3555373097 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8867 (crc 0 0 0) 0x7f40c400a0c0 con 0x7f40c8130420 2024-09-11T14:20:06.500 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:20:06.500 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"fsid":"1036f700-a934-4ca9-974c-2362e4adfb5d","created":"2024-09-11T14:19:51.780788+0000","modified":"2024-09-11T14:20:05.411640+0000","last_up_change":"2024-09-11T14:19:58.389280+0000","last_in_change":"2024-09-11T14:19:53.927574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:20:00.363613+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:20:02.154593+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38ba4d14-fba0-43ad-8341-3a4dff407458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6801","nonce":1724049974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1724049974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1724049974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":1724049974}]},"public_addr":"172.21.15.46:6801/1724049974","cluster_addr":"172.21.15.46:6800/1724049974","heartbeat_back_addr":"172.21.15.46:6807/1724049974","heartbeat_front_addr":"172.21.15.46:6809/1724049974","state":["exists","up"]},{"osd":1,"uuid":"981ffb3f-b14b-49fd-bbed-bc853a1bb77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":1751227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1751227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1751227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":1751227380}]},"public_addr":"172.21.15.46:6805/1751227380","cluster_addr":"172.21.15.46:6804/1751227380","heartbeat_back_addr":"172.21.15.46:6816/1751227380","heartbeat_front_addr":"172.21.15.46:6815/1751227380","state":["exists","up"]},{"osd":2,"uuid":"3e1c22fb-cf45-43cd-a45c-d546b44d973b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":3757354244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3757354244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3757354244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":3757354244}]},"public_addr":"172.21.15.47:6803/3757354244","cluster_addr":"172.21.15.47:6802/3757354244","heartbeat_back_addr":"172.21.15.47:6810/3757354244","heartbeat_front_addr":"172.21.15.47:6811/3757354244","state":["exists","up"]},{"osd":3,"uuid":"9c1ff14e-10e9-4e46-9343-d3368a835700","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":1666238977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1666238977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1666238977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":1666238977}]},"public_addr":"172.21.15.47:6805/1666238977","cluster_addr":"172.21.15.47:6804/1666238977","heartbeat_back_addr":"172.21.15.47:6808/1666238977","heartbeat_front_addr":"172.21.15.47:6807/1666238977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:20:06.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f40ac03e930 msgr2=0x7f40ac040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 --2- 172.21.15.46:0/3555373097 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f40ac03e930 0x7f40ac040e40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c8130420 msgr2=0x7f40c8120310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 --2- 172.21.15.46:0/3555373097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c8130420 0x7f40c8120310 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 shutdown_connections 2024-09-11T14:20:06.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 --2- 172.21.15.46:0/3555373097 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f40ac03e930 0x7f40ac040e40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 --2- 172.21.15.46:0/3555373097 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40c8130420 0x7f40c8120310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 >> 172.21.15.46:0/3555373097 conn(0x7f40c80a0320 msgr2=0x7f40c81342f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:06.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 shutdown_connections 2024-09-11T14:20:06.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.501+0000 7f40cf8a3640 1 -- 172.21.15.46:0/3555373097 wait complete. 2024-09-11T14:20:06.513 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T14:20:06.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:20:06.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.620+0000 7fc510911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.625+0000 7fc510911640 1 Processor -- start 2024-09-11T14:20:06.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.625+0000 7fc510911640 1 -- start start 2024-09-11T14:20:06.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.627+0000 7fc510911640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc50c1355c0 0x7fc50c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.627+0000 7fc510911640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c1331e0 con 0x7fc50c1326c0 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.627+0000 7fc510911640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc50c1322b0 con 0x7fc50c1355c0 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.627+0000 7fc509d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc50c1355c0 0x7fc50c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.627+0000 7fc50a59c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc50c1326c0 0x7fc50c132ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51096/0 (socket says 172.21.15.46:51096) 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.627+0000 7fc509d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc50c1355c0 0x7fc50c1379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40874/0 (socket says 172.21.15.46:40874) 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.627+0000 7fc50a59c640 1 -- 172.21.15.46:0/828447514 learned_addr learned my addr 172.21.15.46:0/828447514 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.628+0000 7fc509d9b640 1 -- 172.21.15.46:0/828447514 >> v1:172.21.15.46:6789/0 conn(0x7fc50c1326c0 legacy=0x7fc50c132ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.628+0000 7fc509d9b640 1 -- 172.21.15.46:0/828447514 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c06fda0 con 0x7fc50c1355c0 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.628+0000 7fc509d9b640 1 --2- 172.21.15.46:0/828447514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1355c0 0x7fc50c1379e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89420d4079e22e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.628+0000 7fc50959a640 1 -- 172.21.15.46:0/828447514 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc500009d90 con 0x7fc50c1355c0 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.628+0000 7fc50959a640 1 -- 172.21.15.46:0/828447514 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc50000e230 con 0x7fc50c1355c0 2024-09-11T14:20:06.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.628+0000 7fc50959a640 1 -- 172.21.15.46:0/828447514 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc50000e4d0 con 0x7fc50c1355c0 2024-09-11T14:20:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.629+0000 7fc510911640 1 -- 172.21.15.46:0/828447514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1355c0 msgr2=0x7fc50c1379e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.629+0000 7fc510911640 1 --2- 172.21.15.46:0/828447514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1355c0 0x7fc50c1379e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.629+0000 7fc510911640 1 -- 172.21.15.46:0/828447514 shutdown_connections 2024-09-11T14:20:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.629+0000 7fc510911640 1 --2- 172.21.15.46:0/828447514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1355c0 0x7fc50c1379e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.629+0000 7fc510911640 1 -- 172.21.15.46:0/828447514 >> 172.21.15.46:0/828447514 conn(0x7fc50c0690e0 msgr2=0x7fc50c0694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.629+0000 7fc510911640 1 -- 172.21.15.46:0/828447514 shutdown_connections 2024-09-11T14:20:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.629+0000 7fc510911640 1 -- 172.21.15.46:0/828447514 wait complete. 2024-09-11T14:20:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.629+0000 7fc510911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.631+0000 7fc510911640 1 Processor -- start 2024-09-11T14:20:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.631+0000 7fc510911640 1 -- start start 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc510911640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1326c0 0x7fc50c123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc510911640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c0729b0 con 0x7fc50c1326c0 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc50a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1326c0 0x7fc50c123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc50a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1326c0 0x7fc50c123890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40886/0 (socket says 172.21.15.46:40886) 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc50a59c640 1 -- 172.21.15.46:0/389963873 learned_addr learned my addr 172.21.15.46:0/389963873 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc50a59c640 1 -- 172.21.15.46:0/389963873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c0723d0 con 0x7fc50c1326c0 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc50a59c640 1 --2- 172.21.15.46:0/389963873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1326c0 0x7fc50c123890 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc4faffd640 1 -- 172.21.15.46:0/389963873 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc4fc005a60 con 0x7fc50c1326c0 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc4faffd640 1 -- 172.21.15.46:0/389963873 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc4fc005bc0 con 0x7fc50c1326c0 2024-09-11T14:20:06.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c122300 con 0x7fc50c1326c0 2024-09-11T14:20:06.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc4faffd640 1 -- 172.21.15.46:0/389963873 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc4fc005e60 con 0x7fc50c1326c0 2024-09-11T14:20:06.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.633+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c123360 con 0x7fc50c1326c0 2024-09-11T14:20:06.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.634+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50c123e60 con 0x7fc50c1326c0 2024-09-11T14:20:06.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.634+0000 7fc4faffd640 1 -- 172.21.15.46:0/389963873 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc4fc0070b0 con 0x7fc50c1326c0 2024-09-11T14:20:06.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.635+0000 7fc4faffd640 1 --2- 172.21.15.46:0/389963873 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc4ec03e930 0x7fc4ec040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.635+0000 7fc4faffd640 1 -- 172.21.15.46:0/389963873 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fc4fc04f650 con 0x7fc50c1326c0 2024-09-11T14:20:06.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.635+0000 7fc509d9b640 1 --2- 172.21.15.46:0/389963873 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc4ec03e930 0x7fc4ec040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.636+0000 7fc509d9b640 1 --2- 172.21.15.46:0/389963873 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc4ec03e930 0x7fc4ec040e40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.640+0000 7fc4faffd640 1 -- 172.21.15.46:0/389963873 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc4fc00dc10 con 0x7fc50c1326c0 2024-09-11T14:20:06.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.826+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc50c134870 con 0x7fc50c1326c0 2024-09-11T14:20:06.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.827+0000 7fc4faffd640 1 -- 172.21.15.46:0/389963873 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8867 (crc 0 0 0) 0x7fc4fc00d610 con 0x7fc50c1326c0 2024-09-11T14:20:06.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:20:06.829 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"fsid":"1036f700-a934-4ca9-974c-2362e4adfb5d","created":"2024-09-11T14:19:51.780788+0000","modified":"2024-09-11T14:20:05.411640+0000","last_up_change":"2024-09-11T14:19:58.389280+0000","last_in_change":"2024-09-11T14:19:53.927574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:20:00.363613+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:20:02.154593+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38ba4d14-fba0-43ad-8341-3a4dff407458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6801","nonce":1724049974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1724049974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1724049974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":1724049974}]},"public_addr":"172.21.15.46:6801/1724049974","cluster_addr":"172.21.15.46:6800/1724049974","heartbeat_back_addr":"172.21.15.46:6807/1724049974","heartbeat_front_addr":"172.21.15.46:6809/1724049974","state":["exists","up"]},{"osd":1,"uuid":"981ffb3f-b14b-49fd-bbed-bc853a1bb77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":1751227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1751227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1751227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":1751227380}]},"public_addr":"172.21.15.46:6805/1751227380","cluster_addr":"172.21.15.46:6804/1751227380","heartbeat_back_addr":"172.21.15.46:6816/1751227380","heartbeat_front_addr":"172.21.15.46:6815/1751227380","state":["exists","up"]},{"osd":2,"uuid":"3e1c22fb-cf45-43cd-a45c-d546b44d973b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":3757354244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3757354244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3757354244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":3757354244}]},"public_addr":"172.21.15.47:6803/3757354244","cluster_addr":"172.21.15.47:6802/3757354244","heartbeat_back_addr":"172.21.15.47:6810/3757354244","heartbeat_front_addr":"172.21.15.47:6811/3757354244","state":["exists","up"]},{"osd":3,"uuid":"9c1ff14e-10e9-4e46-9343-d3368a835700","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":1666238977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1666238977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1666238977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":1666238977}]},"public_addr":"172.21.15.47:6805/1666238977","cluster_addr":"172.21.15.47:6804/1666238977","heartbeat_back_addr":"172.21.15.47:6808/1666238977","heartbeat_front_addr":"172.21.15.47:6807/1666238977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:20:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.829+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc4ec03e930 msgr2=0x7fc4ec040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.829+0000 7fc510911640 1 --2- 172.21.15.46:0/389963873 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc4ec03e930 0x7fc4ec040e40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.829+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1326c0 msgr2=0x7fc50c123890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.829+0000 7fc510911640 1 --2- 172.21.15.46:0/389963873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1326c0 0x7fc50c123890 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.829+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 shutdown_connections 2024-09-11T14:20:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.829+0000 7fc510911640 1 --2- 172.21.15.46:0/389963873 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc4ec03e930 0x7fc4ec040e40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.829+0000 7fc510911640 1 --2- 172.21.15.46:0/389963873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc50c1326c0 0x7fc50c123890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.829+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 >> 172.21.15.46:0/389963873 conn(0x7fc50c0690e0 msgr2=0x7fc50c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:06.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.829+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 shutdown_connections 2024-09-11T14:20:06.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.830+0000 7fc510911640 1 -- 172.21.15.46:0/389963873 wait complete. 2024-09-11T14:20:06.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T14:20:06.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T14:20:06.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T14:20:06.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T14:20:06.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.962+0000 7f27232fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.962+0000 7f748fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.962+0000 7f4d77b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.962+0000 7f27bcad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.968+0000 7f748fb51640 1 Processor -- start 2024-09-11T14:20:06.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.968+0000 7f27232fd640 1 Processor -- start 2024-09-11T14:20:06.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.968+0000 7f4d77b91640 1 Processor -- start 2024-09-11T14:20:06.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.968+0000 7f748fb51640 1 -- start start 2024-09-11T14:20:06.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.968+0000 7f27bcad1640 1 Processor -- start 2024-09-11T14:20:06.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.968+0000 7f27232fd640 1 -- start start 2024-09-11T14:20:06.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.968+0000 7f4d77b91640 1 -- start start 2024-09-11T14:20:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.969+0000 7f27bcad1640 1 -- start start 2024-09-11T14:20:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f748fb51640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7488133a30 0x7f7488138850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f27232fd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f271c132520 0x7f271c132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f4d77b91640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d700717b0 0x7f4d70071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f748fb51640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7488074420 con 0x7f74880733a0 2024-09-11T14:20:06.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f27232fd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f271c06f6d0 con 0x7f271c0a3450 2024-09-11T14:20:06.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f748fb51640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f74880749a0 con 0x7f7488133a30 2024-09-11T14:20:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f27232fd640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f271c06f3d0 con 0x7f271c132520 2024-09-11T14:20:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f2721099640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f271c132520 0x7f271c132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f2721099640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f271c132520 0x7f271c132930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40900/0 (socket says 172.21.15.46:40900) 2024-09-11T14:20:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f2721099640 1 -- 172.21.15.46:0/1152156177 learned_addr learned my addr 172.21.15.46:0/1152156177 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:06.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f4d77b91640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d70072860 con 0x7f4d70072100 2024-09-11T14:20:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f4d77b91640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f4d700a1f50 con 0x7f4d700717b0 2024-09-11T14:20:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f27bcad1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27b8138720 0x7f27b813ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f27bcad1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b8133040 con 0x7f27b8132520 2024-09-11T14:20:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f27bcad1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f27b806f6d0 con 0x7f27b8138720 2024-09-11T14:20:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f4d7592d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d700717b0 0x7f4d70071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f4d7592d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d700717b0 0x7f4d70071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40904/0 (socket says 172.21.15.46:40904) 2024-09-11T14:20:06.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f4d7592d640 1 -- 172.21.15.46:0/1177901782 learned_addr learned my addr 172.21.15.46:0/1177901782 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:06.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.970+0000 7f748d8ed640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f74880733a0 0x7f7488133320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51104/0 (socket says 172.21.15.46:51104) 2024-09-11T14:20:06.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f748d8ed640 1 -- 172.21.15.46:0/4254731678 learned_addr learned my addr 172.21.15.46:0/4254731678 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:06.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f748d0ec640 1 --2- 172.21.15.46:0/4254731678 >> v2:172.21.15.46:3300/0 conn(0x7f7488133a30 0x7f7488138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f27b659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f27b8132520 0x7f27b8132930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51122/0 (socket says 172.21.15.46:51122) 2024-09-11T14:20:06.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f27b659c640 1 -- 172.21.15.46:0/2451884717 learned_addr learned my addr 172.21.15.46:0/2451884717 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:06.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f27b5d9b640 1 --2- 172.21.15.46:0/2451884717 >> v2:172.21.15.46:3300/0 conn(0x7f27b8138720 0x7f27b813ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f2721099640 1 -- 172.21.15.46:0/1152156177 >> v1:172.21.15.46:6789/0 conn(0x7f271c0a3450 legacy=0x7f271c0a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f2721099640 1 -- 172.21.15.46:0/1152156177 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c06f0c0 con 0x7f271c132520 2024-09-11T14:20:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f4d7592d640 1 -- 172.21.15.46:0/1177901782 >> v1:172.21.15.46:6789/0 conn(0x7f4d70072100 legacy=0x7f4d70130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f4d7592d640 1 -- 172.21.15.46:0/1177901782 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d70074760 con 0x7f4d700717b0 2024-09-11T14:20:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f2721099640 1 --2- 172.21.15.46:0/1152156177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c132520 0x7f271c132930 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4185a4e0543d110 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f748d0ec640 1 -- 172.21.15.46:0/4254731678 >> v1:172.21.15.46:6789/0 conn(0x7f74880733a0 legacy=0x7f7488133320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f748d0ec640 1 -- 172.21.15.46:0/4254731678 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7488074110 con 0x7f7488133a30 2024-09-11T14:20:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f27b5d9b640 1 -- 172.21.15.46:0/2451884717 >> v1:172.21.15.46:6789/0 conn(0x7f27b8132520 legacy=0x7f27b8132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f27b5d9b640 1 -- 172.21.15.46:0/2451884717 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b806f3d0 con 0x7f27b8138720 2024-09-11T14:20:06.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f4d7592d640 1 --2- 172.21.15.46:0/1177901782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 0x7f4d70071bc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1733401df0479e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.971+0000 7f748d0ec640 1 --2- 172.21.15.46:0/4254731678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 0x7f7488138850 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380bfd5a561d4873 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f27b5d9b640 1 --2- 172.21.15.46:0/2451884717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8138720 0x7f27b813ab40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b9e446c58fc052 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f2713fff640 1 -- 172.21.15.46:0/1152156177 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2718009e50 con 0x7f271c132520 2024-09-11T14:20:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f2713fff640 1 -- 172.21.15.46:0/1152156177 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f271800e230 con 0x7f271c132520 2024-09-11T14:20:06.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f2713fff640 1 -- 172.21.15.46:0/1152156177 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f271800e4d0 con 0x7f271c132520 2024-09-11T14:20:06.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f748c8eb640 1 -- 172.21.15.46:0/4254731678 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7478009d90 con 0x7f7488133a30 2024-09-11T14:20:06.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f27b559a640 1 -- 172.21.15.46:0/2451884717 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27ac009d90 con 0x7f27b8138720 2024-09-11T14:20:06.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f27b559a640 1 -- 172.21.15.46:0/2451884717 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f27ac00e230 con 0x7f27b8138720 2024-09-11T14:20:06.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f748c8eb640 1 -- 172.21.15.46:0/4254731678 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f747800e230 con 0x7f7488133a30 2024-09-11T14:20:06.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f748c8eb640 1 -- 172.21.15.46:0/4254731678 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f747800e4d0 con 0x7f7488133a30 2024-09-11T14:20:06.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f27b559a640 1 -- 172.21.15.46:0/2451884717 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27ac00e4d0 con 0x7f27b8138720 2024-09-11T14:20:06.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f4d7492b640 1 -- 172.21.15.46:0/1177901782 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d6c009e50 con 0x7f4d700717b0 2024-09-11T14:20:06.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f4d7492b640 1 -- 172.21.15.46:0/1177901782 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d6c00e230 con 0x7f4d700717b0 2024-09-11T14:20:06.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.972+0000 7f4d7492b640 1 -- 172.21.15.46:0/1177901782 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d6c00e4d0 con 0x7f4d700717b0 2024-09-11T14:20:06.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f748fb51640 1 -- 172.21.15.46:0/4254731678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 msgr2=0x7f7488138850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f748fb51640 1 --2- 172.21.15.46:0/4254731678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 0x7f7488138850 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f748fb51640 1 -- 172.21.15.46:0/4254731678 shutdown_connections 2024-09-11T14:20:06.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f748fb51640 1 --2- 172.21.15.46:0/4254731678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 0x7f7488138850 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27232fd640 1 -- 172.21.15.46:0/1152156177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c132520 msgr2=0x7f271c132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f748fb51640 1 -- 172.21.15.46:0/4254731678 >> 172.21.15.46:0/4254731678 conn(0x7f74880a0de0 msgr2=0x7f74880a11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27bcad1640 1 -- 172.21.15.46:0/2451884717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8138720 msgr2=0x7f27b813ab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27bcad1640 1 --2- 172.21.15.46:0/2451884717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8138720 0x7f27b813ab40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f4d77b91640 1 -- 172.21.15.46:0/1177901782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 msgr2=0x7f4d70071bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f4d77b91640 1 --2- 172.21.15.46:0/1177901782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 0x7f4d70071bc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27232fd640 1 --2- 172.21.15.46:0/1152156177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c132520 0x7f271c132930 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27232fd640 1 -- 172.21.15.46:0/1152156177 shutdown_connections 2024-09-11T14:20:06.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27232fd640 1 --2- 172.21.15.46:0/1152156177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c132520 0x7f271c132930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27232fd640 1 -- 172.21.15.46:0/1152156177 >> 172.21.15.46:0/1152156177 conn(0x7f271c06e490 msgr2=0x7f271c06e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:06.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f748fb51640 1 -- 172.21.15.46:0/4254731678 shutdown_connections 2024-09-11T14:20:06.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f748fb51640 1 -- 172.21.15.46:0/4254731678 wait complete. 2024-09-11T14:20:06.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27bcad1640 1 -- 172.21.15.46:0/2451884717 shutdown_connections 2024-09-11T14:20:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f4d77b91640 1 -- 172.21.15.46:0/1177901782 shutdown_connections 2024-09-11T14:20:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f4d77b91640 1 --2- 172.21.15.46:0/1177901782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 0x7f4d70071bc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f4d77b91640 1 -- 172.21.15.46:0/1177901782 >> 172.21.15.46:0/1177901782 conn(0x7f4d700a0320 msgr2=0x7f4d700a0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27bcad1640 1 --2- 172.21.15.46:0/2451884717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8138720 0x7f27b813ab40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27bcad1640 1 -- 172.21.15.46:0/2451884717 >> 172.21.15.46:0/2451884717 conn(0x7f27b806e490 msgr2=0x7f27b806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:06.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27232fd640 1 -- 172.21.15.46:0/1152156177 shutdown_connections 2024-09-11T14:20:06.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f4d77b91640 1 -- 172.21.15.46:0/1177901782 shutdown_connections 2024-09-11T14:20:06.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27bcad1640 1 -- 172.21.15.46:0/2451884717 shutdown_connections 2024-09-11T14:20:06.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f4d77b91640 1 -- 172.21.15.46:0/1177901782 wait complete. 2024-09-11T14:20:06.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27bcad1640 1 -- 172.21.15.46:0/2451884717 wait complete. 2024-09-11T14:20:06.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.974+0000 7f748fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.974+0000 7f4d77b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.974+0000 7f27bcad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.973+0000 7f27232fd640 1 -- 172.21.15.46:0/1152156177 wait complete. 2024-09-11T14:20:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.974+0000 7f27232fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.975+0000 7f748fb51640 1 Processor -- start 2024-09-11T14:20:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.975+0000 7f27232fd640 1 Processor -- start 2024-09-11T14:20:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.975+0000 7f748fb51640 1 -- start start 2024-09-11T14:20:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.975+0000 7f27232fd640 1 -- start start 2024-09-11T14:20:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.976+0000 7f4d77b91640 1 Processor -- start 2024-09-11T14:20:06.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.976+0000 7f4d77b91640 1 -- start start 2024-09-11T14:20:06.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.976+0000 7f27bcad1640 1 Processor -- start 2024-09-11T14:20:06.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.976+0000 7f27bcad1640 1 -- start start 2024-09-11T14:20:06.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f748fb51640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 0x7f7488130380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f748fb51640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f748812e330 con 0x7f7488133a30 2024-09-11T14:20:06.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f27232fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c0a3450 0x7f271c11e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f27232fd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f271c120cf0 con 0x7f271c0a3450 2024-09-11T14:20:06.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f4d77b91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 0x7f4d7011dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f748d8ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 0x7f7488130380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f748d8ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 0x7f7488130380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40918/0 (socket says 172.21.15.46:40918) 2024-09-11T14:20:06.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f748d8ed640 1 -- 172.21.15.46:0/1060486111 learned_addr learned my addr 172.21.15.46:0/1060486111 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:06.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f4d77b91640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7011ef10 con 0x7f4d700717b0 2024-09-11T14:20:06.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f4d7592d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 0x7f4d7011dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f4d7592d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 0x7f4d7011dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40934/0 (socket says 172.21.15.46:40934) 2024-09-11T14:20:06.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f4d7592d640 1 -- 172.21.15.46:0/457363636 learned_addr learned my addr 172.21.15.46:0/457363636 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:06.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f2721099640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c0a3450 0x7f271c11e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f2721099640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c0a3450 0x7f271c11e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40936/0 (socket says 172.21.15.46:40936) 2024-09-11T14:20:06.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f2721099640 1 -- 172.21.15.46:0/3833321685 learned_addr learned my addr 172.21.15.46:0/3833321685 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:06.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.977+0000 7f27bcad1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8132520 0x7f27b8130cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:06.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f27bcad1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f27b80a0800 con 0x7f27b8132520 2024-09-11T14:20:06.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f4d7592d640 1 -- 172.21.15.46:0/457363636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d70121bb0 con 0x7f4d700717b0 2024-09-11T14:20:06.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f2721099640 1 -- 172.21.15.46:0/3833321685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c132020 con 0x7f271c0a3450 2024-09-11T14:20:06.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f4d7592d640 1 --2- 172.21.15.46:0/457363636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 0x7f4d7011dbd0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f2721099640 1 --2- 172.21.15.46:0/3833321685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c0a3450 0x7f271c11e090 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f27b659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8132520 0x7f27b8130cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:06.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f27b659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8132520 0x7f27b8130cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40946/0 (socket says 172.21.15.46:40946) 2024-09-11T14:20:06.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f4d667fc640 1 -- 172.21.15.46:0/457363636 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d6c015550 con 0x7f4d700717b0 2024-09-11T14:20:06.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f748d8ed640 1 -- 172.21.15.46:0/1060486111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7488073900 con 0x7f7488133a30 2024-09-11T14:20:06.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f4d667fc640 1 -- 172.21.15.46:0/457363636 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d6c0156b0 con 0x7f4d700717b0 2024-09-11T14:20:06.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7011f650 con 0x7f4d700717b0 2024-09-11T14:20:06.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f27b659c640 1 -- 172.21.15.46:0/3283546070 learned_addr learned my addr 172.21.15.46:0/3283546070 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:06.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f4d667fc640 1 -- 172.21.15.46:0/457363636 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d6c015950 con 0x7f4d700717b0 2024-09-11T14:20:06.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d70130db0 con 0x7f4d700717b0 2024-09-11T14:20:06.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f748d8ed640 1 --2- 172.21.15.46:0/1060486111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 0x7f7488130380 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f2711ffb640 1 -- 172.21.15.46:0/3833321685 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f271800edd0 con 0x7f271c0a3450 2024-09-11T14:20:06.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.978+0000 7f27232fd640 1 -- 172.21.15.46:0/3833321685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c120f60 con 0x7f271c0a3450 2024-09-11T14:20:06.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.979+0000 7f27b659c640 1 -- 172.21.15.46:0/3283546070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b80a0ea0 con 0x7f27b8132520 2024-09-11T14:20:06.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.979+0000 7f27232fd640 1 -- 172.21.15.46:0/3833321685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c0a1130 con 0x7f271c0a3450 2024-09-11T14:20:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.979+0000 7f27b659c640 1 --2- 172.21.15.46:0/3283546070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8132520 0x7f27b8130cf0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.979+0000 7f2711ffb640 1 -- 172.21.15.46:0/3833321685 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2718015420 con 0x7f271c0a3450 2024-09-11T14:20:06.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.979+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4d7006fb30 con 0x7f4d700717b0 2024-09-11T14:20:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f747e7fc640 1 -- 172.21.15.46:0/1060486111 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7484005a60 con 0x7f7488133a30 2024-09-11T14:20:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f748fb51640 1 -- 172.21.15.46:0/1060486111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7488130070 con 0x7f7488133a30 2024-09-11T14:20:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f748fb51640 1 -- 172.21.15.46:0/1060486111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748812fe20 con 0x7f7488133a30 2024-09-11T14:20:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f4d667fc640 1 -- 172.21.15.46:0/457363636 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4d6c015b50 con 0x7f4d700717b0 2024-09-11T14:20:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f2711ffb640 1 -- 172.21.15.46:0/3833321685 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27180156c0 con 0x7f271c0a3450 2024-09-11T14:20:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f27a6ffd640 1 -- 172.21.15.46:0/3283546070 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27a8005a60 con 0x7f27b8132520 2024-09-11T14:20:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f27232fd640 1 -- 172.21.15.46:0/3833321685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26fc000f80 con 0x7f271c0a3450 2024-09-11T14:20:07.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f27a6ffd640 1 -- 172.21.15.46:0/3283546070 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f27a8005bc0 con 0x7f27b8132520 2024-09-11T14:20:07.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f747e7fc640 1 -- 172.21.15.46:0/1060486111 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7484005bc0 con 0x7f7488133a30 2024-09-11T14:20:07.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f747e7fc640 1 -- 172.21.15.46:0/1060486111 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7484005a60 con 0x7f7488133a30 2024-09-11T14:20:07.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f2711ffb640 1 -- 172.21.15.46:0/3833321685 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2718015870 con 0x7f271c0a3450 2024-09-11T14:20:07.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f4d667fc640 1 --2- 172.21.15.46:0/457363636 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4d5403e8e0 0x7f4d54040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.980+0000 7f4d667fc640 1 -- 172.21.15.46:0/457363636 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f4d6c051130 con 0x7f4d700717b0 2024-09-11T14:20:07.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f4d667fc640 1 --2- 172.21.15.46:0/457363636 >> v2:172.21.15.47:6805/1666238977 conn(0x7f4d540438e0 0x7f4d54045db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f4d667fc640 1 -- 172.21.15.46:0/457363636 --> v2:172.21.15.47:6805/1666238977 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d54046440 con 0x7f4d540438e0 2024-09-11T14:20:07.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f4d667fc640 1 -- 172.21.15.46:0/457363636 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f4d6c0535e0 con 0x7f4d700717b0 2024-09-11T14:20:07.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f746bfff640 1 -- 172.21.15.46:0/1060486111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7488068fa0 con 0x7f7488133a30 2024-09-11T14:20:07.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f27a6ffd640 1 -- 172.21.15.46:0/3283546070 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27a8005e60 con 0x7f27b8132520 2024-09-11T14:20:07.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b80a1110 con 0x7f27b8132520 2024-09-11T14:20:07.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b8120cb0 con 0x7f27b8132520 2024-09-11T14:20:07.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f4d7512c640 1 --2- 172.21.15.46:0/457363636 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4d5403e8e0 0x7f4d54040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f2711ffb640 1 --2- 172.21.15.46:0/3833321685 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f270003e8a0 0x7f2700040db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f2711ffb640 1 -- 172.21.15.46:0/3833321685 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f2718050c00 con 0x7f271c0a3450 2024-09-11T14:20:07.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f2711ffb640 1 --2- 172.21.15.46:0/3833321685 >> v2:172.21.15.46:6805/1751227380 conn(0x7f2700043730 0x7f2700045c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f2720898640 1 --2- 172.21.15.46:0/3833321685 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f270003e8a0 0x7f2700040db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.982+0000 7f4d7612e640 1 --2- 172.21.15.46:0/457363636 >> v2:172.21.15.47:6805/1666238977 conn(0x7f4d540438e0 0x7f4d54045db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:20:07.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.982+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27b809c830 con 0x7f27b8132520 2024-09-11T14:20:07.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.982+0000 7f4d7512c640 1 --2- 172.21.15.46:0/457363636 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4d5403e8e0 0x7f4d54040df0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f2711ffb640 1 -- 172.21.15.46:0/3833321685 --> v2:172.21.15.46:6805/1751227380 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2700046290 con 0x7f2700043730 2024-09-11T14:20:07.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.981+0000 7f2711ffb640 1 -- 172.21.15.46:0/3833321685 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f271800f2a0 con 0x7f271c0a3450 2024-09-11T14:20:07.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.982+0000 7f747e7fc640 1 -- 172.21.15.46:0/1060486111 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7484005d30 con 0x7f7488133a30 2024-09-11T14:20:07.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.983+0000 7f272189a640 1 --2- 172.21.15.46:0/3833321685 >> v2:172.21.15.46:6805/1751227380 conn(0x7f2700043730 0x7f2700045c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:20:07.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.983+0000 7f2720898640 1 --2- 172.21.15.46:0/3833321685 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f270003e8a0 0x7f2700040db0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.983+0000 7f747e7fc640 1 --2- 172.21.15.46:0/1060486111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f746c03e960 0x7f746c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.983+0000 7f27a6ffd640 1 -- 172.21.15.46:0/3283546070 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f27a800c7f0 con 0x7f27b8132520 2024-09-11T14:20:07.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.983+0000 7f747e7fc640 1 -- 172.21.15.46:0/1060486111 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f748404f3f0 con 0x7f7488133a30 2024-09-11T14:20:07.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.983+0000 7f747e7fc640 1 --2- 172.21.15.46:0/1060486111 >> v2:172.21.15.46:6801/1724049974 conn(0x7f746c043960 0x7f746c045e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.983+0000 7f747e7fc640 1 -- 172.21.15.46:0/1060486111 --> v2:172.21.15.46:6801/1724049974 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f746c0464c0 con 0x7f746c043960 2024-09-11T14:20:07.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.983+0000 7f747e7fc640 1 -- 172.21.15.46:0/1060486111 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f7484005a60 con 0x7f7488133a30 2024-09-11T14:20:07.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.984+0000 7f27a6ffd640 1 --2- 172.21.15.46:0/3283546070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f279803e980 0x7f2798040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.984+0000 7f27a6ffd640 1 -- 172.21.15.46:0/3283546070 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f27a804f710 con 0x7f27b8132520 2024-09-11T14:20:07.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.984+0000 7f27a6ffd640 1 --2- 172.21.15.46:0/3283546070 >> v2:172.21.15.47:6803/3757354244 conn(0x7f2798043980 0x7f2798045e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.984+0000 7f27a6ffd640 1 -- 172.21.15.46:0/3283546070 --> v2:172.21.15.47:6803/3757354244 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27980464e0 con 0x7f2798043980 2024-09-11T14:20:07.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.983+0000 7f748d0ec640 1 --2- 172.21.15.46:0/1060486111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f746c03e960 0x7f746c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.984+0000 7f748d0ec640 1 --2- 172.21.15.46:0/1060486111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f746c03e960 0x7f746c040e70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.984+0000 7f27a6ffd640 1 -- 172.21.15.46:0/3283546070 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f27a804fa70 con 0x7f27b8132520 2024-09-11T14:20:07.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.984+0000 7f27b5d9b640 1 --2- 172.21.15.46:0/3283546070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f279803e980 0x7f2798040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.985+0000 7f27b5d9b640 1 --2- 172.21.15.46:0/3283546070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f279803e980 0x7f2798040e90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.985+0000 7f748e0ee640 1 --2- 172.21.15.46:0/1060486111 >> v2:172.21.15.46:6801/1724049974 conn(0x7f746c043960 0x7f746c045e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:20:07.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.985+0000 7f27b6d9d640 1 --2- 172.21.15.46:0/3283546070 >> v2:172.21.15.47:6803/3757354244 conn(0x7f2798043980 0x7f2798045e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:20:07.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.986+0000 7f4d7612e640 1 --2- 172.21.15.46:0/457363636 >> v2:172.21.15.47:6805/1666238977 conn(0x7f4d540438e0 0x7f4d54045db0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.987+0000 7f272189a640 1 --2- 172.21.15.46:0/3833321685 >> v2:172.21.15.46:6805/1751227380 conn(0x7f2700043730 0x7f2700045c00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.988+0000 7f4d667fc640 1 -- 172.21.15.46:0/457363636 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f4d54046440 con 0x7f4d540438e0 2024-09-11T14:20:07.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.989+0000 7f748e0ee640 1 --2- 172.21.15.46:0/1060486111 >> v2:172.21.15.46:6801/1724049974 conn(0x7f746c043960 0x7f746c045e30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.990+0000 7f2711ffb640 1 -- 172.21.15.46:0/3833321685 <== osd.1 v2:172.21.15.46:6805/1751227380 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f2700046290 con 0x7f2700043730 2024-09-11T14:20:07.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.990+0000 7f27b6d9d640 1 --2- 172.21.15.46:0/3283546070 >> v2:172.21.15.47:6803/3757354244 conn(0x7f2798043980 0x7f2798045e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.991+0000 7f747e7fc640 1 -- 172.21.15.46:0/1060486111 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f746c0464c0 con 0x7f746c043960 2024-09-11T14:20:07.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.992+0000 7f27a6ffd640 1 -- 172.21.15.46:0/3283546070 <== osd.2 v2:172.21.15.47:6803/3757354244 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f27980464e0 con 0x7f2798043980 2024-09-11T14:20:07.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.994+0000 7f27232fd640 1 -- 172.21.15.46:0/3833321685 --> v2:172.21.15.46:6805/1751227380 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f26fc002c30 con 0x7f2700043730 2024-09-11T14:20:07.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.994+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 --> v2:172.21.15.47:6805/1666238977 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4d70073c10 con 0x7f4d540438e0 2024-09-11T14:20:07.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.995+0000 7f746bfff640 1 -- 172.21.15.46:0/1060486111 --> v2:172.21.15.46:6801/1724049974 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f748812dea0 con 0x7f746c043960 2024-09-11T14:20:07.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.995+0000 7f2711ffb640 1 -- 172.21.15.46:0/3833321685 <== osd.1 v2:172.21.15.46:6805/1751227380 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f26fc002c30 con 0x7f2700043730 2024-09-11T14:20:07.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.996+0000 7f4d667fc640 1 -- 172.21.15.46:0/457363636 <== osd.3 v2:172.21.15.47:6805/1666238977 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4d6800a820 con 0x7f4d540438e0 2024-09-11T14:20:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.996+0000 7f27077fe640 1 -- 172.21.15.46:0/3833321685 >> v2:172.21.15.46:6805/1751227380 conn(0x7f2700043730 msgr2=0x7f2700045c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.996+0000 7f27077fe640 1 --2- 172.21.15.46:0/3833321685 >> v2:172.21.15.46:6805/1751227380 conn(0x7f2700043730 0x7f2700045c00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.996+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 >> v2:172.21.15.47:6805/1666238977 conn(0x7f4d540438e0 msgr2=0x7f4d54045db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.996+0000 7f4d77b91640 1 --2- 172.21.15.46:0/457363636 >> v2:172.21.15.47:6805/1666238977 conn(0x7f4d540438e0 0x7f4d54045db0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.996+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4d5403e8e0 msgr2=0x7f4d54040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.996+0000 7f4d77b91640 1 --2- 172.21.15.46:0/457363636 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4d5403e8e0 0x7f4d54040df0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.996+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 msgr2=0x7f4d7011dbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.996+0000 7f4d77b91640 1 --2- 172.21.15.46:0/457363636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 0x7f4d7011dbd0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f27077fe640 1 -- 172.21.15.46:0/3833321685 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f270003e8a0 msgr2=0x7f2700040db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f27077fe640 1 --2- 172.21.15.46:0/3833321685 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f270003e8a0 0x7f2700040db0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 shutdown_connections 2024-09-11T14:20:07.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f4d77b91640 1 --2- 172.21.15.46:0/457363636 >> v2:172.21.15.47:6805/1666238977 conn(0x7f4d540438e0 0x7f4d54045db0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f27077fe640 1 -- 172.21.15.46:0/3833321685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c0a3450 msgr2=0x7f271c11e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f27077fe640 1 --2- 172.21.15.46:0/3833321685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c0a3450 0x7f271c11e090 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f4d77b91640 1 --2- 172.21.15.46:0/457363636 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4d5403e8e0 0x7f4d54040df0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f4d77b91640 1 --2- 172.21.15.46:0/457363636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d700717b0 0x7f4d7011dbd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 >> 172.21.15.46:0/457363636 conn(0x7f4d700a0320 msgr2=0x7f4d70133270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 shutdown_connections 2024-09-11T14:20:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f27077fe640 1 -- 172.21.15.46:0/3833321685 shutdown_connections 2024-09-11T14:20:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f27077fe640 1 --2- 172.21.15.46:0/3833321685 >> v2:172.21.15.46:6805/1751227380 conn(0x7f2700043730 0x7f2700045c00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f27077fe640 1 --2- 172.21.15.46:0/3833321685 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f270003e8a0 0x7f2700040db0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f27077fe640 1 --2- 172.21.15.46:0/3833321685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f271c0a3450 0x7f271c11e090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f27077fe640 1 -- 172.21.15.46:0/3833321685 >> 172.21.15.46:0/3833321685 conn(0x7f271c06e490 msgr2=0x7f271c135ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.997+0000 7f4d77b91640 1 -- 172.21.15.46:0/457363636 wait complete. 2024-09-11T14:20:07.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.998+0000 7f747e7fc640 1 -- 172.21.15.46:0/1060486111 <== osd.0 v2:172.21.15.46:6801/1724049974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f748812dea0 con 0x7f746c043960 2024-09-11T14:20:07.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.998+0000 7f27077fe640 1 -- 172.21.15.46:0/3833321685 shutdown_connections 2024-09-11T14:20:07.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.998+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 --> v2:172.21.15.47:6803/3757354244 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27b809d380 con 0x7f2798043980 2024-09-11T14:20:07.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.998+0000 7f27077fe640 1 -- 172.21.15.46:0/3833321685 wait complete. 2024-09-11T14:20:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.998+0000 7f746bfff640 1 -- 172.21.15.46:0/1060486111 >> v2:172.21.15.46:6801/1724049974 conn(0x7f746c043960 msgr2=0x7f746c045e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.998+0000 7f746bfff640 1 --2- 172.21.15.46:0/1060486111 >> v2:172.21.15.46:6801/1724049974 conn(0x7f746c043960 0x7f746c045e30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 -- 172.21.15.46:0/1060486111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f746c03e960 msgr2=0x7f746c040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 --2- 172.21.15.46:0/1060486111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f746c03e960 0x7f746c040e70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 -- 172.21.15.46:0/1060486111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 msgr2=0x7f7488130380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 --2- 172.21.15.46:0/1060486111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 0x7f7488130380 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 -- 172.21.15.46:0/1060486111 shutdown_connections 2024-09-11T14:20:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 --2- 172.21.15.46:0/1060486111 >> v2:172.21.15.46:6801/1724049974 conn(0x7f746c043960 0x7f746c045e30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 --2- 172.21.15.46:0/1060486111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f746c03e960 0x7f746c040e70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 --2- 172.21.15.46:0/1060486111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7488133a30 0x7f7488130380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 -- 172.21.15.46:0/1060486111 >> 172.21.15.46:0/1060486111 conn(0x7f74880a0de0 msgr2=0x7f74880a1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 -- 172.21.15.46:0/1060486111 shutdown_connections 2024-09-11T14:20:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:06.999+0000 7f746bfff640 1 -- 172.21.15.46:0/1060486111 wait complete. 2024-09-11T14:20:07.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27a6ffd640 1 -- 172.21.15.46:0/3283546070 <== osd.2 v2:172.21.15.47:6803/3757354244 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f27b000a820 con 0x7f2798043980 2024-09-11T14:20:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 >> v2:172.21.15.47:6803/3757354244 conn(0x7f2798043980 msgr2=0x7f2798045e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 --2- 172.21.15.46:0/3283546070 >> v2:172.21.15.47:6803/3757354244 conn(0x7f2798043980 0x7f2798045e50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f279803e980 msgr2=0x7f2798040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 --2- 172.21.15.46:0/3283546070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f279803e980 0x7f2798040e90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8132520 msgr2=0x7f27b8130cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 --2- 172.21.15.46:0/3283546070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8132520 0x7f27b8130cf0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 shutdown_connections 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 --2- 172.21.15.46:0/3283546070 >> v2:172.21.15.47:6803/3757354244 conn(0x7f2798043980 0x7f2798045e50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 --2- 172.21.15.46:0/3283546070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f279803e980 0x7f2798040e90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 --2- 172.21.15.46:0/3283546070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27b8132520 0x7f27b8130cf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.000+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 >> 172.21.15.46:0/3283546070 conn(0x7f27b806e490 msgr2=0x7f27b80a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.001+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 shutdown_connections 2024-09-11T14:20:07.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.001+0000 7f27bcad1640 1 -- 172.21.15.46:0/3283546070 wait complete. 2024-09-11T14:20:07.025 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2024-09-11T14:20:07.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T14:20:07.026 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2024-09-11T14:20:07.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T14:20:07.027 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2024-09-11T14:20:07.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T14:20:07.028 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2024-09-11T14:20:07.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T14:20:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.184+0000 7f267aefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.184+0000 7f326c263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.184+0000 7f6b57951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.184+0000 7ff1334bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.191+0000 7f267aefd640 1 Processor -- start 2024-09-11T14:20:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.191+0000 7f267aefd640 1 -- start start 2024-09-11T14:20:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.191+0000 7f326c263640 1 Processor -- start 2024-09-11T14:20:07.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.191+0000 7f6b57951640 1 Processor -- start 2024-09-11T14:20:07.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.191+0000 7ff1334bd640 1 Processor -- start 2024-09-11T14:20:07.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.191+0000 7f326c263640 1 -- start start 2024-09-11T14:20:07.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.191+0000 7f6b57951640 1 -- start start 2024-09-11T14:20:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.191+0000 7ff1334bd640 1 -- start start 2024-09-11T14:20:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.192+0000 7f267aefd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2674132520 0x7f2674132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.192+0000 7f267aefd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267406f6d0 con 0x7f26740a3450 2024-09-11T14:20:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.192+0000 7f267aefd640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f267406f3d0 con 0x7f2674132520 2024-09-11T14:20:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f2678c99640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2674132520 0x7f2674132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f2673fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f26740a3450 0x7f26740a3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51134/0 (socket says 172.21.15.46:51134) 2024-09-11T14:20:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f2673fff640 1 -- 172.21.15.46:0/1880232497 learned_addr learned my addr 172.21.15.46:0/1880232497 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f6b57951640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b50132520 0x7f6b50132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7ff1334bd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff12c0717b0 0x7ff12c071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f326c263640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3264138720 0x7f326413ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f6b57951640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b5006f6d0 con 0x7f6b500a3450 2024-09-11T14:20:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f6b57951640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5006f3d0 con 0x7f6b50132520 2024-09-11T14:20:07.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f3269fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3264132520 0x7f3264132930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51150/0 (socket says 172.21.15.46:51150) 2024-09-11T14:20:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f3269fff640 1 -- 172.21.15.46:0/1784787812 learned_addr learned my addr 172.21.15.46:0/1784787812 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7ff1334bd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12c072860 con 0x7ff12c072100 2024-09-11T14:20:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7ff1334bd640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ff12c0a1f50 con 0x7ff12c0717b0 2024-09-11T14:20:07.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f326c263640 1 -- 172.21.15.46:0/1784787812 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3264133040 con 0x7f3264132520 2024-09-11T14:20:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f326c263640 1 -- 172.21.15.46:0/1784787812 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f326406f6d0 con 0x7f3264138720 2024-09-11T14:20:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f26737fe640 1 -- 172.21.15.46:0/1880232497 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560993340 0 0) 0x7f267406f6d0 con 0x7f26740a3450 2024-09-11T14:20:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f2678c99640 1 -- 172.21.15.46:0/1880232497 >> v1:172.21.15.46:6789/0 conn(0x7f26740a3450 legacy=0x7f26740a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f2678c99640 1 -- 172.21.15.46:0/1880232497 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267406f0c0 con 0x7f2674132520 2024-09-11T14:20:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7ff131259640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff12c0717b0 0x7ff12c071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f6b556ed640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b50132520 0x7f6b50132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7ff131259640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff12c0717b0 0x7ff12c071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40986/0 (socket says 172.21.15.46:40986) 2024-09-11T14:20:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7ff131259640 1 -- 172.21.15.46:0/4236170310 learned_addr learned my addr 172.21.15.46:0/4236170310 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f6b556ed640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b50132520 0x7f6b50132930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40970/0 (socket says 172.21.15.46:40970) 2024-09-11T14:20:07.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f6b556ed640 1 -- 172.21.15.46:0/887018851 learned_addr learned my addr 172.21.15.46:0/887018851 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f2678c99640 1 --2- 172.21.15.46:0/1880232497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2674132520 0x7f2674132930 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460969498f9a5a2f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7ff131259640 1 -- 172.21.15.46:0/4236170310 >> v1:172.21.15.46:6789/0 conn(0x7ff12c072100 legacy=0x7ff12c130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T14:20:07.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.193+0000 7f32697fe640 1 --2- 172.21.15.46:0/1784787812 >> v2:172.21.15.46:3300/0 conn(0x7f3264138720 0x7f326413ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7ff131259640 1 -- 172.21.15.46:0/4236170310 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c074760 con 0x7ff12c0717b0 2024-09-11T14:20:07.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f6b556ed640 1 -- 172.21.15.46:0/887018851 >> v1:172.21.15.46:6789/0 conn(0x7f6b500a3450 legacy=0x7f6b500a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f6b556ed640 1 -- 172.21.15.46:0/887018851 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5006f0c0 con 0x7f6b50132520 2024-09-11T14:20:07.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7ff131259640 1 --2- 172.21.15.46:0/4236170310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 0x7ff12c071bc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53eb8444c6c4e7a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463416810 0 0) 0x7f3260001110 con 0x7f3264132520 2024-09-11T14:20:07.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3250003580 con 0x7f3264132520 2024-09-11T14:20:07.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f26737fe640 1 -- 172.21.15.46:0/1880232497 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2668009d90 con 0x7f2674132520 2024-09-11T14:20:07.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f26737fe640 1 -- 172.21.15.46:0/1880232497 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f266800e230 con 0x7f2674132520 2024-09-11T14:20:07.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f26737fe640 1 -- 172.21.15.46:0/1880232497 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f266800e4d0 con 0x7f2674132520 2024-09-11T14:20:07.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f6b556ed640 1 --2- 172.21.15.46:0/887018851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b50132520 0x7f6b50132930 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7c080591f68ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2222959208 0 0) 0x7f3250003580 con 0x7f3264132520 2024-09-11T14:20:07.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 >> v2:172.21.15.46:3300/0 conn(0x7f3264138720 msgr2=0x7f326413ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T14:20:07.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f3268ffd640 1 --2- 172.21.15.46:0/1784787812 >> v2:172.21.15.46:3300/0 conn(0x7f3264138720 0x7f326413ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7ff123fff640 1 -- 172.21.15.46:0/4236170310 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff128009db0 con 0x7ff12c0717b0 2024-09-11T14:20:07.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7ff123fff640 1 -- 172.21.15.46:0/4236170310 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff12800e230 con 0x7ff12c0717b0 2024-09-11T14:20:07.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326406f3d0 con 0x7f3264132520 2024-09-11T14:20:07.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.194+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1731803599 0 0) 0x7f32600017b0 con 0x7f3264132520 2024-09-11T14:20:07.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 >> v1:172.21.15.46:6789/0 conn(0x7f3264132520 legacy=0x7f3264132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7ff123fff640 1 -- 172.21.15.46:0/4236170310 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff12800e4d0 con 0x7ff12c0717b0 2024-09-11T14:20:07.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f3268ffd640 1 --2- 172.21.15.46:0/1784787812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f3250003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f326406f6d0 con 0x7f3250003a70 2024-09-11T14:20:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f6b47fff640 1 -- 172.21.15.46:0/887018851 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b4c009e50 con 0x7f6b50132520 2024-09-11T14:20:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f6b47fff640 1 -- 172.21.15.46:0/887018851 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6b4c00e230 con 0x7f6b50132520 2024-09-11T14:20:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f6b47fff640 1 -- 172.21.15.46:0/887018851 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b4c00e4d0 con 0x7f6b50132520 2024-09-11T14:20:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f3269fff640 1 --2- 172.21.15.46:0/1784787812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f3250003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f267aefd640 1 -- 172.21.15.46:0/1880232497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2674132520 msgr2=0x7f2674132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f267aefd640 1 --2- 172.21.15.46:0/1880232497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2674132520 0x7f2674132930 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f3269fff640 1 -- 172.21.15.46:0/1784787812 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3250003580 con 0x7f3250003a70 2024-09-11T14:20:07.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f267aefd640 1 -- 172.21.15.46:0/1880232497 shutdown_connections 2024-09-11T14:20:07.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f267aefd640 1 --2- 172.21.15.46:0/1880232497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2674132520 0x7f2674132930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f267aefd640 1 -- 172.21.15.46:0/1880232497 >> 172.21.15.46:0/1880232497 conn(0x7f267406e490 msgr2=0x7f267406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f267aefd640 1 -- 172.21.15.46:0/1880232497 shutdown_connections 2024-09-11T14:20:07.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f3269fff640 1 --2- 172.21.15.46:0/1784787812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f3250003ea0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fe45fd2f545ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7f267aefd640 1 -- 172.21.15.46:0/1880232497 wait complete. 2024-09-11T14:20:07.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7ff1334bd640 1 -- 172.21.15.46:0/4236170310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 msgr2=0x7ff12c071bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.195+0000 7ff1334bd640 1 --2- 172.21.15.46:0/4236170310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 0x7ff12c071bc0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3260004c90 con 0x7f3250003a70 2024-09-11T14:20:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7ff1334bd640 1 -- 172.21.15.46:0/4236170310 shutdown_connections 2024-09-11T14:20:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7ff1334bd640 1 --2- 172.21.15.46:0/4236170310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 0x7ff12c071bc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7ff1334bd640 1 -- 172.21.15.46:0/4236170310 >> 172.21.15.46:0/4236170310 conn(0x7ff12c0a0320 msgr2=0x7ff12c0a0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3260005930 con 0x7f3250003a70 2024-09-11T14:20:07.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f3268ffd640 1 -- 172.21.15.46:0/1784787812 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3260005bd0 con 0x7f3250003a70 2024-09-11T14:20:07.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7ff1334bd640 1 -- 172.21.15.46:0/4236170310 shutdown_connections 2024-09-11T14:20:07.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7ff1334bd640 1 -- 172.21.15.46:0/4236170310 wait complete. 2024-09-11T14:20:07.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f267aefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f6b57951640 1 -- 172.21.15.46:0/887018851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b50132520 msgr2=0x7f6b50132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f6b57951640 1 --2- 172.21.15.46:0/887018851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b50132520 0x7f6b50132930 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f6b57951640 1 -- 172.21.15.46:0/887018851 shutdown_connections 2024-09-11T14:20:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f6b57951640 1 --2- 172.21.15.46:0/887018851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b50132520 0x7f6b50132930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f6b57951640 1 -- 172.21.15.46:0/887018851 >> 172.21.15.46:0/887018851 conn(0x7f6b5006e490 msgr2=0x7f6b5006e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7ff1334bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f6b57951640 1 -- 172.21.15.46:0/887018851 shutdown_connections 2024-09-11T14:20:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f6b57951640 1 -- 172.21.15.46:0/887018851 wait complete. 2024-09-11T14:20:07.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.196+0000 7f6b57951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.197+0000 7f326c263640 1 -- 172.21.15.46:0/1784787812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 msgr2=0x7f3250003ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.197+0000 7f326c263640 1 --2- 172.21.15.46:0/1784787812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f3250003ea0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.197+0000 7f326c263640 1 -- 172.21.15.46:0/1784787812 shutdown_connections 2024-09-11T14:20:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.197+0000 7f326c263640 1 --2- 172.21.15.46:0/1784787812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f3250003ea0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.197+0000 7f326c263640 1 --2- 172.21.15.46:0/1784787812 >> v2:172.21.15.46:3300/0 conn(0x7f3264138720 0x7f326413ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.197+0000 7f326c263640 1 -- 172.21.15.46:0/1784787812 >> 172.21.15.46:0/1784787812 conn(0x7f326406e490 msgr2=0x7f326406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.197+0000 7f326c263640 1 -- 172.21.15.46:0/1784787812 shutdown_connections 2024-09-11T14:20:07.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.197+0000 7f326c263640 1 -- 172.21.15.46:0/1784787812 wait complete. 2024-09-11T14:20:07.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.197+0000 7f326c263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.198+0000 7f6b57951640 1 Processor -- start 2024-09-11T14:20:07.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.198+0000 7f6b57951640 1 -- start start 2024-09-11T14:20:07.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.199+0000 7f326c263640 1 Processor -- start 2024-09-11T14:20:07.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.199+0000 7f326c263640 1 -- start start 2024-09-11T14:20:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.199+0000 7f267aefd640 1 Processor -- start 2024-09-11T14:20:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.199+0000 7ff1334bd640 1 Processor -- start 2024-09-11T14:20:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.199+0000 7ff1334bd640 1 -- start start 2024-09-11T14:20:07.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.199+0000 7f267aefd640 1 -- start start 2024-09-11T14:20:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.200+0000 7f6b57951640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b500a3450 0x7f6b5011e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.200+0000 7f6b57951640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50121f40 con 0x7f6b500a3450 2024-09-11T14:20:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.200+0000 7f6b556ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b500a3450 0x7f6b5011e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.200+0000 7f6b556ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b500a3450 0x7f6b5011e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41014/0 (socket says 172.21.15.46:41014) 2024-09-11T14:20:07.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.200+0000 7f6b556ed640 1 -- 172.21.15.46:0/599525059 learned_addr learned my addr 172.21.15.46:0/599525059 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f326c263640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f326411f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f6b556ed640 1 -- 172.21.15.46:0/599525059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b501320a0 con 0x7f6b500a3450 2024-09-11T14:20:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f326c263640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3264122910 con 0x7f3250003a70 2024-09-11T14:20:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f3269fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f326411f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f3269fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f326411f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41016/0 (socket says 172.21.15.46:41016) 2024-09-11T14:20:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f3269fff640 1 -- 172.21.15.46:0/3518604009 learned_addr learned my addr 172.21.15.46:0/3518604009 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f6b556ed640 1 --2- 172.21.15.46:0/599525059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b500a3450 0x7f6b5011e090 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f6b45ffb640 1 -- 172.21.15.46:0/599525059 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b4c00ed20 con 0x7f6b500a3450 2024-09-11T14:20:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f6b45ffb640 1 -- 172.21.15.46:0/599525059 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6b4c00ee80 con 0x7f6b500a3450 2024-09-11T14:20:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f6b45ffb640 1 -- 172.21.15.46:0/599525059 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6b4c015550 con 0x7f6b500a3450 2024-09-11T14:20:07.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b50135960 con 0x7f6b500a3450 2024-09-11T14:20:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f3269fff640 1 -- 172.21.15.46:0/3518604009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326411ee00 con 0x7f3250003a70 2024-09-11T14:20:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f3269fff640 1 --2- 172.21.15.46:0/3518604009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f326411f1a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7ff1334bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 0x7ff12c130ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.201+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b501219f0 con 0x7f6b500a3450 2024-09-11T14:20:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7f267aefd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26740a3450 0x7f267411e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7ff1334bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c11dea0 con 0x7ff12c0717b0 2024-09-11T14:20:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7f267aefd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2674121ed0 con 0x7f26740a3450 2024-09-11T14:20:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7f325a7fc640 1 -- 172.21.15.46:0/3518604009 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3260004b30 con 0x7f3250003a70 2024-09-11T14:20:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7f325a7fc640 1 -- 172.21.15.46:0/3518604009 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3260001640 con 0x7f3250003a70 2024-09-11T14:20:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7f325a7fc640 1 -- 172.21.15.46:0/3518604009 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3260004c90 con 0x7f3250003a70 2024-09-11T14:20:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7ff131259640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 0x7ff12c130ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7ff131259640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 0x7ff12c130ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41020/0 (socket says 172.21.15.46:41020) 2024-09-11T14:20:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7f2678c99640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26740a3450 0x7f267411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7f2678c99640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26740a3450 0x7f267411e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41026/0 (socket says 172.21.15.46:41026) 2024-09-11T14:20:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7f2678c99640 1 -- 172.21.15.46:0/2402566779 learned_addr learned my addr 172.21.15.46:0/2402566779 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7ff131259640 1 -- 172.21.15.46:0/1434198622 learned_addr learned my addr 172.21.15.46:0/1434198622 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3264120bb0 con 0x7f3250003a70 2024-09-11T14:20:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.202+0000 7ff131259640 1 -- 172.21.15.46:0/1434198622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c120b00 con 0x7ff12c0717b0 2024-09-11T14:20:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7ff131259640 1 --2- 172.21.15.46:0/1434198622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 0x7ff12c130ab0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7f2678c99640 1 -- 172.21.15.46:0/2402566779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2674121aa0 con 0x7f26740a3450 2024-09-11T14:20:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7f6b45ffb640 1 -- 172.21.15.46:0/599525059 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6b4c0156b0 con 0x7f6b500a3450 2024-09-11T14:20:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3264121d80 con 0x7f3250003a70 2024-09-11T14:20:07.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b50120a40 con 0x7f6b500a3450 2024-09-11T14:20:07.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7f2678c99640 1 --2- 172.21.15.46:0/2402566779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26740a3450 0x7f267411e090 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7f6b45ffb640 1 --2- 172.21.15.46:0/599525059 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6b3403e980 0x7f6b34040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7f6b45ffb640 1 -- 172.21.15.46:0/599525059 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f6b4c050a40 con 0x7f6b500a3450 2024-09-11T14:20:07.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7ff121ffb640 1 -- 172.21.15.46:0/1434198622 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff12800edf0 con 0x7ff12c0717b0 2024-09-11T14:20:07.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.203+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c11e5a0 con 0x7ff12c0717b0 2024-09-11T14:20:07.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.204+0000 7f26717fa640 1 -- 172.21.15.46:0/2402566779 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2668014540 con 0x7f26740a3450 2024-09-11T14:20:07.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.204+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2674135780 con 0x7f26740a3450 2024-09-11T14:20:07.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.204+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2674121790 con 0x7f26740a3450 2024-09-11T14:20:07.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.204+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c11f3c0 con 0x7ff12c0717b0 2024-09-11T14:20:07.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.204+0000 7f6b54eec640 1 --2- 172.21.15.46:0/599525059 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6b3403e980 0x7f6b34040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.204+0000 7f325a7fc640 1 -- 172.21.15.46:0/3518604009 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3260005160 con 0x7f3250003a70 2024-09-11T14:20:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.204+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f326406a300 con 0x7f3250003a70 2024-09-11T14:20:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.205+0000 7f325a7fc640 1 --2- 172.21.15.46:0/3518604009 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f324803e980 0x7f3248040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.205+0000 7f6b54eec640 1 --2- 172.21.15.46:0/599525059 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6b3403e980 0x7f6b34040e90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.205+0000 7f32697fe640 1 --2- 172.21.15.46:0/3518604009 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f324803e980 0x7f3248040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.205+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267406a300 con 0x7f26740a3450 2024-09-11T14:20:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.205+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12c06a300 con 0x7ff12c0717b0 2024-09-11T14:20:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.205+0000 7f32697fe640 1 --2- 172.21.15.46:0/3518604009 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f324803e980 0x7f3248040e90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.210+0000 7f6b45ffb640 1 -- 172.21.15.46:0/599525059 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6b4c010af0 con 0x7f6b500a3450 2024-09-11T14:20:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.210+0000 7f325a7fc640 1 -- 172.21.15.46:0/3518604009 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f3260011240 con 0x7f3250003a70 2024-09-11T14:20:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.210+0000 7ff121ffb640 1 -- 172.21.15.46:0/1434198622 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff128015420 con 0x7ff12c0717b0 2024-09-11T14:20:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.210+0000 7ff121ffb640 1 -- 172.21.15.46:0/1434198622 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1280156c0 con 0x7ff12c0717b0 2024-09-11T14:20:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.210+0000 7f26717fa640 1 -- 172.21.15.46:0/2402566779 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f26680146a0 con 0x7f26740a3450 2024-09-11T14:20:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.210+0000 7f26717fa640 1 -- 172.21.15.46:0/2402566779 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2668014940 con 0x7f26740a3450 2024-09-11T14:20:07.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.220+0000 7f325a7fc640 1 -- 172.21.15.46:0/3518604009 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f3260018430 con 0x7f3250003a70 2024-09-11T14:20:07.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.222+0000 7ff121ffb640 1 -- 172.21.15.46:0/1434198622 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7ff128015820 con 0x7ff12c0717b0 2024-09-11T14:20:07.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.222+0000 7ff121ffb640 1 --2- 172.21.15.46:0/1434198622 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7ff11003e910 0x7ff110040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.222+0000 7f26717fa640 1 -- 172.21.15.46:0/2402566779 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2668013400 con 0x7f26740a3450 2024-09-11T14:20:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.222+0000 7ff121ffb640 1 -- 172.21.15.46:0/1434198622 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7ff128050e80 con 0x7ff12c0717b0 2024-09-11T14:20:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.222+0000 7f26717fa640 1 --2- 172.21.15.46:0/2402566779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f265803e930 0x7f2658040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.222+0000 7f26717fa640 1 -- 172.21.15.46:0/2402566779 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f2668019040 con 0x7f26740a3450 2024-09-11T14:20:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.222+0000 7ff130a58640 1 --2- 172.21.15.46:0/1434198622 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7ff11003e910 0x7ff110040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.223+0000 7f2673fff640 1 --2- 172.21.15.46:0/2402566779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f265803e930 0x7f2658040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.223+0000 7ff130a58640 1 --2- 172.21.15.46:0/1434198622 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7ff11003e910 0x7ff110040e20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.223+0000 7f2673fff640 1 --2- 172.21.15.46:0/2402566779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f265803e930 0x7f2658040e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.232+0000 7ff121ffb640 1 -- 172.21.15.46:0/1434198622 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7ff128011c30 con 0x7ff12c0717b0 2024-09-11T14:20:07.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.242+0000 7f26717fa640 1 -- 172.21.15.46:0/2402566779 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f2668018970 con 0x7f26740a3450 2024-09-11T14:20:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.413+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6b5006a300 con 0x7f6b500a3450 2024-09-11T14:20:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.413+0000 7f6b45ffb640 1 -- 172.21.15.46:0/599525059 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f6b4c010310 con 0x7f6b500a3450 2024-09-11T14:20:07.415 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2024-09-11T14:20:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6b3403e980 msgr2=0x7f6b34040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 --2- 172.21.15.46:0/599525059 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6b3403e980 0x7f6b34040e90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b500a3450 msgr2=0x7f6b5011e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 --2- 172.21.15.46:0/599525059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b500a3450 0x7f6b5011e090 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 shutdown_connections 2024-09-11T14:20:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 --2- 172.21.15.46:0/599525059 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6b3403e980 0x7f6b34040e90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 --2- 172.21.15.46:0/599525059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b500a3450 0x7f6b5011e090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 >> 172.21.15.46:0/599525059 conn(0x7f6b5006e490 msgr2=0x7f6b501bd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 shutdown_connections 2024-09-11T14:20:07.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.417+0000 7f6b57951640 1 -- 172.21.15.46:0/599525059 wait complete. 2024-09-11T14:20:07.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.420+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff12c071bc0 con 0x7ff12c0717b0 2024-09-11T14:20:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.420+0000 7ff121ffb640 1 -- 172.21.15.46:0/1434198622 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7ff128010310 con 0x7ff12c0717b0 2024-09-11T14:20:07.422 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7ff11003e910 msgr2=0x7ff110040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 --2- 172.21.15.46:0/1434198622 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7ff11003e910 0x7ff110040e20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 msgr2=0x7ff12c130ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 --2- 172.21.15.46:0/1434198622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 0x7ff12c130ab0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 shutdown_connections 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 --2- 172.21.15.46:0/1434198622 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7ff11003e910 0x7ff110040e20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 --2- 172.21.15.46:0/1434198622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff12c0717b0 0x7ff12c130ab0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 >> 172.21.15.46:0/1434198622 conn(0x7ff12c0a0320 msgr2=0x7ff12c0a36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 shutdown_connections 2024-09-11T14:20:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.423+0000 7ff1334bd640 1 -- 172.21.15.46:0/1434198622 wait complete. 2024-09-11T14:20:07.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-09-11T14:20:07.435 DEBUG:teuthology.parallel:result is None 2024-09-11T14:20:07.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2024-09-11T14:20:07.436 DEBUG:teuthology.parallel:result is None 2024-09-11T14:20:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.439+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3264133040 con 0x7f3250003a70 2024-09-11T14:20:07.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.440+0000 7f325a7fc640 1 -- 172.21.15.46:0/3518604009 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f3264133040 con 0x7f3250003a70 2024-09-11T14:20:07.441 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2024-09-11T14:20:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f324803e980 msgr2=0x7f3248040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 --2- 172.21.15.46:0/3518604009 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f324803e980 0x7f3248040e90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 msgr2=0x7f326411f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 --2- 172.21.15.46:0/3518604009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f326411f1a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 shutdown_connections 2024-09-11T14:20:07.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 --2- 172.21.15.46:0/3518604009 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f324803e980 0x7f3248040e90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 --2- 172.21.15.46:0/3518604009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3250003a70 0x7f326411f1a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 >> 172.21.15.46:0/3518604009 conn(0x7f326406e490 msgr2=0x7f32640a6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 shutdown_connections 2024-09-11T14:20:07.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.442+0000 7f326c263640 1 -- 172.21.15.46:0/3518604009 wait complete. 2024-09-11T14:20:07.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2024-09-11T14:20:07.455 DEBUG:teuthology.parallel:result is None 2024-09-11T14:20:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.453+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2674120120 con 0x7f26740a3450 2024-09-11T14:20:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.454+0000 7f26717fa640 1 -- 172.21.15.46:0/2402566779 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f2668018190 con 0x7f26740a3450 2024-09-11T14:20:07.455 INFO:teuthology.orchestra.run.smithi046.stdout:38654705672 2024-09-11T14:20:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.456+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f265803e930 msgr2=0x7f2658040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.456+0000 7f267aefd640 1 --2- 172.21.15.46:0/2402566779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f265803e930 0x7f2658040e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.456+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26740a3450 msgr2=0x7f267411e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.456+0000 7f267aefd640 1 --2- 172.21.15.46:0/2402566779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26740a3450 0x7f267411e090 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.456+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 shutdown_connections 2024-09-11T14:20:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.456+0000 7f267aefd640 1 --2- 172.21.15.46:0/2402566779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f265803e930 0x7f2658040e40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.456+0000 7f267aefd640 1 --2- 172.21.15.46:0/2402566779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26740a3450 0x7f267411e090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.456+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 >> 172.21.15.46:0/2402566779 conn(0x7f267406e490 msgr2=0x7f26740a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.457+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 shutdown_connections 2024-09-11T14:20:07.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.457+0000 7f267aefd640 1 -- 172.21.15.46:0/2402566779 wait complete. 2024-09-11T14:20:07.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.3 2024-09-11T14:20:07.469 DEBUG:teuthology.parallel:result is None 2024-09-11T14:20:07.469 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:20:07.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:20:07.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.617+0000 7fdc40d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.622+0000 7fdc40d51640 1 Processor -- start 2024-09-11T14:20:07.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.622+0000 7fdc40d51640 1 -- start start 2024-09-11T14:20:07.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.624+0000 7fdc40d51640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc3c130420 0x7fdc3c130830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.624+0000 7fdc40d51640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3c074a00 con 0x7fdc3c133250 2024-09-11T14:20:07.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.624+0000 7fdc40d51640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fdc3c074c30 con 0x7fdc3c130420 2024-09-11T14:20:07.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.624+0000 7fdc3a59c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc3c130420 0x7fdc3c130830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.624+0000 7fdc39d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdc3c133250 0x7fdc3c133660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56994/0 (socket says 172.21.15.46:56994) 2024-09-11T14:20:07.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.624+0000 7fdc39d9b640 1 -- 172.21.15.46:0/476263619 learned_addr learned my addr 172.21.15.46:0/476263619 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:07.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.625+0000 7fdc3a59c640 1 -- 172.21.15.46:0/476263619 >> v1:172.21.15.46:6789/0 conn(0x7fdc3c133250 legacy=0x7fdc3c133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.625+0000 7fdc3a59c640 1 -- 172.21.15.46:0/476263619 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3c071930 con 0x7fdc3c130420 2024-09-11T14:20:07.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.625+0000 7fdc3a59c640 1 --2- 172.21.15.46:0/476263619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 0x7fdc3c130830 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee94ab3a8a9c3545 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.625+0000 7fdc3959a640 1 -- 172.21.15.46:0/476263619 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc34009d90 con 0x7fdc3c130420 2024-09-11T14:20:07.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.625+0000 7fdc3959a640 1 -- 172.21.15.46:0/476263619 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc3400e230 con 0x7fdc3c130420 2024-09-11T14:20:07.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.625+0000 7fdc3959a640 1 -- 172.21.15.46:0/476263619 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc3400e4d0 con 0x7fdc3c130420 2024-09-11T14:20:07.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.626+0000 7fdc40d51640 1 -- 172.21.15.46:0/476263619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 msgr2=0x7fdc3c130830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.626+0000 7fdc40d51640 1 --2- 172.21.15.46:0/476263619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 0x7fdc3c130830 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.626+0000 7fdc40d51640 1 -- 172.21.15.46:0/476263619 shutdown_connections 2024-09-11T14:20:07.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.626+0000 7fdc40d51640 1 --2- 172.21.15.46:0/476263619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 0x7fdc3c130830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.626+0000 7fdc40d51640 1 -- 172.21.15.46:0/476263619 >> 172.21.15.46:0/476263619 conn(0x7fdc3c0a0320 msgr2=0x7fdc3c0a0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.626+0000 7fdc40d51640 1 -- 172.21.15.46:0/476263619 shutdown_connections 2024-09-11T14:20:07.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.626+0000 7fdc40d51640 1 -- 172.21.15.46:0/476263619 wait complete. 2024-09-11T14:20:07.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.626+0000 7fdc40d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.628+0000 7fdc40d51640 1 Processor -- start 2024-09-11T14:20:07.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.628+0000 7fdc40d51640 1 -- start start 2024-09-11T14:20:07.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.629+0000 7fdc40d51640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 0x7fdc3c11f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc40d51640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c120680 con 0x7fdc3c130420 2024-09-11T14:20:07.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc3a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 0x7fdc3c11f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc3a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 0x7fdc3c11f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58120/0 (socket says 172.21.15.46:58120) 2024-09-11T14:20:07.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc3a59c640 1 -- 172.21.15.46:0/3711312012 learned_addr learned my addr 172.21.15.46:0/3711312012 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:07.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc3a59c640 1 -- 172.21.15.46:0/3711312012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3c123160 con 0x7fdc3c130420 2024-09-11T14:20:07.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc3a59c640 1 --2- 172.21.15.46:0/3711312012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 0x7fdc3c11f290 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc32ffd640 1 -- 172.21.15.46:0/3711312012 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc34014540 con 0x7fdc3c130420 2024-09-11T14:20:07.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc32ffd640 1 -- 172.21.15.46:0/3711312012 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc340146a0 con 0x7fdc3c130420 2024-09-11T14:20:07.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc3c122100 con 0x7fdc3c130420 2024-09-11T14:20:07.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc32ffd640 1 -- 172.21.15.46:0/3711312012 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc34014940 con 0x7fdc3c130420 2024-09-11T14:20:07.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.630+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc3c120be0 con 0x7fdc3c130420 2024-09-11T14:20:07.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.631+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc3c06a300 con 0x7fdc3c130420 2024-09-11T14:20:07.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.631+0000 7fdc32ffd640 1 -- 172.21.15.46:0/3711312012 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fdc34014af0 con 0x7fdc3c130420 2024-09-11T14:20:07.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.632+0000 7fdc32ffd640 1 --2- 172.21.15.46:0/3711312012 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fdc1c03e960 0x7fdc1c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.632+0000 7fdc32ffd640 1 -- 172.21.15.46:0/3711312012 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fdc34019040 con 0x7fdc3c130420 2024-09-11T14:20:07.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.632+0000 7fdc39d9b640 1 --2- 172.21.15.46:0/3711312012 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fdc1c03e960 0x7fdc1c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.633+0000 7fdc39d9b640 1 --2- 172.21.15.46:0/3711312012 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fdc1c03e960 0x7fdc1c040e70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.637+0000 7fdc32ffd640 1 -- 172.21.15.46:0/3711312012 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fdc34018790 con 0x7fdc3c130420 2024-09-11T14:20:07.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.819+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc3c0a1f00 con 0x7fdc1c03e960 2024-09-11T14:20:07.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.821+0000 7fdc32ffd640 1 -- 172.21.15.46:0/3711312012 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31201 (crc 0 0 0) 0x7fdc240058d0 con 0x7fdc1c03e960 2024-09-11T14:20:07.823 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:20:07.823 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-11T14:20:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fdc1c03e960 msgr2=0x7fdc1c040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 --2- 172.21.15.46:0/3711312012 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fdc1c03e960 0x7fdc1c040e70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 msgr2=0x7fdc3c11f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 --2- 172.21.15.46:0/3711312012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 0x7fdc3c11f290 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 shutdown_connections 2024-09-11T14:20:07.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 --2- 172.21.15.46:0/3711312012 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fdc1c03e960 0x7fdc1c040e70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 --2- 172.21.15.46:0/3711312012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc3c130420 0x7fdc3c11f290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 >> 172.21.15.46:0/3711312012 conn(0x7fdc3c0a0320 msgr2=0x7fdc3c0a4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 shutdown_connections 2024-09-11T14:20:07.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.823+0000 7fdc40d51640 1 -- 172.21.15.46:0/3711312012 wait complete. 2024-09-11T14:20:07.836 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-11T14:20:07.001661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209187248,"statfs":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.437629+0000","last_change":"2024-09-11T14:20:05.441963+0000","last_active":"2024-09-11T14:20:05.437629+0000","last_peered":"2024-09-11T14:20:05.437629+0000","last_clean":"2024-09-11T14:20:05.437629+0000","last_became_active":"2024-09-11T14:20:03.484694+0000","last_became_peered":"2024-09-11T14:20:03.484694+0000","last_unstale":"2024-09-11T14:20:05.437629+0000","last_undegraded":"2024-09-11T14:20:05.437629+0000","last_fullsized":"2024-09-11T14:20:05.437629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.437814+0000","last_change":"2024-09-11T14:20:05.440901+0000","last_active":"2024-09-11T14:20:05.437814+0000","last_peered":"2024-09-11T14:20:05.437814+0000","last_clean":"2024-09-11T14:20:05.437814+0000","last_became_active":"2024-09-11T14:20:03.517121+0000","last_became_peered":"2024-09-11T14:20:03.517121+0000","last_unstale":"2024-09-11T14:20:05.437814+0000","last_undegraded":"2024-09-11T14:20:05.437814+0000","last_fullsized":"2024-09-11T14:20:05.437814+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.433160+0000","last_change":"2024-09-11T14:20:05.436801+0000","last_active":"2024-09-11T14:20:05.433160+0000","last_peered":"2024-09-11T14:20:05.433160+0000","last_clean":"2024-09-11T14:20:05.433160+0000","last_became_active":"2024-09-11T14:20:03.488911+0000","last_became_peered":"2024-09-11T14:20:03.488911+0000","last_unstale":"2024-09-11T14:20:05.433160+0000","last_undegraded":"2024-09-11T14:20:05.433160+0000","last_fullsized":"2024-09-11T14:20:05.433160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.430967+0000","last_change":"2024-09-11T14:20:05.435707+0000","last_active":"2024-09-11T14:20:05.430967+0000","last_peered":"2024-09-11T14:20:05.430967+0000","last_clean":"2024-09-11T14:20:05.430967+0000","last_became_active":"2024-09-11T14:20:03.480359+0000","last_became_peered":"2024-09-11T14:20:03.480359+0000","last_unstale":"2024-09-11T14:20:05.430967+0000","last_undegraded":"2024-09-11T14:20:05.430967+0000","last_fullsized":"2024-09-11T14:20:05.430967+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.443617+0000","last_change":"2024-09-11T14:20:05.443617+0000","last_active":"2024-09-11T14:20:05.443617+0000","last_peered":"2024-09-11T14:20:05.443617+0000","last_clean":"2024-09-11T14:20:05.443617+0000","last_became_active":"2024-09-11T14:20:03.479775+0000","last_became_peered":"2024-09-11T14:20:03.479775+0000","last_unstale":"2024-09-11T14:20:05.443617+0000","last_undegraded":"2024-09-11T14:20:05.443617+0000","last_fullsized":"2024-09-11T14:20:05.443617+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.431133+0000","last_change":"2024-09-11T14:20:05.435614+0000","last_active":"2024-09-11T14:20:05.431133+0000","last_peered":"2024-09-11T14:20:05.431133+0000","last_clean":"2024-09-11T14:20:05.431133+0000","last_became_active":"2024-09-11T14:20:03.469827+0000","last_became_peered":"2024-09-11T14:20:03.469827+0000","last_unstale":"2024-09-11T14:20:05.431133+0000","last_undegraded":"2024-09-11T14:20:05.431133+0000","last_fullsized":"2024-09-11T14:20:05.431133+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.435959+0000","last_change":"2024-09-11T14:20:05.442983+0000","last_active":"2024-09-11T14:20:05.435959+0000","last_peered":"2024-09-11T14:20:05.435959+0000","last_clean":"2024-09-11T14:20:05.435959+0000","last_became_active":"2024-09-11T14:20:03.491981+0000","last_became_peered":"2024-09-11T14:20:03.491981+0000","last_unstale":"2024-09-11T14:20:05.435959+0000","last_undegraded":"2024-09-11T14:20:05.435959+0000","last_fullsized":"2024-09-11T14:20:05.435959+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.437108+0000","last_change":"2024-09-11T14:20:05.440350+0000","last_active":"2024-09-11T14:20:05.437108+0000","last_peered":"2024-09-11T14:20:05.437108+0000","last_clean":"2024-09-11T14:20:05.437108+0000","last_became_active":"2024-09-11T14:20:03.498001+0000","last_became_peered":"2024-09-11T14:20:03.498001+0000","last_unstale":"2024-09-11T14:20:05.437108+0000","last_undegraded":"2024-09-11T14:20:05.437108+0000","last_fullsized":"2024-09-11T14:20:05.437108+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.430820+0000","last_change":"2024-09-11T14:20:01.465936+0000","last_active":"2024-09-11T14:20:05.430820+0000","last_peered":"2024-09-11T14:20:05.430820+0000","last_clean":"2024-09-11T14:20:05.430820+0000","last_became_active":"2024-09-11T14:20:01.446610+0000","last_became_peered":"2024-09-11T14:20:01.446610+0000","last_unstale":"2024-09-11T14:20:05.430820+0000","last_undegraded":"2024-09-11T14:20:05.430820+0000","last_fullsized":"2024-09-11T14:20:05.430820+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_clean_scrub_stamp":"2024-09-11T14:20:00.391487+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296556,"statfs":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297196,"statfs":{"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":528,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297200,"statfs":{"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1432,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296296,"statfs":{"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:20:07.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:20:07.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.943+0000 7fc99ca63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.949+0000 7fc99ca63640 1 Processor -- start 2024-09-11T14:20:07.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.949+0000 7fc99ca63640 1 -- start start 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99ca63640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc998132520 0x7fc998132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99ca63640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99806f6d0 con 0x7fc9980a3450 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99ca63640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc99806f3d0 con 0x7fc998132520 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc998132520 0x7fc998132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc995d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc9980a3450 0x7fc9980a3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57002/0 (socket says 172.21.15.46:57002) 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc995d9b640 1 -- 172.21.15.46:0/1284374733 learned_addr learned my addr 172.21.15.46:0/1284374733 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99659c640 1 -- 172.21.15.46:0/1284374733 >> v1:172.21.15.46:6789/0 conn(0x7fc9980a3450 legacy=0x7fc9980a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99659c640 1 -- 172.21.15.46:0/1284374733 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99806f0c0 con 0x7fc998132520 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99559a640 1 -- 172.21.15.46:0/1284374733 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517689911 0 0) 0x7fc99806f6d0 con 0x7fc9980a3450 2024-09-11T14:20:07.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99659c640 1 --2- 172.21.15.46:0/1284374733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc998132520 0x7fc998132930 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b31bb564f6545f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99559a640 1 -- 172.21.15.46:0/1284374733 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc988009d90 con 0x7fc998132520 2024-09-11T14:20:07.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99559a640 1 -- 172.21.15.46:0/1284374733 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc98800e230 con 0x7fc998132520 2024-09-11T14:20:07.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.951+0000 7fc99559a640 1 -- 172.21.15.46:0/1284374733 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc98800e4d0 con 0x7fc998132520 2024-09-11T14:20:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.952+0000 7fc99ca63640 1 -- 172.21.15.46:0/1284374733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc998132520 msgr2=0x7fc998132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.952+0000 7fc99ca63640 1 --2- 172.21.15.46:0/1284374733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc998132520 0x7fc998132930 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.952+0000 7fc99ca63640 1 -- 172.21.15.46:0/1284374733 shutdown_connections 2024-09-11T14:20:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.952+0000 7fc99ca63640 1 --2- 172.21.15.46:0/1284374733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc998132520 0x7fc998132930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.952+0000 7fc99ca63640 1 -- 172.21.15.46:0/1284374733 >> 172.21.15.46:0/1284374733 conn(0x7fc99806e490 msgr2=0x7fc99806e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.952+0000 7fc99ca63640 1 -- 172.21.15.46:0/1284374733 shutdown_connections 2024-09-11T14:20:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.952+0000 7fc99ca63640 1 -- 172.21.15.46:0/1284374733 wait complete. 2024-09-11T14:20:07.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.953+0000 7fc99ca63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.954+0000 7fc99ca63640 1 Processor -- start 2024-09-11T14:20:07.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.955+0000 7fc99ca63640 1 -- start start 2024-09-11T14:20:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.956+0000 7fc99ca63640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9980a3450 0x7fc998120f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.956+0000 7fc99ca63640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc9981320e0 con 0x7fc9980a3450 2024-09-11T14:20:07.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.956+0000 7fc99659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9980a3450 0x7fc998120f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.956+0000 7fc99659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9980a3450 0x7fc998120f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58142/0 (socket says 172.21.15.46:58142) 2024-09-11T14:20:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.956+0000 7fc99659c640 1 -- 172.21.15.46:0/2940227814 learned_addr learned my addr 172.21.15.46:0/2940227814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.956+0000 7fc99659c640 1 -- 172.21.15.46:0/2940227814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9981219c0 con 0x7fc9980a3450 2024-09-11T14:20:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.956+0000 7fc99659c640 1 --2- 172.21.15.46:0/2940227814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9980a3450 0x7fc998120f90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.957+0000 7fc986ffd640 1 -- 172.21.15.46:0/2940227814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc988013610 con 0x7fc9980a3450 2024-09-11T14:20:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.957+0000 7fc986ffd640 1 -- 172.21.15.46:0/2940227814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc988013770 con 0x7fc9980a3450 2024-09-11T14:20:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.957+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99811f8e0 con 0x7fc9980a3450 2024-09-11T14:20:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.957+0000 7fc986ffd640 1 -- 172.21.15.46:0/2940227814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc988013a10 con 0x7fc9980a3450 2024-09-11T14:20:07.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.957+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc998135790 con 0x7fc9980a3450 2024-09-11T14:20:07.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.958+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99806a300 con 0x7fc9980a3450 2024-09-11T14:20:07.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.958+0000 7fc986ffd640 1 -- 172.21.15.46:0/2940227814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc988013bc0 con 0x7fc9980a3450 2024-09-11T14:20:07.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.958+0000 7fc986ffd640 1 --2- 172.21.15.46:0/2940227814 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc97803e930 0x7fc978040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:07.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.958+0000 7fc986ffd640 1 -- 172.21.15.46:0/2940227814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fc988018040 con 0x7fc9980a3450 2024-09-11T14:20:07.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.959+0000 7fc995d9b640 1 --2- 172.21.15.46:0/2940227814 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc97803e930 0x7fc978040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:07.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.959+0000 7fc995d9b640 1 --2- 172.21.15.46:0/2940227814 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc97803e930 0x7fc978040e40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:07.963+0000 7fc986ffd640 1 -- 172.21.15.46:0/2940227814 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc988011380 con 0x7fc9980a3450 2024-09-11T14:20:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.143+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc998121850 con 0x7fc97803e930 2024-09-11T14:20:08.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.144+0000 7fc986ffd640 1 -- 172.21.15.46:0/2940227814 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31201 (crc 0 0 0) 0x7fc998121850 con 0x7fc97803e930 2024-09-11T14:20:08.146 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:20:08.146 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-11T14:20:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc97803e930 msgr2=0x7fc978040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 --2- 172.21.15.46:0/2940227814 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc97803e930 0x7fc978040e40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9980a3450 msgr2=0x7fc998120f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 --2- 172.21.15.46:0/2940227814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9980a3450 0x7fc998120f90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 shutdown_connections 2024-09-11T14:20:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 --2- 172.21.15.46:0/2940227814 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc97803e930 0x7fc978040e40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 --2- 172.21.15.46:0/2940227814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9980a3450 0x7fc998120f90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 >> 172.21.15.46:0/2940227814 conn(0x7fc99806e490 msgr2=0x7fc9980a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:08.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 shutdown_connections 2024-09-11T14:20:08.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.146+0000 7fc99ca63640 1 -- 172.21.15.46:0/2940227814 wait complete. 2024-09-11T14:20:08.159 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-11T14:20:07.001661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3664,"kb_used_data":3664,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209187248,"statfs":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.437629+0000","last_change":"2024-09-11T14:20:05.441963+0000","last_active":"2024-09-11T14:20:05.437629+0000","last_peered":"2024-09-11T14:20:05.437629+0000","last_clean":"2024-09-11T14:20:05.437629+0000","last_became_active":"2024-09-11T14:20:03.484694+0000","last_became_peered":"2024-09-11T14:20:03.484694+0000","last_unstale":"2024-09-11T14:20:05.437629+0000","last_undegraded":"2024-09-11T14:20:05.437629+0000","last_fullsized":"2024-09-11T14:20:05.437629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.437814+0000","last_change":"2024-09-11T14:20:05.440901+0000","last_active":"2024-09-11T14:20:05.437814+0000","last_peered":"2024-09-11T14:20:05.437814+0000","last_clean":"2024-09-11T14:20:05.437814+0000","last_became_active":"2024-09-11T14:20:03.517121+0000","last_became_peered":"2024-09-11T14:20:03.517121+0000","last_unstale":"2024-09-11T14:20:05.437814+0000","last_undegraded":"2024-09-11T14:20:05.437814+0000","last_fullsized":"2024-09-11T14:20:05.437814+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.433160+0000","last_change":"2024-09-11T14:20:05.436801+0000","last_active":"2024-09-11T14:20:05.433160+0000","last_peered":"2024-09-11T14:20:05.433160+0000","last_clean":"2024-09-11T14:20:05.433160+0000","last_became_active":"2024-09-11T14:20:03.488911+0000","last_became_peered":"2024-09-11T14:20:03.488911+0000","last_unstale":"2024-09-11T14:20:05.433160+0000","last_undegraded":"2024-09-11T14:20:05.433160+0000","last_fullsized":"2024-09-11T14:20:05.433160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.430967+0000","last_change":"2024-09-11T14:20:05.435707+0000","last_active":"2024-09-11T14:20:05.430967+0000","last_peered":"2024-09-11T14:20:05.430967+0000","last_clean":"2024-09-11T14:20:05.430967+0000","last_became_active":"2024-09-11T14:20:03.480359+0000","last_became_peered":"2024-09-11T14:20:03.480359+0000","last_unstale":"2024-09-11T14:20:05.430967+0000","last_undegraded":"2024-09-11T14:20:05.430967+0000","last_fullsized":"2024-09-11T14:20:05.430967+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.443617+0000","last_change":"2024-09-11T14:20:05.443617+0000","last_active":"2024-09-11T14:20:05.443617+0000","last_peered":"2024-09-11T14:20:05.443617+0000","last_clean":"2024-09-11T14:20:05.443617+0000","last_became_active":"2024-09-11T14:20:03.479775+0000","last_became_peered":"2024-09-11T14:20:03.479775+0000","last_unstale":"2024-09-11T14:20:05.443617+0000","last_undegraded":"2024-09-11T14:20:05.443617+0000","last_fullsized":"2024-09-11T14:20:05.443617+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.431133+0000","last_change":"2024-09-11T14:20:05.435614+0000","last_active":"2024-09-11T14:20:05.431133+0000","last_peered":"2024-09-11T14:20:05.431133+0000","last_clean":"2024-09-11T14:20:05.431133+0000","last_became_active":"2024-09-11T14:20:03.469827+0000","last_became_peered":"2024-09-11T14:20:03.469827+0000","last_unstale":"2024-09-11T14:20:05.431133+0000","last_undegraded":"2024-09-11T14:20:05.431133+0000","last_fullsized":"2024-09-11T14:20:05.431133+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.435959+0000","last_change":"2024-09-11T14:20:05.442983+0000","last_active":"2024-09-11T14:20:05.435959+0000","last_peered":"2024-09-11T14:20:05.435959+0000","last_clean":"2024-09-11T14:20:05.435959+0000","last_became_active":"2024-09-11T14:20:03.491981+0000","last_became_peered":"2024-09-11T14:20:03.491981+0000","last_unstale":"2024-09-11T14:20:05.435959+0000","last_undegraded":"2024-09-11T14:20:05.435959+0000","last_fullsized":"2024-09-11T14:20:05.435959+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.437108+0000","last_change":"2024-09-11T14:20:05.440350+0000","last_active":"2024-09-11T14:20:05.437108+0000","last_peered":"2024-09-11T14:20:05.437108+0000","last_clean":"2024-09-11T14:20:05.437108+0000","last_became_active":"2024-09-11T14:20:03.498001+0000","last_became_peered":"2024-09-11T14:20:03.498001+0000","last_unstale":"2024-09-11T14:20:05.437108+0000","last_undegraded":"2024-09-11T14:20:05.437108+0000","last_fullsized":"2024-09-11T14:20:05.437108+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":87,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-11T14:20:05.430820+0000","last_change":"2024-09-11T14:20:01.465936+0000","last_active":"2024-09-11T14:20:05.430820+0000","last_peered":"2024-09-11T14:20:05.430820+0000","last_clean":"2024-09-11T14:20:05.430820+0000","last_became_active":"2024-09-11T14:20:01.446610+0000","last_became_peered":"2024-09-11T14:20:01.446610+0000","last_unstale":"2024-09-11T14:20:05.430820+0000","last_undegraded":"2024-09-11T14:20:05.430820+0000","last_fullsized":"2024-09-11T14:20:05.430820+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_clean_scrub_stamp":"2024-09-11T14:20:00.391487+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214207741952,"internally_reserved":0,"allocated":3751936,"data_stored":3751936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296556,"statfs":{"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":532,"kb_used_data":532,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297196,"statfs":{"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":528,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297200,"statfs":{"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1432,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296296,"statfs":{"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53551407104,"internally_reserved":0,"allocated":1466368,"data_stored":1466368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53552332800,"internally_reserved":0,"allocated":540672,"data_stored":540672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552328704,"internally_reserved":0,"allocated":544768,"data_stored":544768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551673344,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:20:08.159 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:20:08.160 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T14:20:08.160 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T14:20:08.160 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T14:20:08.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.266+0000 7f4962511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.271+0000 7f4962511640 1 Processor -- start 2024-09-11T14:20:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.271+0000 7f4962511640 1 -- start start 2024-09-11T14:20:08.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.272+0000 7f4962511640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f495c133250 0x7f495c133660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.272+0000 7f4962511640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f495c074b40 con 0x7f495c133ba0 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.272+0000 7f4962511640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f495c072df0 con 0x7f495c133250 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.272+0000 7f495bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f495c133250 0x7f495c133660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.273+0000 7f4953fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f495c133ba0 0x7f495c12ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57008/0 (socket says 172.21.15.46:57008) 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.273+0000 7f4953fff640 1 -- 172.21.15.46:0/2263691802 learned_addr learned my addr 172.21.15.46:0/2263691802 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.273+0000 7f495bfff640 1 -- 172.21.15.46:0/2263691802 >> v1:172.21.15.46:6789/0 conn(0x7f495c133ba0 legacy=0x7f495c12ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.273+0000 7f495bfff640 1 -- 172.21.15.46:0/2263691802 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c09ff40 con 0x7f495c133250 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.273+0000 7f495b7fe640 1 -- 172.21.15.46:0/2263691802 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 765386864 0 0) 0x7f495c074b40 con 0x7f495c133ba0 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.273+0000 7f495bfff640 1 --2- 172.21.15.46:0/2263691802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 0x7f495c133660 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a6617de5ff1410 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.273+0000 7f495b7fe640 1 -- 172.21.15.46:0/2263691802 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f494c009d90 con 0x7f495c133250 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.273+0000 7f495b7fe640 1 -- 172.21.15.46:0/2263691802 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f494c00e230 con 0x7f495c133250 2024-09-11T14:20:08.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.273+0000 7f495b7fe640 1 -- 172.21.15.46:0/2263691802 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f494c00e4d0 con 0x7f495c133250 2024-09-11T14:20:08.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.274+0000 7f4962511640 1 -- 172.21.15.46:0/2263691802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 msgr2=0x7f495c133660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:08.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.274+0000 7f4962511640 1 --2- 172.21.15.46:0/2263691802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 0x7f495c133660 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.274+0000 7f4962511640 1 -- 172.21.15.46:0/2263691802 shutdown_connections 2024-09-11T14:20:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.274+0000 7f4962511640 1 --2- 172.21.15.46:0/2263691802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 0x7f495c133660 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.274+0000 7f4962511640 1 -- 172.21.15.46:0/2263691802 >> 172.21.15.46:0/2263691802 conn(0x7f495c0a0210 msgr2=0x7f495c0a0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.274+0000 7f4962511640 1 -- 172.21.15.46:0/2263691802 shutdown_connections 2024-09-11T14:20:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.274+0000 7f4962511640 1 -- 172.21.15.46:0/2263691802 wait complete. 2024-09-11T14:20:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.274+0000 7f4962511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:20:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.276+0000 7f4962511640 1 Processor -- start 2024-09-11T14:20:08.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.276+0000 7f4962511640 1 -- start start 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.277+0000 7f4962511640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 0x7f495c121400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.277+0000 7f4962511640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1252f0 con 0x7f495c133250 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f495bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 0x7f495c121400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f495bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 0x7f495c121400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58174/0 (socket says 172.21.15.46:58174) 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f495bfff640 1 -- 172.21.15.46:0/4057143621 learned_addr learned my addr 172.21.15.46:0/4057143621 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f495bfff640 1 -- 172.21.15.46:0/4057143621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c1246d0 con 0x7f495c133250 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f495bfff640 1 --2- 172.21.15.46:0/4057143621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 0x7f495c121400 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f49597fa640 1 -- 172.21.15.46:0/4057143621 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f494c013610 con 0x7f495c133250 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f49597fa640 1 -- 172.21.15.46:0/4057143621 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f494c013770 con 0x7f495c133250 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c122e90 con 0x7f495c133250 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f49597fa640 1 -- 172.21.15.46:0/4057143621 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f494c013a10 con 0x7f495c133250 2024-09-11T14:20:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.278+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c1236b0 con 0x7f495c133250 2024-09-11T14:20:08.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.279+0000 7f49597fa640 1 -- 172.21.15.46:0/4057143621 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f494c013bc0 con 0x7f495c133250 2024-09-11T14:20:08.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.279+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c09fc20 con 0x7f495c133250 2024-09-11T14:20:08.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.280+0000 7f49597fa640 1 --2- 172.21.15.46:0/4057143621 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f493c03e930 0x7f493c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:20:08.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.280+0000 7f49597fa640 1 -- 172.21.15.46:0/4057143621 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f494c018040 con 0x7f495c133250 2024-09-11T14:20:08.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.280+0000 7f4953fff640 1 --2- 172.21.15.46:0/4057143621 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f493c03e930 0x7f493c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:20:08.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.281+0000 7f4953fff640 1 --2- 172.21.15.46:0/4057143621 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f493c03e930 0x7f493c040e40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:20:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.285+0000 7f49597fa640 1 -- 172.21.15.46:0/4057143621 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f494c011380 con 0x7f495c133250 2024-09-11T14:20:08.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.508+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f495c073ee0 con 0x7f495c133250 2024-09-11T14:20:08.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.509+0000 7f49597fa640 1 -- 172.21.15.46:0/4057143621 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7f494c0080b0 con 0x7f495c133250 2024-09-11T14:20:08.510 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:20:08.510 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T14:20:08.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f493c03e930 msgr2=0x7f493c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 --2- 172.21.15.46:0/4057143621 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f493c03e930 0x7f493c040e40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 msgr2=0x7f495c121400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:20:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 --2- 172.21.15.46:0/4057143621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 0x7f495c121400 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 shutdown_connections 2024-09-11T14:20:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 --2- 172.21.15.46:0/4057143621 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f493c03e930 0x7f493c040e40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 --2- 172.21.15.46:0/4057143621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f495c133250 0x7f495c121400 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:20:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 >> 172.21.15.46:0/4057143621 conn(0x7f495c0a0210 msgr2=0x7f495c1324f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:20:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 shutdown_connections 2024-09-11T14:20:08.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:20:08.511+0000 7f4962511640 1 -- 172.21.15.46:0/4057143621 wait complete. 2024-09-11T14:20:08.523 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T14:20:08.524 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T14:20:08.538 INFO:tasks.workunit:Pulling workunits from ref 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-11T14:20:08.538 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T14:20:08.538 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:20:08.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:20:08.554 INFO:teuthology.orchestra.run.smithi046.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-11T14:20:08.554 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:20:08.610 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-11T14:20:08.610 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-11T14:20:08.665 INFO:tasks.workunit:timeout=3h 2024-09-11T14:20:08.666 INFO:tasks.workunit:cleanup=True 2024-09-11T14:20:08.666 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0325fd3c11a225c0fd9eb38fab88aad1370ad779 2024-09-11T14:20:08.722 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T14:20:59.090 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 95% (11529/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-11T14:20:59.643 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '0325fd3c11a225c0fd9eb38fab88aad1370ad779'. 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-09-11T14:20:59.644 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-11T14:20:59.645 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-09-11T14:20:59.645 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-11T14:20:59.645 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T14:20:59.645 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-11T14:20:59.645 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 0325fd3c11a Merge pull request #58530 from zdover23/wip-doc-2024-07-11-radosgw-s3-authentication 2024-09-11T14:20:59.649 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T14:20:59.716 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T14:20:59.718 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T14:20:59.718 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T14:21:00.421 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T14:21:00.492 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T14:21:00.533 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T14:21:00.535 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T14:21:00.535 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T14:21:00.574 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T14:21:00.578 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-11T14:21:00.578 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T14:21:00.634 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-11T14:21:00.635 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-11T14:21:00.636 DEBUG:teuthology.orchestra.run.smithi046:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-09-11T14:21:00.695 INFO:tasks.workunit.client.0.smithi046.stderr:+ parallel=1 2024-09-11T14:21:00.695 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' --crimson = --serial ']' 2024-09-11T14:21:00.695 INFO:tasks.workunit.client.0.smithi046.stderr:+ crimson=0 2024-09-11T14:21:00.695 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' --crimson = --crimson ']' 2024-09-11T14:21:00.695 INFO:tasks.workunit.client.0.smithi046.stderr:+ parallel=0 2024-09-11T14:21:00.695 INFO:tasks.workunit.client.0.smithi046.stderr:+ crimson=1 2024-09-11T14:21:00.695 INFO:tasks.workunit.client.0.smithi046.stderr:+ color= 2024-09-11T14:21:00.696 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -t 1 ']' 2024-09-11T14:21:00.696 INFO:tasks.workunit.client.0.smithi046.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-11T14:21:00.696 INFO:tasks.workunit.client.0.smithi046.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-11T14:21:00.696 INFO:tasks.workunit.client.0.smithi046.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-11T14:21:00.696 INFO:tasks.workunit.client.0.smithi046.stderr:+ declare -A pids 2024-09-11T14:21:00.696 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:21:00.697 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:21:00.697 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_aio 2024-09-11T14:21:00.714 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:21:00.715 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 42 tests from 2 test suites. 2024-09-11T14:21:00.715 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:21:00.715 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 26 tests from LibRadosAio 2024-09-11T14:21:00.715 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.TooBig 2024-09-11T14:21:02.808 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.TooBig (2094 ms) 2024-09-11T14:21:02.809 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-09-11T14:21:05.819 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleWrite (3011 ms) 2024-09-11T14:21:05.820 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-09-11T14:21:08.834 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.WaitForSafe (3014 ms) 2024-09-11T14:21:08.834 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-09-11T14:21:11.845 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTrip (3012 ms) 2024-09-11T14:21:11.845 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-09-11T14:21:14.859 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTrip2 (3013 ms) 2024-09-11T14:21:14.859 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-09-11T14:21:17.870 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTrip3 (3012 ms) 2024-09-11T14:21:17.871 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-09-11T14:21:20.886 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripAppend (3015 ms) 2024-09-11T14:21:20.886 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-09-11T14:21:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RemoveTest (3010 ms) 2024-09-11T14:21:23.895 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-11T14:21:26.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3014 ms) 2024-09-11T14:21:26.910 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RmXattr 2024-09-11T14:21:29.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RmXattr (3009 ms) 2024-09-11T14:21:29.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.XattrIter 2024-09-11T14:21:32.935 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.XattrIter (3017 ms) 2024-09-11T14:21:32.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.IsComplete 2024-09-11T14:21:35.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.IsComplete (3010 ms) 2024-09-11T14:21:35.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.IsSafe 2024-09-11T14:21:38.961 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.IsSafe (3015 ms) 2024-09-11T14:21:38.961 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-09-11T14:21:41.977 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.ReturnValue (3017 ms) 2024-09-11T14:21:41.978 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.Flush 2024-09-11T14:21:44.990 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.Flush (3013 ms) 2024-09-11T14:21:44.991 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-09-11T14:21:48.004 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.FlushAsync (3013 ms) 2024-09-11T14:21:48.004 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-11T14:21:51.019 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3015 ms) 2024-09-11T14:21:51.019 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-11T14:21:53.797 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (2779 ms) 2024-09-11T14:21:53.798 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-09-11T14:21:56.796 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleStat (2999 ms) 2024-09-11T14:21:56.796 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-11T14:21:59.838 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.OperateMtime (3042 ms) 2024-09-11T14:21:59.839 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-09-11T14:22:02.852 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.Operate2Mtime (3013 ms) 2024-09-11T14:22:02.852 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-09-11T14:22:05.864 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleStatNS (3013 ms) 2024-09-11T14:22:05.864 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.StatRemove 2024-09-11T14:22:08.872 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.StatRemove (3008 ms) 2024-09-11T14:22:08.873 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-09-11T14:22:11.881 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.ExecuteClass (3009 ms) 2024-09-11T14:22:11.881 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-09-11T14:22:14.899 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.MultiWrite (3017 ms) 2024-09-11T14:22:14.899 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-09-11T14:22:17.914 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.AioUnlock (3013 ms) 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 26 tests from LibRadosAio (77197 ms total) 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 16 tests from LibRadosAioEC 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1100: Skipped 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1132: Skipped 2024-09-11T14:22:17.915 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-09-11T14:22:17.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-09-11T14:22:17.916 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1149: Skipped 2024-09-11T14:22:17.916 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-09-11T14:22:17.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-09-11T14:22:17.916 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1182: Skipped 2024-09-11T14:22:17.916 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (1 ms) 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1215: Skipped 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1286: Skipped 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1326: Skipped 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1366: Skipped 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.Flush 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1385: Skipped 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1415: Skipped 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.918 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1454: Skipped 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1498: Skipped 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1532: Skipped 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-09-11T14:22:17.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1593: Skipped 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1649: Skipped 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio.cc:1681: Skipped 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 16 tests from LibRadosAioEC (1 ms total) 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:22:17.920 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 42 tests from 2 test suites ran. (77198 ms total) 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 26 tests. 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-09-11T14:22:17.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-09-11T14:22:17.922 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-09-11T14:22:17.922 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-09-11T14:22:17.922 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-09-11T14:22:17.922 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-09-11T14:22:17.922 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-09-11T14:22:17.922 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-09-11T14:22:17.922 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:22:17.922 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:22:17.923 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_aio_pp 2024-09-11T14:22:17.938 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:22:17.939 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 57 tests from 4 test suites. 2024-09-11T14:22:17.939 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:22:17.939 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 32 tests from LibRadosAio 2024-09-11T14:22:17.939 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-09-11T14:22:20.929 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.TooBigPP (2990 ms) 2024-09-11T14:22:20.929 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-09-11T14:22:38.814 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.PoolQuotaPP (17885 ms) 2024-09-11T14:22:38.814 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-09-11T14:22:44.843 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleWritePP (6030 ms) 2024-09-11T14:22:44.843 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-09-11T14:22:47.855 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.WaitForSafePP (3011 ms) 2024-09-11T14:22:47.855 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-09-11T14:22:50.873 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripPP (3018 ms) 2024-09-11T14:22:50.876 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-09-11T14:22:53.880 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3008 ms) 2024-09-11T14:22:53.881 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-09-11T14:22:56.810 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2929 ms) 2024-09-11T14:22:56.810 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-11T14:22:59.819 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3009 ms) 2024-09-11T14:22:59.819 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-09-11T14:23:02.834 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.IsCompletePP (3015 ms) 2024-09-11T14:23:02.835 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-09-11T14:23:05.853 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.IsSafePP (3015 ms) 2024-09-11T14:23:05.853 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-09-11T14:23:08.855 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.ReturnValuePP (3006 ms) 2024-09-11T14:23:08.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.FlushPP 2024-09-11T14:23:11.867 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.FlushPP (3012 ms) 2024-09-11T14:23:11.867 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-09-11T14:23:14.886 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3018 ms) 2024-09-11T14:23:14.886 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-11T14:23:17.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3012 ms) 2024-09-11T14:23:17.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-11T14:23:20.913 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3016 ms) 2024-09-11T14:23:20.914 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-11T14:23:23.926 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3012 ms) 2024-09-11T14:23:23.926 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-11T14:23:26.818 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (2892 ms) 2024-09-11T14:23:26.818 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-11T14:23:29.826 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3008 ms) 2024-09-11T14:23:29.827 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-09-11T14:23:32.844 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleStatPP (3019 ms) 2024-09-11T14:23:32.844 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-11T14:23:35.854 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.OperateMtime (3009 ms) 2024-09-11T14:23:35.854 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-09-11T14:23:38.864 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.OperateMtime2 (3010 ms) 2024-09-11T14:23:38.864 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-09-11T14:23:41.874 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.StatRemovePP (3010 ms) 2024-09-11T14:23:41.874 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-09-11T14:23:44.891 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3017 ms) 2024-09-11T14:23:44.891 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.OmapPP 2024-09-11T14:23:47.905 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.OmapPP (3014 ms) 2024-09-11T14:23:47.905 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-09-11T14:23:50.919 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.MultiWritePP (3014 ms) 2024-09-11T14:23:50.920 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-09-11T14:23:53.932 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.AioUnlockPP (3012 ms) 2024-09-11T14:23:53.932 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-11T14:23:56.824 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2892 ms) 2024-09-11T14:23:56.824 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-09-11T14:23:59.832 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RacingRemovePP (3009 ms) 2024-09-11T14:23:59.833 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-11T14:24:02.847 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3014 ms) 2024-09-11T14:24:02.847 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-11T14:24:05.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3010 ms) 2024-09-11T14:24:05.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-09-11T14:24:08.325 INFO:tasks.workunit.client.0.smithi046.stdout:setting pool EIO 2024-09-11T14:24:17.979 INFO:tasks.workunit.client.0.smithi046.stdout:waiting for 928 2024-09-11T14:24:18.979 INFO:tasks.workunit.client.0.smithi046.stdout:waiting for 896 2024-09-11T14:24:19.980 INFO:tasks.workunit.client.0.smithi046.stdout:waiting for 854 2024-09-11T14:24:20.979 INFO:tasks.workunit.client.0.smithi046.stdout:max_success 184, min_failed 185 2024-09-11T14:24:21.455 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.PoolEIOFlag (15598 ms) 2024-09-11T14:24:21.455 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.MultiReads 2024-09-11T14:24:21.455 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2427: Skipped 2024-09-11T14:24:21.456 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:24:21.456 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-09-11T14:24:21.456 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 32 tests from LibRadosAio (123517 ms total) 2024-09-11T14:24:21.456 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:24:21.456 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosAioPP 2024-09-11T14:24:21.456 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-11T14:24:35.849 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (14393 ms) 2024-09-11T14:24:35.849 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-11T14:24:44.849 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (9000 ms) 2024-09-11T14:24:44.849 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-09-11T14:24:59.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAioPP.RmXattrPP (15051 ms) 2024-09-11T14:24:59.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-11T14:25:02.913 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3014 ms) 2024-09-11T14:25:02.913 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosAioPP (41458 ms total) 2024-09-11T14:25:02.913 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:02.914 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosIoPP 2024-09-11T14:25:02.914 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-11T14:25:05.928 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.XattrListPP (3012 ms) 2024-09-11T14:25:05.928 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosIoPP (3012 ms total) 2024-09-11T14:25:05.928 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:05.928 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 20 tests from LibRadosAioEC 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1384: Skipped 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1419: Skipped 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1436: Skipped 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1467: Skipped 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1500: Skipped 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1605: Skipped 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-09-11T14:25:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1637: Skipped 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1705: Skipped 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1742: Skipped 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-11T14:25:05.931 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1780: Skipped 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1796: Skipped 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1824: Skipped 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-11T14:25:05.932 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1859: Skipped 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1904: Skipped 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1946: Skipped 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:1977: Skipped 2024-09-11T14:25:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2008: Skipped 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2059: Skipped 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2089: Skipped 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-09-11T14:25:05.934 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/aio_cxx.cc:2124: Skipped 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 57 tests from 4 test suites ran. (167987 ms total) 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 36 tests. 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 21 tests, listed below: 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-09-11T14:25:05.935 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-09-11T14:25:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-09-11T14:25:05.937 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-09-11T14:25:05.937 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-09-11T14:25:05.937 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-09-11T14:25:05.937 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:25:05.937 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:25:05.937 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_io 2024-09-11T14:25:05.952 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:25:05.952 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 24 tests from 2 test suites. 2024-09-11T14:25:05.952 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:05.952 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from LibRadosIo 2024-09-11T14:25:07.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-09-11T14:25:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.SimpleWrite (358 ms) 2024-09-11T14:25:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.TooBig 2024-09-11T14:25:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-09-11T14:25:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-09-11T14:25:08.381 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-09-11T14:25:08.381 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-09-11T14:25:08.381 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-09-11T14:25:08.381 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-09-11T14:25:08.381 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-09-11T14:25:08.381 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.ReadTimeout (87 ms) 2024-09-11T14:25:08.381 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-09-11T14:25:08.435 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.RoundTrip (54 ms) 2024-09-11T14:25:08.435 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.Checksum 2024-09-11T14:25:08.462 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.Checksum (28 ms) 2024-09-11T14:25:08.462 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-11T14:25:08.506 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (44 ms) 2024-09-11T14:25:08.506 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-11T14:25:08.546 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (40 ms) 2024-09-11T14:25:08.546 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-09-11T14:25:08.585 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.AppendRoundTrip (39 ms) 2024-09-11T14:25:08.585 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-09-11T14:25:08.591 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.ZeroLenZero (6 ms) 2024-09-11T14:25:08.591 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.TruncTest 2024-09-11T14:25:08.634 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.TruncTest (43 ms) 2024-09-11T14:25:08.635 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-09-11T14:25:08.672 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.RemoveTest (37 ms) 2024-09-11T14:25:08.672 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-11T14:25:08.718 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (47 ms) 2024-09-11T14:25:08.718 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.RmXattr 2024-09-11T14:25:08.829 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.RmXattr (111 ms) 2024-09-11T14:25:08.829 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.XattrIter 2024-09-11T14:25:08.886 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.XattrIter (57 ms) 2024-09-11T14:25:08.940 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from LibRadosIo (951 ms total) 2024-09-11T14:25:08.940 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:08.940 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from LibRadosIoEC 2024-09-11T14:25:08.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:25:08.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-09-11T14:25:08.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-09-11T14:25:08.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-09-11T14:25:08.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 24 tests from 2 test suites ran. (2987 ms total) 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 14 tests. 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 10 tests, listed below: 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-09-11T14:25:08.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-09-11T14:25:08.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-11T14:25:08.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-09-11T14:25:08.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-09-11T14:25:08.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-09-11T14:25:08.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-09-11T14:25:08.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-09-11T14:25:08.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-09-11T14:25:08.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-09-11T14:25:08.946 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:25:08.947 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:25:08.947 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_io_pp 2024-09-11T14:25:08.960 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:25:08.960 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 40 tests from 2 test suites. 2024-09-11T14:25:08.961 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:08.961 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosIoPP 2024-09-11T14:25:08.961 INFO:tasks.workunit.client.0.smithi046.stdout:seed 30727 2024-09-11T14:25:10.948 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-09-11T14:25:10.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-11T14:25:10.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-11T14:25:11.290 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (342 ms) 2024-09-11T14:25:11.290 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-09-11T14:25:11.452 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.ReadOpPP (162 ms) 2024-09-11T14:25:11.453 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-11T14:25:11.486 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (33 ms) 2024-09-11T14:25:11.486 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-11T14:25:15.106 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (3620 ms) 2024-09-11T14:25:15.106 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-09-11T14:25:15.134 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.RoundTripPP (29 ms) 2024-09-11T14:25:15.134 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-11T14:25:15.159 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (25 ms) 2024-09-11T14:25:15.159 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-09-11T14:25:15.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.Checksum (29 ms) 2024-09-11T14:25:15.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-11T14:25:15.214 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (24 ms) 2024-09-11T14:25:15.214 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-11T14:25:15.262 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (49 ms) 2024-09-11T14:25:15.262 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-11T14:25:15.306 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (44 ms) 2024-09-11T14:25:15.306 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-11T14:25:15.330 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (23 ms) 2024-09-11T14:25:15.330 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-11T14:25:15.374 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (43 ms) 2024-09-11T14:25:15.374 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-09-11T14:25:15.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.TruncTestPP (45 ms) 2024-09-11T14:25:15.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-11T14:25:15.468 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (50 ms) 2024-09-11T14:25:15.468 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-11T14:25:15.522 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (54 ms) 2024-09-11T14:25:15.522 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-09-11T14:25:15.635 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.RmXattrPP (113 ms) 2024-09-11T14:25:15.635 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-11T14:25:15.697 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.XattrListPP (61 ms) 2024-09-11T14:25:15.697 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-11T14:25:15.737 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (40 ms) 2024-09-11T14:25:15.737 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-09-11T14:25:15.779 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.CmpExtPP (43 ms) 2024-09-11T14:25:15.779 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-11T14:25:15.808 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (29 ms) 2024-09-11T14:25:15.808 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-11T14:25:15.842 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (34 ms) 2024-09-11T14:25:15.961 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosIoPP (4894 ms total) 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 18 tests from LibRadosIoECPP 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.962 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (1 ms) 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.963 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.964 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.965 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-11T14:25:15.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 18 tests from LibRadosIoECPP (1 ms total) 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 40 tests from 2 test suites ran. (6996 ms total) 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 22 tests. 2024-09-11T14:25:15.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 18 tests, listed below: 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-09-11T14:25:15.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-09-11T14:25:15.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-09-11T14:25:15.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-11T14:25:15.972 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:25:15.972 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:25:15.972 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_asio 2024-09-11T14:25:15.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:15.990+0000 7f8d0c2486c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:16.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.005+0000 7f8d0c2486c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:16.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.005+0000 7f8d0c2486c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:16.006 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-11T14:25:16.007 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:16.007 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 12 tests from AsioRados 2024-09-11T14:25:16.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.007+0000 7f8d0c2486c0 1 Processor -- start 2024-09-11T14:25:16.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.007+0000 7f8d0c2486c0 1 -- start start 2024-09-11T14:25:16.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.009+0000 7f8d0c2486c0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb92380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:25:16.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.009+0000 7f8d0c2486c0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x9dd520 con 0xa783b0 2024-09-11T14:25:16.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.010+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb92380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:25:16.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.010+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb92380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50980/0 (socket says 172.21.15.46:50980) 2024-09-11T14:25:16.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.010+0000 7f8cff7fe640 1 -- 172.21.15.46:0/3929756395 learned_addr learned my addr 172.21.15.46:0/3929756395 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:25:16.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.010+0000 7f8cff7fe640 1 -- 172.21.15.46:0/3929756395 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x979e10 con 0xa783b0 2024-09-11T14:25:16.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.010+0000 7f8cff7fe640 1 --2- 172.21.15.46:0/3929756395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb92380 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552f4d9fd466ae3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:25:16.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.011+0000 7f8cfdffb640 1 -- 172.21.15.46:0/3929756395 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8cf000a170 con 0xa783b0 2024-09-11T14:25:16.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.011+0000 7f8cfdffb640 1 -- 172.21.15.46:0/3929756395 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8cf000a2d0 con 0xa783b0 2024-09-11T14:25:16.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.011+0000 7f8cfdffb640 1 -- 172.21.15.46:0/3929756395 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8cf002dc90 con 0xa783b0 2024-09-11T14:25:16.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.012+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/3929756395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 msgr2=0xb92380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:25:16.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.012+0000 7f8d0c2486c0 1 --2- 172.21.15.46:0/3929756395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb92380 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:25:16.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.012+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/3929756395 shutdown_connections 2024-09-11T14:25:16.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.012+0000 7f8d0c2486c0 1 --2- 172.21.15.46:0/3929756395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb92380 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:25:16.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.012+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/3929756395 >> 172.21.15.46:0/3929756395 conn(0x99d770 msgr2=0xb94dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:25:16.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.017+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/3929756395 shutdown_connections 2024-09-11T14:25:16.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.021+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/3929756395 wait complete. 2024-09-11T14:25:16.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.022+0000 7f8d0c2486c0 1 Processor -- start 2024-09-11T14:25:16.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.022+0000 7f8d0c2486c0 1 -- start start 2024-09-11T14:25:16.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.025+0000 7f8d0c2486c0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb7eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:25:16.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.025+0000 7f8d0c2486c0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x9db280 con 0xa783b0 2024-09-11T14:25:16.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.025+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb7eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:25:16.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.025+0000 7f8cff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb7eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50982/0 (socket says 172.21.15.46:50982) 2024-09-11T14:25:16.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.025+0000 7f8cff7fe640 1 -- 172.21.15.46:0/936118285 learned_addr learned my addr 172.21.15.46:0/936118285 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:25:16.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.026+0000 7f8cff7fe640 1 -- 172.21.15.46:0/936118285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x96b920 con 0xa783b0 2024-09-11T14:25:16.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.026+0000 7f8cff7fe640 1 --2- 172.21.15.46:0/936118285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb7eea0 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:25:16.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.027+0000 7f8cfcff9640 1 -- 172.21.15.46:0/936118285 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8cf002dc90 con 0xa783b0 2024-09-11T14:25:16.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.027+0000 7f8cfcff9640 1 -- 172.21.15.46:0/936118285 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8cf0039c80 con 0xa783b0 2024-09-11T14:25:16.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.027+0000 7f8cfcff9640 1 -- 172.21.15.46:0/936118285 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8cf003a400 con 0xa783b0 2024-09-11T14:25:16.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.027+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x96b380 con 0xa783b0 2024-09-11T14:25:16.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.028+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb80730 con 0xa783b0 2024-09-11T14:25:16.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.029+0000 7f8cfcff9640 1 -- 172.21.15.46:0/936118285 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8cf003a5b0 con 0xa783b0 2024-09-11T14:25:16.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.029+0000 7f8cfcff9640 1 --2- 172.21.15.46:0/936118285 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8cec03d1c0 0x7f8cec03f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:25:16.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.029+0000 7f8cfcff9640 1 -- 172.21.15.46:0/936118285 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(239..239 src has 1..239) ==== 2700+0+0 (crc 0 0 0) 0x7f8cf002de40 con 0xa783b0 2024-09-11T14:25:16.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.030+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x9d3df0 con 0xa783b0 2024-09-11T14:25:16.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.030+0000 7f8cfcff9640 1 -- 172.21.15.46:0/936118285 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=239) ==== 24+0+0 (crc 0 0 0) 0x7f8cf0037a80 con 0xa783b0 2024-09-11T14:25:16.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.034+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x9e6bf0 con 0xa783b0 2024-09-11T14:25:16.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.038+0000 7f8cfeffd640 1 --2- 172.21.15.46:0/936118285 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8cec03d1c0 0x7f8cec03f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:25:16.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.039+0000 7f8cfeffd640 1 --2- 172.21.15.46:0/936118285 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8cec03d1c0 0x7f8cec03f6d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:25:16.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.836+0000 7f8cfcff9640 1 -- 172.21.15.46:0/936118285 <== mon.0 v2:172.21.15.46:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v240) ==== 43+0+0 (crc 0 0 0) 0x7f8cf0034790 con 0xa783b0 2024-09-11T14:25:16.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.836+0000 7f8cfcff9640 1 -- 172.21.15.46:0/936118285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=240}) -- 0x7f8cec041b40 con 0xa783b0 2024-09-11T14:25:16.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.837+0000 7f8cfcff9640 1 -- 172.21.15.46:0/936118285 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(240..240 src has 1..240) ==== 651+0+0 (crc 0 0 0) 0x7f8cf0032040 con 0xa783b0 2024-09-11T14:25:16.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.837+0000 7f8d0c2486c0 1 --2- 172.21.15.46:0/936118285 >> v2:172.21.15.46:6805/1751227380 conn(0xa787c0 0xb7f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:25:16.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.837+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0xb91a20 con 0xa787c0 2024-09-11T14:25:16.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.839+0000 7f8d04e40640 1 --2- 172.21.15.46:0/936118285 >> v2:172.21.15.46:6805/1751227380 conn(0xa787c0 0xb7f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:25:16.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:16.850+0000 7f8d04e40640 1 --2- 172.21.15.46:0/936118285 >> v2:172.21.15.46:6805/1751227380 conn(0xa787c0 0xb7f8f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:25:18.044 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-09-11T14:25:18.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.042+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 1 ==== osd_op_reply(2 exist [writefull 0~5] v241'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.042+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xba4f50 con 0xa787c0 2024-09-11T14:25:18.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.042+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xba57f0 con 0xa787c0 2024-09-11T14:25:18.071 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.070+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 2 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.072 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadCallback (28 ms) 2024-09-11T14:25:18.072 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-09-11T14:25:18.072 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.070+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v241'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.070+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xba5bd0 con 0xa787c0 2024-09-11T14:25:18.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.070+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xba7f70 con 0xa787c0 2024-09-11T14:25:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.092+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.092+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v241'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.094 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadFuture (22 ms) 2024-09-11T14:25:18.094 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-09-11T14:25:18.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.092+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xb81f50 con 0xa787c0 2024-09-11T14:25:18.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.092+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xbe8900 con 0xa787c0 2024-09-11T14:25:18.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.113+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.113+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v241'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.115 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadYield (21 ms) 2024-09-11T14:25:18.115 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-09-11T14:25:18.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.114+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0xba9360 con 0xa787c0 2024-09-11T14:25:18.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.138+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 8 ==== osd_op_reply(9 exist [write 0~5] v241'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.140 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteCallback (25 ms) 2024-09-11T14:25:18.140 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-09-11T14:25:18.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.138+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0xba9360 con 0xa787c0 2024-09-11T14:25:18.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.157+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 9 ==== osd_op_reply(10 exist [write 0~5] v241'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.159 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteFuture (20 ms) 2024-09-11T14:25:18.159 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-09-11T14:25:18.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.158+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0xbcb370 con 0xa787c0 2024-09-11T14:25:18.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.181+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 10 ==== osd_op_reply(11 exist [write 0~5] v241'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteYield (23 ms) 2024-09-11T14:25:18.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-11T14:25:18.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.181+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xba8350 con 0xa787c0 2024-09-11T14:25:18.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.181+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xba8cd0 con 0xa787c0 2024-09-11T14:25:18.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.199+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.199+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v241'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (18 ms) 2024-09-11T14:25:18.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-11T14:25:18.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.199+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xba8350 con 0xa787c0 2024-09-11T14:25:18.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.199+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xba8cd0 con 0xa787c0 2024-09-11T14:25:18.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.210+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v241'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.211+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.213 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (12 ms) 2024-09-11T14:25:18.213 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-09-11T14:25:18.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.211+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xbcb370 con 0xa787c0 2024-09-11T14:25:18.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.212+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e240) -- 0xbcb990 con 0xa787c0 2024-09-11T14:25:18.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.223+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.224+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v241'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.225 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadOperationYield (13 ms) 2024-09-11T14:25:18.225 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-11T14:25:18.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.224+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0xba8970 con 0xa787c0 2024-09-11T14:25:18.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.244+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 17 ==== osd_op_reply(18 exist [writefull 0~5] v241'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.245 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (20 ms) 2024-09-11T14:25:18.245 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-11T14:25:18.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.244+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0xba8950 con 0xa787c0 2024-09-11T14:25:18.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.262+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 18 ==== osd_op_reply(19 exist [writefull 0~5] v241'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.264 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (18 ms) 2024-09-11T14:25:18.264 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-11T14:25:18.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.263+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e240) -- 0xba8950 con 0xa787c0 2024-09-11T14:25:18.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d04e40640 1 -- 172.21.15.46:0/936118285 <== osd.1 v2:172.21.15.46:6805/1751227380 19 ==== osd_op_reply(20 exist [writefull 0~5] v241'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0xa787c0 2024-09-11T14:25:18.280 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (16 ms) 2024-09-11T14:25:18.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 >> v2:172.21.15.46:6805/1751227380 conn(0xa787c0 msgr2=0xb7f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:25:18.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 --2- 172.21.15.46:0/936118285 >> v2:172.21.15.46:6805/1751227380 conn(0xa787c0 0xb7f8f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:25:18.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8cec03d1c0 msgr2=0x7f8cec03f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:25:18.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 --2- 172.21.15.46:0/936118285 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8cec03d1c0 0x7f8cec03f6d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:25:18.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 msgr2=0xb7eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:25:18.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 --2- 172.21.15.46:0/936118285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb7eea0 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:25:18.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 shutdown_connections 2024-09-11T14:25:18.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 --2- 172.21.15.46:0/936118285 >> v2:172.21.15.46:6805/1751227380 conn(0xa787c0 0xb7f8f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:25:18.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 --2- 172.21.15.46:0/936118285 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8cec03d1c0 0x7f8cec03f6d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:25:18.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 --2- 172.21.15.46:0/936118285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa783b0 0xb7eea0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:25:18.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 >> 172.21.15.46:0/936118285 conn(0x99d770 msgr2=0xb94370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:25:18.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.278+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 shutdown_connections 2024-09-11T14:25:18.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.279+0000 7f8d0c2486c0 1 -- 172.21.15.46:0/936118285 wait complete. 2024-09-11T14:25:18.282 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 12 tests from AsioRados (236 ms total) 2024-09-11T14:25:18.282 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:18.282 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:18.283 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 12 tests from 1 test suite ran. (2274 ms total) 2024-09-11T14:25:18.283 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 12 tests. 2024-09-11T14:25:18.283 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:25:18.283 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:25:18.284 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_list 2024-09-11T14:25:18.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.311+0000 7f0ddd8379c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:18.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.312+0000 7f0ddd8379c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:18.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:18.312+0000 7f0ddd8379c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:18.313 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 11 tests from 3 test suites. 2024-09-11T14:25:18.314 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:18.314 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosList 2024-09-11T14:25:19.850 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjects 2024-09-11T14:25:20.521 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjects (672 ms) 2024-09-11T14:25:20.521 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-11T14:25:20.839 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (317 ms) 2024-09-11T14:25:20.839 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-09-11T14:25:21.025 INFO:tasks.workunit.client.0.smithi046.stdout:myset foo1,foo2,foo3 2024-09-11T14:25:21.174 INFO:tasks.workunit.client.0.smithi046.stdout:foo1 2024-09-11T14:25:21.174 INFO:tasks.workunit.client.0.smithi046.stdout:foo2 2024-09-11T14:25:21.174 INFO:tasks.workunit.client.0.smithi046.stdout:foo3 2024-09-11T14:25:21.174 INFO:tasks.workunit.client.0.smithi046.stdout:myset foo1,foo4,foo5 2024-09-11T14:25:21.313 INFO:tasks.workunit.client.0.smithi046.stdout:foo4 2024-09-11T14:25:21.313 INFO:tasks.workunit.client.0.smithi046.stdout:foo5 2024-09-11T14:25:21.313 INFO:tasks.workunit.client.0.smithi046.stdout:foo1 2024-09-11T14:25:21.313 INFO:tasks.workunit.client.0.smithi046.stdout:myset foo6,foo7 2024-09-11T14:25:21.454 INFO:tasks.workunit.client.0.smithi046.stdout:foo7 2024-09-11T14:25:21.455 INFO:tasks.workunit.client.0.smithi046.stdout:foo6 2024-09-11T14:25:21.455 INFO:tasks.workunit.client.0.smithi046.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-11T14:25:21.598 INFO:tasks.workunit.client.0.smithi046.stdout:ns1:foo4 2024-09-11T14:25:21.598 INFO:tasks.workunit.client.0.smithi046.stdout:ns1:foo5 2024-09-11T14:25:21.598 INFO:tasks.workunit.client.0.smithi046.stdout:ns2:foo7 2024-09-11T14:25:21.598 INFO:tasks.workunit.client.0.smithi046.stdout:ns2:foo6 2024-09-11T14:25:21.598 INFO:tasks.workunit.client.0.smithi046.stdout:ns1:foo1 2024-09-11T14:25:21.598 INFO:tasks.workunit.client.0.smithi046.stdout::foo1 2024-09-11T14:25:21.598 INFO:tasks.workunit.client.0.smithi046.stdout::foo2 2024-09-11T14:25:21.598 INFO:tasks.workunit.client.0.smithi046.stdout::foo3 2024-09-11T14:25:21.867 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjectsNS (1028 ms) 2024-09-11T14:25:21.867 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-09-11T14:25:22.318 INFO:tasks.workunit.client.0.smithi046.stdout:1 0 2024-09-11T14:25:22.318 INFO:tasks.workunit.client.0.smithi046.stdout:10 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:13 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:7 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:14 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:0 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:15 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:11 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:5 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:8 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:6 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:3 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:4 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:12 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:9 0 2024-09-11T14:25:22.319 INFO:tasks.workunit.client.0.smithi046.stdout:2 0 2024-09-11T14:25:22.460 INFO:tasks.workunit.client.0.smithi046.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-11T14:25:22.845 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjectsStart (978 ms) 2024-09-11T14:25:22.845 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-09-11T14:25:23.128 INFO:tasks.workunit.client.0.smithi046.stdout:x cursor=MIN 2024-09-11T14:25:23.270 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-09-11T14:25:23.270 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-09-11T14:25:23.270 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-09-11T14:25:23.270 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-09-11T14:25:23.270 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-09-11T14:25:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-09-11T14:25:23.413 INFO:tasks.workunit.client.0.smithi046.stdout:FIRST> seek to MIN oid=1 2024-09-11T14:25:23.559 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-09-11T14:25:23.559 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:02547ec2:::1:head 2024-09-11T14:25:23.700 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:02547ec2:::1:head -> 1 2024-09-11T14:25:23.700 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-09-11T14:25:23.700 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:52ea6a34:::10:head 2024-09-11T14:25:23.796 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-11T14:25:23.796 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-09-11T14:25:23.796 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:566253c9:::13:head 2024-09-11T14:25:23.892 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:566253c9:::13:head -> 13 2024-09-11T14:25:23.892 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-09-11T14:25:23.892 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-11T14:25:23.985 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-11T14:25:23.985 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-09-11T14:25:23.985 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:62a1935d:::14:head 2024-09-11T14:25:24.072 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:62a1935d:::14:head -> 14 2024-09-11T14:25:24.072 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-09-11T14:25:24.073 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:6cac518f:::0:head 2024-09-11T14:25:24.171 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:6cac518f:::0:head -> 0 2024-09-11T14:25:24.171 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-09-11T14:25:24.171 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:863748b0:::15:head 2024-09-11T14:25:24.240 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:863748b0:::15:head -> 15 2024-09-11T14:25:24.240 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-09-11T14:25:24.240 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:89d3ae78:::11:head 2024-09-11T14:25:24.305 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-11T14:25:24.305 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-09-11T14:25:24.305 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:b29083e3:::5:head 2024-09-11T14:25:24.347 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:b29083e3:::5:head -> 5 2024-09-11T14:25:24.348 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-09-11T14:25:24.348 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-11T14:25:24.386 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-11T14:25:24.386 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-09-11T14:25:24.386 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-11T14:25:24.420 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-11T14:25:24.420 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-09-11T14:25:24.420 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:cfc208b3:::3:head 2024-09-11T14:25:24.450 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-11T14:25:24.450 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-09-11T14:25:24.450 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:d83876eb:::4:head 2024-09-11T14:25:24.471 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:d83876eb:::4:head -> 4 2024-09-11T14:25:24.471 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-09-11T14:25:24.471 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-11T14:25:24.491 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-11T14:25:24.492 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-09-11T14:25:24.492 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:e960b815:::9:head 2024-09-11T14:25:24.504 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:e960b815:::9:head -> 9 2024-09-11T14:25:24.504 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-09-11T14:25:24.504 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:f905c69b:::2:head 2024-09-11T14:25:24.508 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:f905c69b:::2:head -> 2 2024-09-11T14:25:24.508 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:566253c9:::13:head 2024-09-11T14:25:24.508 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-09-11T14:25:24.604 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:566253c9:::13:head -> 13 2024-09-11T14:25:24.605 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=13 expected=13 2024-09-11T14:25:24.605 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:02547ec2:::1:head 2024-09-11T14:25:24.605 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-09-11T14:25:24.746 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:02547ec2:::1:head -> 1 2024-09-11T14:25:24.747 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=1 expected=1 2024-09-11T14:25:24.747 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-11T14:25:24.747 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-09-11T14:25:24.784 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-11T14:25:24.784 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=8 expected=8 2024-09-11T14:25:24.785 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:b29083e3:::5:head 2024-09-11T14:25:24.785 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-09-11T14:25:24.827 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:b29083e3:::5:head -> 5 2024-09-11T14:25:24.827 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=5 expected=5 2024-09-11T14:25:24.827 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:d83876eb:::4:head 2024-09-11T14:25:24.827 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-09-11T14:25:24.848 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:d83876eb:::4:head -> 4 2024-09-11T14:25:24.848 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=4 expected=4 2024-09-11T14:25:24.848 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:cfc208b3:::3:head 2024-09-11T14:25:24.848 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-09-11T14:25:24.877 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-11T14:25:24.877 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=3 expected=3 2024-09-11T14:25:24.877 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-11T14:25:24.877 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-09-11T14:25:24.911 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-11T14:25:24.911 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=6 expected=6 2024-09-11T14:25:24.911 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:52ea6a34:::10:head 2024-09-11T14:25:24.912 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-09-11T14:25:25.007 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-11T14:25:25.007 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=10 expected=10 2024-09-11T14:25:25.007 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:f905c69b:::2:head 2024-09-11T14:25:25.007 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-09-11T14:25:25.011 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:f905c69b:::2:head -> 2 2024-09-11T14:25:25.011 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=2 expected=2 2024-09-11T14:25:25.011 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:e960b815:::9:head 2024-09-11T14:25:25.011 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-09-11T14:25:25.023 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:e960b815:::9:head -> 9 2024-09-11T14:25:25.023 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=9 expected=9 2024-09-11T14:25:25.023 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-11T14:25:25.023 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-09-11T14:25:25.044 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-11T14:25:25.044 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=12 expected=12 2024-09-11T14:25:25.044 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-11T14:25:25.044 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-09-11T14:25:25.137 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-11T14:25:25.137 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=7 expected=7 2024-09-11T14:25:25.137 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:89d3ae78:::11:head 2024-09-11T14:25:25.137 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-09-11T14:25:25.202 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-11T14:25:25.203 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=11 expected=11 2024-09-11T14:25:25.203 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:863748b0:::15:head 2024-09-11T14:25:25.203 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-09-11T14:25:25.271 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:863748b0:::15:head -> 15 2024-09-11T14:25:25.272 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=15 expected=15 2024-09-11T14:25:25.272 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:6cac518f:::0:head 2024-09-11T14:25:25.272 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-09-11T14:25:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:6cac518f:::0:head -> 0 2024-09-11T14:25:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=0 expected=0 2024-09-11T14:25:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:62a1935d:::14:head 2024-09-11T14:25:25.354 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-09-11T14:25:25.442 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:62a1935d:::14:head -> 14 2024-09-11T14:25:25.442 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=14 expected=14 2024-09-11T14:25:25.827 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjectsCursor (2983 ms) 2024-09-11T14:25:25.828 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-09-11T14:25:26.668 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.EnumerateObjects (840 ms) 2024-09-11T14:25:26.668 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-11T14:25:26.948 INFO:tasks.workunit.client.0.smithi046.stdout:split 0/5 -> MIN 76:33333333::::head 2024-09-11T14:25:26.979 INFO:tasks.workunit.client.0.smithi046.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-09-11T14:25:27.010 INFO:tasks.workunit.client.0.smithi046.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-09-11T14:25:27.046 INFO:tasks.workunit.client.0.smithi046.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-09-11T14:25:27.084 INFO:tasks.workunit.client.0.smithi046.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-09-11T14:25:27.501 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (832 ms) 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosList (7651 ms total) 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosListEC 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:70: Skipped 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:84: Skipped 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:96: Skipped 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:84: Skipped 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:96: Skipped 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:84: Skipped 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:96: Skipped 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:78: Skipped 2024-09-11T14:25:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:27.865 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-09-11T14:25:27.865 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:27.865 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosListNP 2024-09-11T14:25:27.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-09-11T14:25:30.877 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosListNP.ListObjectsError (3015 ms) 2024-09-11T14:25:30.877 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosListNP (3015 ms total) 2024-09-11T14:25:30.877 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:30.877 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:30.877 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 11 tests from 3 test suites ran. (12564 ms total) 2024-09-11T14:25:30.877 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-09-11T14:25:30.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 3 tests, listed below: 2024-09-11T14:25:30.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-09-11T14:25:30.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-09-11T14:25:30.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-09-11T14:25:30.880 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:25:30.880 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:25:30.880 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_lock 2024-09-11T14:25:30.903 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:25:30.903 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-11T14:25:30.903 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:30.903 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLock 2024-09-11T14:25:32.884 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-09-11T14:25:33.158 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockExclusive (273 ms) 2024-09-11T14:25:33.158 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockShared 2024-09-11T14:25:33.255 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockShared (98 ms) 2024-09-11T14:25:33.256 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-09-11T14:25:34.338 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1083 ms) 2024-09-11T14:25:34.338 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-09-11T14:25:35.399 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockSharedDur (1061 ms) 2024-09-11T14:25:35.399 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-09-11T14:25:35.460 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockMayRenew (60 ms) 2024-09-11T14:25:35.460 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.Unlock 2024-09-11T14:25:35.526 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.Unlock (67 ms) 2024-09-11T14:25:35.526 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.ListLockers 2024-09-11T14:25:35.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.ListLockers (79 ms) 2024-09-11T14:25:35.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.BreakLock 2024-09-11T14:25:35.651 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.BreakLock (45 ms) 2024-09-11T14:25:35.896 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLock (2766 ms total) 2024-09-11T14:25:35.896 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:35.896 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockEC 2024-09-11T14:25:35.896 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:25:35.896 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.897 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-09-11T14:25:35.898 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:35.899 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockEC (1 ms total) 2024-09-11T14:25:35.900 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 16 tests from 2 test suites ran. (4991 ms total) 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-09-11T14:25:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-09-11T14:25:35.902 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-09-11T14:25:35.902 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:25:35.902 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:25:35.902 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_lock_pp 2024-09-11T14:25:35.920 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:25:35.920 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-11T14:25:35.921 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:35.921 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockPP 2024-09-11T14:25:35.921 INFO:tasks.workunit.client.0.smithi046.stdout:seed 30842 2024-09-11T14:25:37.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-11T14:25:38.269 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (368 ms) 2024-09-11T14:25:38.269 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-09-11T14:25:38.307 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockSharedPP (39 ms) 2024-09-11T14:25:38.308 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-11T14:25:39.360 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1053 ms) 2024-09-11T14:25:39.361 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-11T14:25:40.430 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1069 ms) 2024-09-11T14:25:40.430 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-11T14:25:40.492 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (62 ms) 2024-09-11T14:25:40.492 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-09-11T14:25:40.553 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.UnlockPP (61 ms) 2024-09-11T14:25:40.553 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-09-11T14:25:40.628 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.ListLockersPP (75 ms) 2024-09-11T14:25:40.628 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-09-11T14:25:40.671 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.BreakLockPP (43 ms) 2024-09-11T14:25:40.911 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockPP (2771 ms total) 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockECPP 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-09-11T14:25:40.912 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-11T14:25:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-09-11T14:25:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-11T14:25:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.913 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:40.914 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.915 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-09-11T14:25:40.916 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 16 tests from 2 test suites ran. (4989 ms total) 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-09-11T14:25:40.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-09-11T14:25:40.918 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:25:40.918 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:25:40.918 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_misc 2024-09-11T14:25:40.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:40.946+0000 7fed43a516c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:40.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:40.946+0000 7fed43a516c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:40.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:40.946+0000 7fed43a516c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:25:40.949 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 12 tests from 4 test suites. 2024-09-11T14:25:40.949 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:25:40.949 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-11T14:25:40.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-09-11T14:25:40.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-11T14:25:40.949 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-11T14:25:40.949 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:40.949 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-09-11T14:25:40.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-11T14:25:41.020 INFO:tasks.workunit.client.0.smithi046.stderr:unable to get monitor info from DNS SRV with service name: 2024-09-11T14:25:41.018+0000 7fed43a516c0 -1 failed for service _ceph-mon._tcp 2024-09-11T14:25:41.020 INFO:tasks.workunit.client.0.smithi046.stderr:ceph-mon 2024-09-11T14:25:41.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:25:41.018+0000 7fed43a516c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-11T14:25:41.020 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (72 ms) 2024-09-11T14:25:41.020 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-11T14:25:46.033 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5013 ms) 2024-09-11T14:25:46.033 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5085 ms total) 2024-09-11T14:25:46.033 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:46.033 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscPool 2024-09-11T14:25:46.033 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-11T14:25:47.844 INFO:tasks.workunit.client.0.smithi046.stdout:started 0x7fed08005de0 2024-09-11T14:25:48.844 INFO:tasks.workunit.client.0.smithi046.stdout:started 0x11de480 2024-09-11T14:25:48.845 INFO:tasks.workunit.client.0.smithi046.stdout: started 2 aios 2024-09-11T14:25:48.845 INFO:tasks.workunit.client.0.smithi046.stdout:waiting 0x7fed08005de0 2024-09-11T14:25:48.845 INFO:tasks.workunit.client.0.smithi046.stdout:waiting 0x11de480 2024-09-11T14:25:48.849 INFO:tasks.workunit.client.0.smithi046.stdout:done. 2024-09-11T14:25:50.863 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (4829 ms) 2024-09-11T14:25:50.863 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscPool (4829 ms total) 2024-09-11T14:25:50.863 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:25:50.863 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosMisc 2024-09-11T14:25:52.870 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-09-11T14:25:52.870 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-11T14:25:52.870 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.Exec 2024-09-11T14:25:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.Exec (329 ms) 2024-09-11T14:25:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-09-11T14:25:53.293 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.WriteSame (95 ms) 2024-09-11T14:25:53.293 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-09-11T14:25:53.324 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.CmpExt (31 ms) 2024-09-11T14:25:53.324 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.Applications 2024-09-11T14:25:57.848 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.Applications (4523 ms) 2024-09-11T14:25:57.848 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-09-11T14:25:57.848 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-11T14:25:57.848 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-09-11T14:25:57.848 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-11T14:25:57.848 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-09-11T14:26:26.349 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.ShutdownRace (28501 ms) 2024-09-11T14:26:26.866 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosMisc (33479 ms total) 2024-09-11T14:26:26.866 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:26:26.866 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:26:26.866 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 12 tests from 4 test suites ran. (45917 ms total) 2024-09-11T14:26:26.866 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 12 tests. 2024-09-11T14:26:26.884 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:26:26.884 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:26:26.884 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_misc_pp 2024-09-11T14:26:26.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:26:26.930+0000 7fe401e48840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:26.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:26:26.931+0000 7fe401e48840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:26.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:26:26.931+0000 7fe401e48840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:26:26.933 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 31 tests from 7 test suites. 2024-09-11T14:26:26.933 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:26:26.933 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-11T14:26:26.933 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-09-11T14:26:26.933 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-11T14:26:26.933 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-11T14:26:26.933 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:26:26.933 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosMiscPP 2024-09-11T14:26:26.933 INFO:tasks.workunit.client.0.smithi046.stdout:seed 92507 2024-09-11T14:26:28.875 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-11T14:26:28.875 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-09-11T14:26:28.875 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-09-11T14:26:29.379 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.LongNamePP (504 ms) 2024-09-11T14:26:29.379 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-11T14:26:29.379 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:53: Skipped 2024-09-11T14:26:29.379 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:26:29.379 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-09-11T14:26:29.380 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-11T14:26:29.462 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (84 ms) 2024-09-11T14:26:29.463 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-11T14:26:29.532 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (70 ms) 2024-09-11T14:26:29.533 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-09-11T14:26:29.555 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.ExecPP (23 ms) 2024-09-11T14:26:29.555 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-11T14:26:29.578 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (23 ms) 2024-09-11T14:26:29.578 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-09-11T14:26:29.615 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.Operate1PP (37 ms) 2024-09-11T14:26:29.616 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-09-11T14:26:29.640 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.Operate2PP (25 ms) 2024-09-11T14:26:29.640 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-11T14:26:29.703 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (63 ms) 2024-09-11T14:26:29.703 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-11T14:26:29.728 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (25 ms) 2024-09-11T14:26:29.729 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-11T14:26:29.762 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (34 ms) 2024-09-11T14:26:29.763 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-11T14:26:29.832 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (69 ms) 2024-09-11T14:26:29.832 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-11T14:26:29.849 INFO:tasks.workunit.client.0.smithi046.stdout:osd_max_attr_size = 0 2024-09-11T14:26:29.849 INFO:tasks.workunit.client.0.smithi046.stdout:osd_max_attr_size == 0; skipping test 2024-09-11T14:26:55.101 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (25269 ms) 2024-09-11T14:26:55.101 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-09-11T14:26:55.101 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:387: Skipped 2024-09-11T14:26:55.102 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:26:55.102 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-09-11T14:26:55.102 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-11T14:26:55.102 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:550: Skipped 2024-09-11T14:26:55.102 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:26:55.102 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-09-11T14:26:55.102 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-11T14:26:55.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (61 ms) 2024-09-11T14:26:55.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-11T14:26:55.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (32 ms) 2024-09-11T14:26:55.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-09-11T14:26:59.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.Applications (4671 ms) 2024-09-11T14:26:59.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-11T14:26:59.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-11T14:26:59.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-11T14:26:59.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-11T14:26:59.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-09-11T14:26:59.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-11T14:27:00.872 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosMiscPP (30990 ms total) 2024-09-11T14:27:00.872 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:00.872 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-09-11T14:27:00.872 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:477: Skipped 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:499: Skipped 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:505: Skipped 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/misc_cxx.cc:492: Skipped 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (1 ms total) 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:00.873 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-11T14:27:02.881 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-09-11T14:27:03.249 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/0.Subset (368 ms) 2024-09-11T14:27:03.250 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-09-11T14:27:03.306 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/0.Chunked (56 ms) 2024-09-11T14:27:03.882 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/0 (424 ms total) 2024-09-11T14:27:03.883 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:03.883 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-11T14:27:05.895 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-09-11T14:27:06.257 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/1.Subset (361 ms) 2024-09-11T14:27:06.257 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-09-11T14:27:06.291 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/1.Chunked (34 ms) 2024-09-11T14:27:06.861 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/1 (395 ms total) 2024-09-11T14:27:06.861 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:06.861 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-11T14:27:08.902 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-09-11T14:27:09.263 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/2.Subset (361 ms) 2024-09-11T14:27:09.264 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-09-11T14:27:09.292 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/2.Chunked (29 ms) 2024-09-11T14:27:09.907 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/2 (390 ms total) 2024-09-11T14:27:09.907 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:09.907 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscECPP 2024-09-11T14:27:09.907 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:09.908 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:27:09.909 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 31 tests from 7 test suites ran. (42974 ms total) 2024-09-11T14:27:09.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 26 tests. 2024-09-11T14:27:09.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-11T14:27:09.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-09-11T14:27:09.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-09-11T14:27:09.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-09-11T14:27:09.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-11T14:27:09.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-09-11T14:27:09.911 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:27:09.911 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:27:09.911 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_tier_pp 2024-09-11T14:27:09.955 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:27:09.954+0000 7f24f73289c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:09.956 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:27:09.954+0000 7f24f73289c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:09.956 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:27:09.954+0000 7f24f73289c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:27:09.956 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 77 tests from 4 test suites. 2024-09-11T14:27:09.956 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:27:09.956 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosTierPP 2024-09-11T14:27:09.956 INFO:tasks.workunit.client.0.smithi046.stdout:seed 92593 2024-09-11T14:27:11.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-09-11T14:27:11.916 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:287: Skipped 2024-09-11T14:27:11.916 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:11.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-09-11T14:27:11.916 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-11T14:27:11.916 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:2182: Skipped 2024-09-11T14:27:11.916 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:11.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-09-11T14:27:11.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-09-11T14:27:11.917 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:2561: Skipped 2024-09-11T14:27:11.917 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:11.917 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-09-11T14:27:12.919 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-09-11T14:27:12.920 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:12.920 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-09-11T14:27:14.938 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-11T14:27:14.938 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.938 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.938 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.939 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.939 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-09-11T14:27:14.939 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-11T14:27:14.939 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.939 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.939 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.939 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-09-11T14:27:14.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-11T14:27:14.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-09-11T14:27:14.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-11T14:27:14.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-09-11T14:27:14.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-11T14:27:14.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-09-11T14:27:14.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-11T14:27:14.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-09-11T14:27:14.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-11T14:27:14.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-09-11T14:27:14.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-11T14:27:14.945 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.945 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.946 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.947 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.947 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-09-11T14:27:14.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-11T14:27:14.947 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.947 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.947 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.947 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-09-11T14:27:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-11T14:27:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-09-11T14:27:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-11T14:27:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.949 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.949 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.949 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-09-11T14:27:14.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-11T14:27:14.949 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.949 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-11T14:27:14.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.951 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.951 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.951 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-09-11T14:27:14.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-11T14:27:14.951 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.951 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.951 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.951 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-09-11T14:27:14.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-11T14:27:14.952 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.952 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.952 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.952 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-09-11T14:27:14.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-11T14:27:14.952 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-09-11T14:27:14.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-11T14:27:14.954 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.954 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.954 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.954 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-09-11T14:27:14.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-11T14:27:14.954 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.954 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-09-11T14:27:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-11T14:27:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-09-11T14:27:14.956 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-11T14:27:14.956 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.956 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.956 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.956 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.956 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-09-11T14:27:14.956 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-11T14:27:14.956 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.957 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.957 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.957 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.957 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-09-11T14:27:14.957 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-11T14:27:14.957 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.957 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.957 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.957 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.958 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-09-11T14:27:14.958 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-11T14:27:14.958 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.958 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.958 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.958 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.958 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-09-11T14:27:14.958 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-11T14:27:14.958 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.959 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.959 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.959 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.959 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-09-11T14:27:14.959 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-11T14:27:14.959 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.959 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.959 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.959 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.960 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-09-11T14:27:14.960 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-11T14:27:14.960 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.960 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.960 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.960 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.960 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-09-11T14:27:14.961 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-11T14:27:14.961 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.961 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.961 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.961 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.961 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-09-11T14:27:14.962 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-11T14:27:14.962 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.962 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.962 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.962 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.962 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-09-11T14:27:14.962 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.963 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.964 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-09-11T14:27:14.964 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-11T14:27:14.964 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.964 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.964 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.964 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.964 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-09-11T14:27:14.965 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-11T14:27:14.965 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.965 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.965 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.965 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.965 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (1 ms) 2024-09-11T14:27:14.965 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-11T14:27:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-09-11T14:27:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-11T14:27:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-09-11T14:27:14.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-11T14:27:14.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-09-11T14:27:14.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-11T14:27:14.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-09-11T14:27:14.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.971 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-11T14:27:14.972 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-11T14:27:14.973 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.973 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-11T14:27:14.973 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:14.973 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-09-11T14:27:15.936 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-09-11T14:27:15.936 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosTierECPP 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-11T14:27:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6267: Skipped 2024-09-11T14:27:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-09-11T14:27:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-11T14:27:15.944 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-11T14:27:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.946 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-11T14:27:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/tier_cxx.cc:6272: Skipped 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 77 tests from 4 test suites ran. (5975 ms total) 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 0 tests. 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 77 tests, listed below: 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-09-11T14:27:15.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-11T14:27:15.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-11T14:27:15.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-11T14:27:15.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-09-11T14:27:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-11T14:27:15.955 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-09-11T14:27:15.956 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-11T14:27:15.956 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-11T14:27:15.956 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-11T14:27:15.956 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-11T14:27:15.956 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:27:15.956 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:27:15.956 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_pool 2024-09-11T14:27:15.957 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:27:15.957 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-11T14:27:15.957 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:27:15.957 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from LibRadosPools 2024-09-11T14:27:15.958 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolList 2024-09-11T14:27:18.868 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolList (2911 ms) 2024-09-11T14:27:18.869 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-09-11T14:27:21.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolLookup (3009 ms) 2024-09-11T14:27:21.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-09-11T14:27:24.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolLookup2 (3021 ms) 2024-09-11T14:27:24.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-11T14:27:27.868 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (2970 ms) 2024-09-11T14:27:27.868 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-11T14:27:30.882 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3013 ms) 2024-09-11T14:27:30.882 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-09-11T14:27:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolDelete (5020 ms) 2024-09-11T14:27:35.901 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-09-11T14:27:40.883 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolCreateDelete (4982 ms) 2024-09-11T14:27:40.884 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-11T14:27:45.903 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (5019 ms) 2024-09-11T14:27:45.903 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-11T14:27:45.903 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/pool.cc:139: Skipped 2024-09-11T14:27:45.903 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:27:45.903 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (1 ms) 2024-09-11T14:27:45.904 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from LibRadosPools (29946 ms total) 2024-09-11T14:27:45.904 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:45.904 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:27:45.904 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 9 tests from 1 test suite ran. (29946 ms total) 2024-09-11T14:27:45.904 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-09-11T14:27:45.904 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-11T14:27:45.904 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-09-11T14:27:45.905 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:27:45.906 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:27:45.906 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_snapshots 2024-09-11T14:27:45.929 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:27:45.929 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 13 tests from 4 test suites. 2024-09-11T14:27:45.929 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:27:45.929 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshots 2024-09-11T14:27:47.872 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-09-11T14:27:49.879 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshots.SnapList (2007 ms) 2024-09-11T14:27:49.879 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-09-11T14:27:51.883 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2005 ms) 2024-09-11T14:27:51.884 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-09-11T14:27:53.894 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshots.Rollback (2011 ms) 2024-09-11T14:27:53.895 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-09-11T14:27:55.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2006 ms) 2024-09-11T14:27:56.875 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshots (8029 ms total) 2024-09-11T14:27:56.875 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:27:56.875 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-11T14:27:58.915 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-11T14:28:03.004 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4089 ms) 2024-09-11T14:28:03.004 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-11T14:28:06.956 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (3953 ms) 2024-09-11T14:28:06.957 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-11T14:28:12.043 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5086 ms) 2024-09-11T14:28:12.971 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13128 ms total) 2024-09-11T14:28:12.971 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-11T14:28:12.972 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-11T14:28:12.973 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.974 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:28:12.975 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 13 tests from 4 test suites ran. (27041 ms total) 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 7 tests. 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 6 tests, listed below: 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-11T14:28:12.976 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-11T14:28:12.977 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:28:12.977 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:28:12.977 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-11T14:28:12.999 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:28:13.000 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 21 tests from 5 test suites. 2024-09-11T14:28:13.000 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:28:13.000 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-09-11T14:28:13.000 INFO:tasks.workunit.client.0.smithi046.stdout:seed 92851 2024-09-11T14:28:14.980 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-11T14:28:16.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (1899 ms) 2024-09-11T14:28:16.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-11T14:28:18.883 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2004 ms) 2024-09-11T14:28:18.883 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-11T14:28:20.893 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2011 ms) 2024-09-11T14:28:20.894 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-11T14:28:22.903 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2010 ms) 2024-09-11T14:28:22.903 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-11T14:28:26.881 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3977 ms) 2024-09-11T14:28:27.884 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosSnapshotsPP (11901 ms total) 2024-09-11T14:28:27.884 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:28:27.884 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-11T14:28:29.892 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-11T14:28:33.989 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4098 ms) 2024-09-11T14:28:33.989 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-11T14:28:37.884 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3895 ms) 2024-09-11T14:28:37.885 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-11T14:28:43.908 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6024 ms) 2024-09-11T14:28:43.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-11T14:28:47.886 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3978 ms) 2024-09-11T14:28:47.887 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-11T14:28:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2103 ms) 2024-09-11T14:28:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-11T14:28:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-11T14:28:49.990 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:28:49.990 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-09-11T14:28:49.990 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-11T14:28:51.905 INFO:tasks.workunit.client.0.smithi046.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi046-92851-7 2024-09-11T14:28:52.909 INFO:tasks.workunit.client.0.smithi046.stdout:waiting for snaps to purge 2024-09-11T14:29:07.948 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17958 ms) 2024-09-11T14:29:08.902 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (38056 ms total) 2024-09-11T14:29:08.902 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:08.902 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-11T14:29:08.902 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-11T14:29:08.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (6 ms) 2024-09-11T14:29:08.909 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-11T14:29:13.965 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5055 ms) 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5061 ms total) 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.966 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-09-11T14:29:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-11T14:29:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-09-11T14:29:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-11T14:29:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:13.969 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:29:13.970 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 21 tests from 5 test suites ran. (60964 ms total) 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 13 tests. 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-11T14:29:13.971 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-11T14:29:13.972 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:29:13.972 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:29:13.972 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_stat 2024-09-11T14:29:13.997 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:29:13.998 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-11T14:29:13.998 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:29:13.998 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosStat 2024-09-11T14:29:15.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.Stat 2024-09-11T14:29:16.284 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.Stat (350 ms) 2024-09-11T14:29:16.284 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.Stat2 2024-09-11T14:29:16.324 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.Stat2 (40 ms) 2024-09-11T14:29:16.325 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.StatNS 2024-09-11T14:29:16.409 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.StatNS (85 ms) 2024-09-11T14:29:16.410 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-09-11T14:29:16.410 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.ClusterStat (0 ms) 2024-09-11T14:29:16.410 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.PoolStat 2024-09-11T14:29:16.430 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.PoolStat (20 ms) 2024-09-11T14:29:16.939 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosStat (495 ms total) 2024-09-11T14:29:16.939 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:16.939 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosStatEC 2024-09-11T14:29:16.939 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:29:16.939 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.939 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatEC.Stat 2024-09-11T14:29:16.939 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:29:16.940 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:16.941 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:29:16.942 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 9 tests from 2 test suites ran. (2941 ms total) 2024-09-11T14:29:16.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 5 tests. 2024-09-11T14:29:16.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-11T14:29:16.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-09-11T14:29:16.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-09-11T14:29:16.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-09-11T14:29:16.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-09-11T14:29:16.943 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:29:16.943 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:29:16.943 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_stat_pp 2024-09-11T14:29:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:29:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-11T14:29:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:29:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosStatPP 2024-09-11T14:29:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:seed 92986 2024-09-11T14:29:18.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-09-11T14:29:19.266 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.StatPP (319 ms) 2024-09-11T14:29:19.266 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-11T14:29:19.420 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (154 ms) 2024-09-11T14:29:19.421 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-11T14:29:19.421 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-09-11T14:29:19.421 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-09-11T14:29:19.441 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.PoolStatPP (21 ms) 2024-09-11T14:29:19.441 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-09-11T14:29:19.522 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.StatPPNS (81 ms) 2024-09-11T14:29:19.949 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosStatPP (575 ms total) 2024-09-11T14:29:19.949 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosStatECPP 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.950 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:19.951 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 9 tests from 2 test suites ran. (2987 ms total) 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 5 tests. 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-09-11T14:29:19.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-09-11T14:29:19.953 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:29:19.953 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:29:19.953 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_watch_notify 2024-09-11T14:29:19.973 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:29:19.973 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-11T14:29:19.973 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:29:19.973 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-09-11T14:29:21.897 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-11T14:29:22.287 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify_test_cb 2024-09-11T14:29:22.316 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (419 ms) 2024-09-11T14:29:22.316 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-11T14:29:22.368 INFO:tasks.workunit.client.0.smithi046.stdout:waiting up to 300 for disconnect notification ... 2024-09-11T14:29:25.030 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_errcb cookie 13497296 err -107 2024-09-11T14:29:25.381 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3065 ms) 2024-09-11T14:29:25.381 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-11T14:29:25.455 INFO:tasks.workunit.client.0.smithi046.stdout:waiting up to 300 for disconnect notification ... 2024-09-11T14:29:30.030 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_errcb cookie 13497216 err -107 2024-09-11T14:29:30.468 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5086 ms) 2024-09-11T14:29:30.468 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-11T14:29:30.524 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15518 notify_id 1752346656768 cookie 13497216 2024-09-11T14:29:30.561 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (92 ms) 2024-09-11T14:29:30.561 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-11T14:29:30.601 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15518 notify_id 1752346656769 cookie 13497168 2024-09-11T14:29:30.625 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (66 ms) 2024-09-11T14:29:30.626 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-09-11T14:29:30.668 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15518 notify_id 1752346656770 cookie 13497168 2024-09-11T14:29:30.696 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.AioNotify (71 ms) 2024-09-11T14:29:30.696 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-11T14:29:30.755 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15518 notify_id 1752346656768 cookie 13497168 2024-09-11T14:29:30.755 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15518 notify_id 1752346656768 cookie 14955088 2024-09-11T14:29:30.793 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (97 ms) 2024-09-11T14:29:30.794 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-11T14:29:30.833 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15518 notify_id 1752346656771 cookie 14955088 2024-09-11T14:29:33.833 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15518 notify_id 1752346656772 cookie 14955088 2024-09-11T14:29:33.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3071 ms) 2024-09-11T14:29:33.865 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-11T14:29:33.908 INFO:tasks.workunit.client.0.smithi046.stdout:waiting up to 1024 for osd to time us out ... 2024-09-11T14:29:37.923 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_errcb cookie 14955088 err -107 2024-09-11T14:29:38.948 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15518 notify_id 1752346656769 cookie 14955088 2024-09-11T14:29:38.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5107 ms) 2024-09-11T14:29:38.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-11T14:29:39.032 INFO:tasks.workunit.client.0.smithi046.stdout:waiting up to 30 for disconnect notification ... 2024-09-11T14:29:40.033 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_errcb cookie 14949984 err -107 2024-09-11T14:29:41.044 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2073 ms) 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from LibRadosWatchNotify (19147 ms total) 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:168: Skipped 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:182: Skipped 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:196: Skipped 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.907 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-09-11T14:29:41.908 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/TestCase.cc:176: Skipped 2024-09-11T14:29:41.908 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.908 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-09-11T14:29:41.908 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:41.908 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:29:41.908 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 11 tests from 2 test suites ran. (21934 ms total) 2024-09-11T14:29:41.908 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 10 tests. 2024-09-11T14:29:41.908 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-11T14:29:41.908 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-09-11T14:29:41.909 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:29:41.909 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:29:41.909 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-11T14:29:41.935 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:29:41.935 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-11T14:29:41.935 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:29:41.935 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-11T14:29:41.935 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-11T14:29:41.935 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.935 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-11T14:29:41.935 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-09-11T14:29:41.936 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4884-ge7a65bf9/rpm/el9/BUILD/ceph-19.3.0-4884-ge7a65bf9/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-11T14:29:41.937 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-09-11T14:29:41.937 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-09-11T14:29:41.937 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:41.937 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-11T14:29:43.920 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-11T14:29:44.315 INFO:tasks.workunit.client.0.smithi046.stdout:notify 2024-09-11T14:29:44.355 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (434 ms) 2024-09-11T14:29:44.355 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-11T14:29:44.414 INFO:tasks.workunit.client.0.smithi046.stdout:notify 2024-09-11T14:29:44.434 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (79 ms) 2024-09-11T14:29:44.434 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-11T14:29:44.481 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (48 ms) 2024-09-11T14:29:44.482 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-11T14:29:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (52 ms) 2024-09-11T14:29:44.533 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-11T14:29:44.574 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11425664 notify_id 1765231558658 notifier_gid 15521 2024-09-11T14:29:44.592 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (59 ms) 2024-09-11T14:29:44.592 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-11T14:29:44.638 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11428928 notify_id 1765231558661 notifier_gid 15521 2024-09-11T14:29:44.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (65 ms) 2024-09-11T14:29:44.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-11T14:29:44.702 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11428928 notify_id 1765231558659 notifier_gid 15521 2024-09-11T14:29:44.720 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (63 ms) 2024-09-11T14:29:44.720 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-11T14:29:44.762 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11445232 notify_id 1765231558662 notifier_gid 15521 2024-09-11T14:29:44.780 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (59 ms) 2024-09-11T14:29:44.780 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-11T14:29:44.828 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11448800 notify_id 1765231558657 notifier_gid 15521 2024-09-11T14:29:44.844 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (65 ms) 2024-09-11T14:29:44.844 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-11T14:29:44.888 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11448800 notify_id 1765231558659 notifier_gid 15521 2024-09-11T14:29:44.905 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (61 ms) 2024-09-11T14:29:44.906 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-11T14:29:44.981 INFO:tasks.workunit.client.0.smithi046.stdout: trying... 2024-09-11T14:29:44.984 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11448800 notify_id 1765231558663 notifier_gid 15521 2024-09-11T14:29:45.983 INFO:tasks.workunit.client.0.smithi046.stdout: timed out 2024-09-11T14:29:46.003 INFO:tasks.workunit.client.0.smithi046.stdout: flushing 2024-09-11T14:29:47.985 INFO:tasks.workunit.client.0.smithi046.stdout: flushed 2024-09-11T14:29:47.985 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3079 ms) 2024-09-11T14:29:47.985 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-11T14:29:48.039 INFO:tasks.workunit.client.0.smithi046.stdout: trying... 2024-09-11T14:29:48.043 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11462368 notify_id 1765231558664 notifier_gid 15521 2024-09-11T14:29:49.041 INFO:tasks.workunit.client.0.smithi046.stdout: timed out 2024-09-11T14:29:49.062 INFO:tasks.workunit.client.0.smithi046.stdout: flushing 2024-09-11T14:29:51.044 INFO:tasks.workunit.client.0.smithi046.stdout: flushed 2024-09-11T14:29:51.044 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3059 ms) 2024-09-11T14:29:51.044 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-11T14:29:51.095 INFO:tasks.workunit.client.0.smithi046.stdout:List watches 2024-09-11T14:29:51.095 INFO:tasks.workunit.client.0.smithi046.stdout:notify2 2024-09-11T14:29:51.099 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11448800 notify_id 1765231558660 notifier_gid 15521 2024-09-11T14:29:54.106 INFO:tasks.workunit.client.0.smithi046.stdout:notify2 done 2024-09-11T14:29:54.106 INFO:tasks.workunit.client.0.smithi046.stdout:watch_check 2024-09-11T14:29:54.106 INFO:tasks.workunit.client.0.smithi046.stdout:unwatch2 2024-09-11T14:29:54.126 INFO:tasks.workunit.client.0.smithi046.stdout: flushing 2024-09-11T14:29:54.126 INFO:tasks.workunit.client.0.smithi046.stdout:done 2024-09-11T14:29:54.126 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3083 ms) 2024-09-11T14:29:54.126 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-11T14:29:54.174 INFO:tasks.workunit.client.0.smithi046.stdout:List watches 2024-09-11T14:29:54.174 INFO:tasks.workunit.client.0.smithi046.stdout:notify2 2024-09-11T14:29:54.178 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 11462368 notify_id 1769526525956 notifier_gid 15521 2024-09-11T14:29:57.184 INFO:tasks.workunit.client.0.smithi046.stdout:notify2 done 2024-09-11T14:29:57.185 INFO:tasks.workunit.client.0.smithi046.stdout:watch_check 2024-09-11T14:29:57.185 INFO:tasks.workunit.client.0.smithi046.stdout:unwatch2 2024-09-11T14:29:57.204 INFO:tasks.workunit.client.0.smithi046.stdout: flushing 2024-09-11T14:29:57.204 INFO:tasks.workunit.client.0.smithi046.stdout:done 2024-09-11T14:29:57.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3078 ms) 2024-09-11T14:29:57.541 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (13284 ms total) 2024-09-11T14:29:57.541 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:29:57.541 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:29:57.541 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 16 tests from 2 test suites ran. (15606 ms total) 2024-09-11T14:29:57.541 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 14 tests. 2024-09-11T14:29:57.541 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-11T14:29:57.541 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-11T14:29:57.541 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-11T14:29:57.544 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:29:57.544 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:29:57.544 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_cmd 2024-09-11T14:29:57.568 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:29:57.568 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:29:57.568 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:29:57.568 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosCmd 2024-09-11T14:29:57.568 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-09-11T14:29:57.628 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.MonDescribe (61 ms) 2024-09-11T14:29:57.628 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-09-11T14:29:57.710 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.OSDCmd (81 ms) 2024-09-11T14:29:57.710 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-09-11T14:30:00.557 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.PGCmd (2847 ms) 2024-09-11T14:30:00.557 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-09-11T14:30:00.604 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-09-11T14:29:59.547554+0000 mon.a [INF] from='client.? 172.21.15.46:0/1942482256' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi046-93044-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-11T14:30:01.552 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-09-11T14:30:00.603425+0000 client.admin [INF] onexx 2024-09-11T14:30:01.552 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-09-11T14:30:00.603617+0000 mon.a [INF] from='client.? 172.21.15.46:0/87878118' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-11T14:30:02.553 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-09-11T14:30:01.551537+0000 mon.a [INF] from='client.? 172.21.15.46:0/87878118' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-09-11T14:30:05.554 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-09-11T14:30:03.552878+0000 mon.a [INF] from='client.? 172.21.15.46:0/87878118' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-11T14:30:05.557 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-09-11T14:30:05.553636+0000 client.admin [INF] threexx 2024-09-11T14:30:05.557 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-09-11T14:30:05.553892+0000 mon.a [INF] from='client.? 172.21.15.46:0/87878118' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-11T14:30:09.564 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.WatchLog (9007 ms) 2024-09-11T14:30:09.564 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosCmd (11996 ms total) 2024-09-11T14:30:09.564 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:09.564 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:30:09.565 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 4 tests from 1 test suite ran. (11996 ms total) 2024-09-11T14:30:09.565 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 4 tests. 2024-09-11T14:30:09.566 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:30:09.566 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:30:09.567 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-11T14:30:09.589 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:30:09.589 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-11T14:30:09.589 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:30:09.589 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosCmd 2024-09-11T14:30:09.589 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-09-11T14:30:09.625 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.MonDescribePP (37 ms) 2024-09-11T14:30:09.625 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-09-11T14:30:09.662 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.OSDCmdPP (36 ms) 2024-09-11T14:30:09.662 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-09-11T14:30:12.583 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.PGCmdPP (2922 ms) 2024-09-11T14:30:12.584 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosCmd (2995 ms total) 2024-09-11T14:30:12.584 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:12.584 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:30:12.584 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 3 tests from 1 test suite ran. (2995 ms total) 2024-09-11T14:30:12.584 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 3 tests. 2024-09-11T14:30:12.585 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:30:12.586 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:30:12.586 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_service 2024-09-11T14:30:12.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:30:12.618+0000 7fca13831840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:12.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:30:12.618+0000 7fca13831840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:12.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:30:12.618+0000 7fca13831840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:12.620 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:30:12.620 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:30:12.620 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosService 2024-09-11T14:30:12.620 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-09-11T14:30:17.652 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosService.RegisterEarly (5033 ms) 2024-09-11T14:30:17.653 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosService.RegisterLate 2024-09-11T14:30:17.684 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosService.RegisterLate (31 ms) 2024-09-11T14:30:17.684 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosService.StatusFormat 2024-09-11T14:30:17.846 INFO:tasks.workunit.client.0.smithi046.stdout: cluster: 2024-09-11T14:30:17.846 INFO:tasks.workunit.client.0.smithi046.stdout: id: 1036f700-a934-4ca9-974c-2362e4adfb5d 2024-09-11T14:30:17.846 INFO:tasks.workunit.client.0.smithi046.stdout: health: HEALTH_WARN 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: 1 pool(s) do not have an application enabled 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: services: 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: mgr: x(active, since 10m) 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: laundry: 1 daemon active (1 hosts) 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: data: 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: pools: 3 pools, 41 pgs 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: objects: 5 objects, 577 KiB 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: usage: 26 MiB used, 199 GiB / 200 GiB avail 2024-09-11T14:30:17.847 INFO:tasks.workunit.client.0.smithi046.stdout: pgs: 41 active+clean 2024-09-11T14:30:17.848 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:17.848 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:19.877 INFO:tasks.workunit.client.0.smithi046.stdout: cluster: 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: id: 1036f700-a934-4ca9-974c-2362e4adfb5d 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: health: HEALTH_WARN 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: 1 pool(s) do not have an application enabled 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: services: 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: mgr: x(active, since 10m) 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:19.878 INFO:tasks.workunit.client.0.smithi046.stdout: data: 2024-09-11T14:30:19.879 INFO:tasks.workunit.client.0.smithi046.stdout: pools: 3 pools, 41 pgs 2024-09-11T14:30:19.879 INFO:tasks.workunit.client.0.smithi046.stdout: objects: 5 objects, 577 KiB 2024-09-11T14:30:19.879 INFO:tasks.workunit.client.0.smithi046.stdout: usage: 26 MiB used, 199 GiB / 200 GiB avail 2024-09-11T14:30:19.879 INFO:tasks.workunit.client.0.smithi046.stdout: pgs: 41 active+clean 2024-09-11T14:30:19.879 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:19.879 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:19.906 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosService.StatusFormat (2223 ms) 2024-09-11T14:30:19.906 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosService.Status 2024-09-11T14:30:39.937 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosService.Status (20031 ms) 2024-09-11T14:30:39.938 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosService (27318 ms total) 2024-09-11T14:30:39.938 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:30:39.938 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:30:39.938 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 4 tests from 1 test suite ran. (27318 ms total) 2024-09-11T14:30:39.938 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 4 tests. 2024-09-11T14:30:39.943 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:30:39.943 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:30:39.943 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_service_pp 2024-09-11T14:30:39.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:30:39.978+0000 7f4a58e70840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:39.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:30:39.978+0000 7f4a58e70840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:39.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:30:39.979+0000 7f4a58e70840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:30:39.981 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-11T14:30:39.981 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:30:39.981 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosServicePP 2024-09-11T14:30:39.981 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-09-11T14:30:45.011 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5030 ms) 2024-09-11T14:30:45.011 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-09-11T14:30:45.057 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosServicePP.RegisterLate (47 ms) 2024-09-11T14:30:45.057 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosServicePP.Status 2024-09-11T14:31:05.089 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosServicePP.Status (20031 ms) 2024-09-11T14:31:05.089 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosServicePP.Close 2024-09-11T14:31:05.089 INFO:tasks.workunit.client.0.smithi046.stdout:attempt 0 of 20 2024-09-11T14:31:10.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosServicePP.Close (5061 ms) 2024-09-11T14:31:10.150 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosServicePP (30169 ms total) 2024-09-11T14:31:10.150 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:31:10.150 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:31:10.150 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 4 tests from 1 test suite ran. (30169 ms total) 2024-09-11T14:31:10.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 4 tests. 2024-09-11T14:31:10.152 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:31:10.153 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:31:10.153 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-11T14:31:10.171 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:31:10.171 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 8 tests from 2 test suites. 2024-09-11T14:31:10.171 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:31:10.172 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibradosCWriteOps 2024-09-11T14:31:10.172 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-09-11T14:31:10.172 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-11T14:31:10.172 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-11T14:31:10.172 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:31:10.172 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-09-11T14:31:10.172 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-09-11T14:31:12.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.assertExists (2771 ms) 2024-09-11T14:31:12.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-11T14:31:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3012 ms) 2024-09-11T14:31:15.954 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-09-11T14:31:18.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3014 ms) 2024-09-11T14:31:18.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-09-11T14:31:21.980 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.Write (3012 ms) 2024-09-11T14:31:21.980 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-09-11T14:31:24.996 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.Exec (3016 ms) 2024-09-11T14:31:24.996 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-09-11T14:31:28.006 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3009 ms) 2024-09-11T14:31:28.006 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-09-11T14:31:41.938 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.CmpExt (13933 ms) 2024-09-11T14:31:41.939 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosCWriteOps (31767 ms total) 2024-09-11T14:31:41.939 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:31:41.939 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:31:41.939 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 8 tests from 2 test suites ran. (31767 ms total) 2024-09-11T14:31:41.939 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-09-11T14:31:41.942 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:31:41.942 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:31:41.942 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-11T14:31:41.963 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:31:41.963 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-11T14:31:41.963 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:31:41.963 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 17 tests from CReadOpsTest 2024-09-11T14:31:43.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-09-11T14:31:43.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-11T14:31:43.947 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-09-11T14:31:44.362 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.SetOpFlags (415 ms) 2024-09-11T14:31:44.363 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-09-11T14:31:44.410 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.AssertExists (47 ms) 2024-09-11T14:31:44.410 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-09-11T14:31:44.477 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.AssertVersion (68 ms) 2024-09-11T14:31:44.478 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-09-11T14:31:44.701 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.CmpXattr (223 ms) 2024-09-11T14:31:44.701 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Read 2024-09-11T14:31:44.774 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Read (74 ms) 2024-09-11T14:31:44.774 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Checksum 2024-09-11T14:31:44.839 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Checksum (65 ms) 2024-09-11T14:31:44.839 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-09-11T14:31:44.884 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.RWOrderedRead (44 ms) 2024-09-11T14:31:44.884 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-09-11T14:31:44.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.ShortRead (60 ms) 2024-09-11T14:31:44.944 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Exec 2024-09-11T14:31:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Exec (70 ms) 2024-09-11T14:31:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-09-11T14:31:45.068 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.ExecUserBuf (55 ms) 2024-09-11T14:31:45.068 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Stat 2024-09-11T14:31:45.123 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Stat (55 ms) 2024-09-11T14:31:45.123 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Stat2 2024-09-11T14:31:45.174 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Stat2 (50 ms) 2024-09-11T14:31:45.174 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Omap 2024-09-11T14:31:45.324 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Omap (151 ms) 2024-09-11T14:31:45.324 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-09-11T14:31:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.OmapNuls (132 ms) 2024-09-11T14:31:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-09-11T14:31:45.573 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.GetXattrs (116 ms) 2024-09-11T14:31:45.573 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-09-11T14:31:45.621 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.CmpExt (49 ms) 2024-09-11T14:31:45.952 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 17 tests from CReadOpsTest (1674 ms total) 2024-09-11T14:31:45.952 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:31:45.952 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:31:45.952 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 17 tests from 1 test suite ran. (3990 ms total) 2024-09-11T14:31:45.953 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 17 tests. 2024-09-11T14:31:45.955 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:31:45.955 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:31:45.955 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_list_parallel 2024-09-11T14:31:49.329 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[93725]: starting. 2024-09-11T14:31:49.329 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[93725]: creating pool ceph_test_rados_list_parallel.smithi046-93724 2024-09-11T14:31:49.329 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[93725]: created object 0... 2024-09-11T14:31:49.329 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[93725]: created object 25... 2024-09-11T14:31:49.330 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[93725]: created object 49... 2024-09-11T14:31:49.330 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[93725]: finishing. 2024-09-11T14:31:49.330 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[93725]: shutting down. 2024-09-11T14:31:49.512 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[93726]: starting. 2024-09-11T14:31:49.512 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[93726]: listing objects. 2024-09-11T14:31:49.512 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[93726]: listed object 0... 2024-09-11T14:31:49.512 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[93726]: listed object 25... 2024-09-11T14:31:49.512 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[93726]: saw 50 objects 2024-09-11T14:31:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[93726]: shutting down. 2024-09-11T14:31:50.421 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:50.421 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[93761]: starting. 2024-09-11T14:31:50.421 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[93761]: creating pool ceph_test_rados_list_parallel.smithi046-93724 2024-09-11T14:31:50.421 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[93761]: created object 0... 2024-09-11T14:31:50.421 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[93761]: created object 25... 2024-09-11T14:31:50.421 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[93761]: created object 49... 2024-09-11T14:31:50.422 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[93761]: finishing. 2024-09-11T14:31:50.422 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[93761]: shutting down. 2024-09-11T14:31:50.860 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:50.860 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[93762]: starting. 2024-09-11T14:31:50.860 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[93762]: listing objects. 2024-09-11T14:31:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[93762]: listed object 0... 2024-09-11T14:31:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[93762]: listed object 25... 2024-09-11T14:31:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[93762]: saw 43 objects 2024-09-11T14:31:50.861 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[93762]: shutting down. 2024-09-11T14:31:51.241 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:51.241 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[93763]: starting. 2024-09-11T14:31:51.241 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[93763]: removed 25 objects... 2024-09-11T14:31:51.241 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[93763]: removed half of the objects 2024-09-11T14:31:51.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[93763]: removed 50 objects... 2024-09-11T14:31:51.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[93763]: removed 50 objects 2024-09-11T14:31:51.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[93763]: shutting down. 2024-09-11T14:31:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[93812]: starting. 2024-09-11T14:31:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[93812]: creating pool ceph_test_rados_list_parallel.smithi046-93724 2024-09-11T14:31:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[93812]: created object 0... 2024-09-11T14:31:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[93812]: created object 25... 2024-09-11T14:31:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[93812]: created object 49... 2024-09-11T14:31:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[93812]: finishing. 2024-09-11T14:31:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[93812]: shutting down. 2024-09-11T14:31:52.706 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:52.706 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:52.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[93813]: starting. 2024-09-11T14:31:52.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[93813]: listing objects. 2024-09-11T14:31:52.707 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[93813]: listed object 0... 2024-09-11T14:31:52.707 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[93813]: listed object 25... 2024-09-11T14:31:52.707 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[93813]: listed object 50... 2024-09-11T14:31:52.707 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[93813]: saw 54 objects 2024-09-11T14:31:52.707 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[93813]: shutting down. 2024-09-11T14:31:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[93814]: starting. 2024-09-11T14:31:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[93814]: added 25 objects... 2024-09-11T14:31:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[93814]: added half of the objects 2024-09-11T14:31:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[93814]: added 50 objects... 2024-09-11T14:31:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[93814]: added 50 objects 2024-09-11T14:31:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[93814]: shutting down. 2024-09-11T14:31:54.109 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[93863]: starting. 2024-09-11T14:31:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[93863]: creating pool ceph_test_rados_list_parallel.smithi046-93724 2024-09-11T14:31:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[93863]: created object 0... 2024-09-11T14:31:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[93863]: created object 25... 2024-09-11T14:31:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[93863]: created object 49... 2024-09-11T14:31:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[93863]: finishing. 2024-09-11T14:31:54.110 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[93863]: shutting down. 2024-09-11T14:31:54.705 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:54.705 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:54.706 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:54.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[93864]: starting. 2024-09-11T14:31:54.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[93864]: listing objects. 2024-09-11T14:31:54.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[93864]: listed object 0... 2024-09-11T14:31:54.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[93864]: listed object 25... 2024-09-11T14:31:54.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[93864]: listed object 50... 2024-09-11T14:31:54.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[93864]: listed object 75... 2024-09-11T14:31:54.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[93864]: saw 99 objects 2024-09-11T14:31:54.706 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[93864]: shutting down. 2024-09-11T14:31:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[93867]: starting. 2024-09-11T14:31:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[93867]: removed 25 objects... 2024-09-11T14:31:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[93867]: removed half of the objects 2024-09-11T14:31:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[93867]: removed 50 objects... 2024-09-11T14:31:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[93867]: removed 50 objects 2024-09-11T14:31:55.262 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[93867]: shutting down. 2024-09-11T14:31:55.358 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:55.358 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:55.359 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:55.359 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[93865]: starting. 2024-09-11T14:31:55.359 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[93865]: added 25 objects... 2024-09-11T14:31:55.359 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[93865]: added half of the objects 2024-09-11T14:31:55.359 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[93865]: added 50 objects... 2024-09-11T14:31:55.359 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[93865]: added 50 objects 2024-09-11T14:31:55.359 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[93865]: shutting down. 2024-09-11T14:31:55.510 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:55.511 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:55.511 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:55.511 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[93866]: starting. 2024-09-11T14:31:55.511 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[93866]: added 25 objects... 2024-09-11T14:31:55.511 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[93866]: added half of the objects 2024-09-11T14:31:55.511 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[93866]: added 50 objects... 2024-09-11T14:31:55.511 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[93866]: added 50 objects 2024-09-11T14:31:55.511 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[93866]: shutting down. 2024-09-11T14:31:56.514 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:56.514 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:56.514 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:56.514 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:56.514 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[93948]: starting. 2024-09-11T14:31:56.514 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[93948]: creating pool ceph_test_rados_list_parallel.smithi046-93724 2024-09-11T14:31:56.514 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[93948]: created object 0... 2024-09-11T14:31:56.515 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[93948]: created object 25... 2024-09-11T14:31:56.515 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[93948]: created object 49... 2024-09-11T14:31:56.515 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[93948]: finishing. 2024-09-11T14:31:56.515 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[93948]: shutting down. 2024-09-11T14:31:56.970 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: starting. 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: listing objects. 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: listed object 0... 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: listed object 25... 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: listed object 50... 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: listed object 75... 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: listed object 100... 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: listed object 125... 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: saw 150 objects 2024-09-11T14:31:56.971 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[93949]: shutting down. 2024-09-11T14:31:57.392 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[93950]: starting. 2024-09-11T14:31:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[93950]: added 25 objects... 2024-09-11T14:31:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[93950]: added half of the objects 2024-09-11T14:31:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[93950]: added 50 objects... 2024-09-11T14:31:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[93950]: added 50 objects 2024-09-11T14:31:57.393 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[93950]: shutting down. 2024-09-11T14:31:57.568 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:57.568 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:57.568 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:57.569 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:57.569 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:31:57.569 INFO:tasks.workunit.client.0.smithi046.stdout:******* SUCCESS ********** 2024-09-11T14:31:57.570 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:31:57.570 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:31:57.570 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-11T14:32:00.920 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94016]: starting. 2024-09-11T14:32:00.920 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94016]: creating pool ceph_test_rados_open_pools_parallel.smithi046-94015 2024-09-11T14:32:00.920 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94016]: created object 0... 2024-09-11T14:32:00.920 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94016]: created object 25... 2024-09-11T14:32:00.920 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94016]: created object 49... 2024-09-11T14:32:00.921 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94016]: finishing. 2024-09-11T14:32:00.921 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94016]: shutting down. 2024-09-11T14:32:01.588 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[94017]: starting. 2024-09-11T14:32:01.588 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[94017]: rados_pool_create. 2024-09-11T14:32:01.588 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[94017]: rados_ioctx_create. 2024-09-11T14:32:01.588 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[94017]: shutting down. 2024-09-11T14:32:04.286 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:32:04.287 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94052]: starting. 2024-09-11T14:32:04.287 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94052]: creating pool ceph_test_rados_open_pools_parallel.smithi046-94015 2024-09-11T14:32:04.287 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94052]: created object 0... 2024-09-11T14:32:04.287 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94052]: created object 25... 2024-09-11T14:32:04.287 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94052]: created object 49... 2024-09-11T14:32:04.287 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94052]: finishing. 2024-09-11T14:32:04.287 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94052]: shutting down. 2024-09-11T14:32:04.952 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:32:04.953 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[94053]: starting. 2024-09-11T14:32:04.953 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[94053]: rados_pool_create. 2024-09-11T14:32:04.953 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[94053]: rados_ioctx_create. 2024-09-11T14:32:04.953 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[94053]: shutting down. 2024-09-11T14:32:04.955 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:32:04.955 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:32:04.955 INFO:tasks.workunit.client.0.smithi046.stdout:******* SUCCESS ********** 2024-09-11T14:32:04.956 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-11T14:32:04.956 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:32:04.956 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-11T14:32:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94089]: starting. 2024-09-11T14:32:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94089]: creating pool ceph_test_rados_delete_pools_parallel.smithi046-94088 2024-09-11T14:32:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94089]: created object 0... 2024-09-11T14:32:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94089]: created object 25... 2024-09-11T14:32:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94089]: created object 49... 2024-09-11T14:32:08.293 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94089]: finishing. 2024-09-11T14:32:08.294 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[94089]: shutting down. 2024-09-11T14:32:08.967 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[94090]: starting. 2024-09-11T14:32:08.967 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[94090]: deleting pool ceph_test_rados_delete_pools_parallel.smithi046-94088 2024-09-11T14:32:08.968 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[94090]: shutting down. 2024-09-11T14:32:12.371 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:32:12.372 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94125]: starting. 2024-09-11T14:32:12.372 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94125]: creating pool ceph_test_rados_delete_pools_parallel.smithi046-94088 2024-09-11T14:32:12.372 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94125]: created object 0... 2024-09-11T14:32:12.372 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94125]: created object 25... 2024-09-11T14:32:12.372 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94125]: created object 49... 2024-09-11T14:32:12.372 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94125]: finishing. 2024-09-11T14:32:12.372 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[94125]: shutting down. 2024-09-11T14:32:12.533 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:32:12.533 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[94127]: starting. 2024-09-11T14:32:12.533 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[94127]: listing objects. 2024-09-11T14:32:12.533 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[94127]: listed object 0... 2024-09-11T14:32:12.533 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[94127]: listed object 25... 2024-09-11T14:32:12.533 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[94127]: saw 50 objects 2024-09-11T14:32:12.533 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[94127]: shutting down. 2024-09-11T14:32:12.982 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:32:12.982 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[94126]: starting. 2024-09-11T14:32:12.982 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[94126]: deleting pool ceph_test_rados_delete_pools_parallel.smithi046-94088 2024-09-11T14:32:12.983 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[94126]: shutting down. 2024-09-11T14:32:12.984 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:32:12.984 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-09-11T14:32:12.984 INFO:tasks.workunit.client.0.smithi046.stdout:******* SUCCESS ********** 2024-09-11T14:32:12.988 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:32:12.988 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:32:12.988 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:32:12.988 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' cls = ec_io ']' 2024-09-11T14:32:12.989 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' cls = ec_list ']' 2024-09-11T14:32:12.989 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_cls 2024-09-11T14:32:13.007 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:32:13.008 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 1 test from 1 test suite. 2024-09-11T14:32:13.008 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:32:13.008 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from NeoRadosCls 2024-09-11T14:32:13.008 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosCls.DNE 2024-09-11T14:32:15.991 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosCls.DNE (2984 ms) 2024-09-11T14:32:15.992 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from NeoRadosCls (2984 ms total) 2024-09-11T14:32:15.992 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:32:15.992 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:32:15.992 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 1 test from 1 test suite ran. (2984 ms total) 2024-09-11T14:32:15.992 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 1 test. 2024-09-11T14:32:15.994 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:32:15.994 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:32:15.994 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:32:15.994 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' cmd = ec_io ']' 2024-09-11T14:32:15.994 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' cmd = ec_list ']' 2024-09-11T14:32:15.994 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_cmd 2024-09-11T14:32:16.016 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:32:16.016 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-11T14:32:16.016 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:32:16.016 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from NeoRadosCmd 2024-09-11T14:32:16.016 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-09-11T14:32:17.998 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosCmd.MonDescribe (1981 ms) 2024-09-11T14:32:17.998 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-09-11T14:32:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosCmd.OSDCmd (2013 ms) 2024-09-11T14:32:20.011 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-09-11T14:32:23.018 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosCmd.PGCmd (3007 ms) 2024-09-11T14:32:23.018 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from NeoRadosCmd (7001 ms total) 2024-09-11T14:32:23.018 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:32:23.018 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:32:23.018 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 3 tests from 1 test suite ran. (7001 ms total) 2024-09-11T14:32:23.018 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 3 tests. 2024-09-11T14:32:23.020 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:32:23.020 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:32:23.020 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:32:23.020 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' handler_error = ec_io ']' 2024-09-11T14:32:23.020 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' handler_error = ec_list ']' 2024-09-11T14:32:23.020 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_handler_error 2024-09-11T14:32:23.040 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:32:23.040 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 1 test from 1 test suite. 2024-09-11T14:32:23.040 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:32:23.040 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from neocls_handler_error 2024-09-11T14:32:23.040 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-09-11T14:32:26.033 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] neocls_handler_error.test_handler_error (2993 ms) 2024-09-11T14:32:26.033 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from neocls_handler_error (2993 ms total) 2024-09-11T14:32:26.033 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:32:26.033 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:32:26.033 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 1 test from 1 test suite ran. (2993 ms total) 2024-09-11T14:32:26.033 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 1 test. 2024-09-11T14:32:26.035 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:32:26.035 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:32:26.035 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:32:26.035 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' io = ec_io ']' 2024-09-11T14:32:26.035 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' io = ec_list ']' 2024-09-11T14:32:26.035 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_io 2024-09-11T14:32:26.059 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:32:26.059 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-11T14:32:26.059 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:32:26.059 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from NeoRadosIo 2024-09-11T14:32:26.059 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.Limits 2024-09-11T14:32:27.036 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:32:28.040 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.Limits (1982 ms) 2024-09-11T14:32:28.041 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-09-11T14:32:31.054 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.SimpleWrite (3014 ms) 2024-09-11T14:32:31.055 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-09-11T14:32:34.060 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.ReadOp (3006 ms) 2024-09-11T14:32:34.061 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-09-11T14:32:37.071 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.SparseRead (3011 ms) 2024-09-11T14:32:37.072 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-09-11T14:32:40.083 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.RoundTrip (3011 ms) 2024-09-11T14:32:40.083 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-11T14:32:42.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (2870 ms) 2024-09-11T14:32:42.952 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-11T14:32:45.957 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3003 ms) 2024-09-11T14:32:45.957 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-11T14:32:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3014 ms) 2024-09-11T14:32:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-11T14:32:51.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (2980 ms) 2024-09-11T14:32:51.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.Trunc 2024-09-11T14:32:54.990 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.Trunc (3040 ms) 2024-09-11T14:32:54.991 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.Remove 2024-09-11T14:32:58.003 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.Remove (3013 ms) 2024-09-11T14:32:58.004 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-11T14:33:01.018 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3015 ms) 2024-09-11T14:33:01.018 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-09-11T14:33:04.023 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.RmXattr (3005 ms) 2024-09-11T14:33:04.023 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-09-11T14:33:07.036 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.GetXattrs (3013 ms) 2024-09-11T14:33:07.036 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from NeoRadosIo (40978 ms total) 2024-09-11T14:33:07.036 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:33:07.036 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:33:07.036 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 14 tests from 1 test suite ran. (40978 ms total) 2024-09-11T14:33:07.036 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 14 tests. 2024-09-11T14:33:07.040 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:33:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:33:07.043 INFO:tasks.workunit.client.0.smithi046.stdout:Skipping EC with Crimson 2024-09-11T14:33:07.044 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:33:07.044 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' ec_io = ec_io ']' 2024-09-11T14:33:07.044 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo 'Skipping EC with Crimson' 2024-09-11T14:33:07.044 INFO:tasks.workunit.client.0.smithi046.stderr:+ continue 2024-09-11T14:33:07.044 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:33:07.044 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:33:07.045 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:33:07.045 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' list = ec_io ']' 2024-09-11T14:33:07.045 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' list = ec_list ']' 2024-09-11T14:33:07.045 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_list 2024-09-11T14:33:07.061 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:33:07.061 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-11T14:33:07.062 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:33:07.062 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from NeoradosList 2024-09-11T14:33:07.062 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoradosList.ListObjects 2024-09-11T14:33:10.051 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoradosList.ListObjects (2989 ms) 2024-09-11T14:33:10.051 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-09-11T14:33:13.057 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoradosList.ListObjectsNS (3007 ms) 2024-09-11T14:33:13.057 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-09-11T14:33:25.587 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoradosList.ListObjectsMany (12530 ms) 2024-09-11T14:33:25.588 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from NeoradosList (18526 ms total) 2024-09-11T14:33:25.588 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:33:25.588 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:33:25.588 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 3 tests from 1 test suite ran. (18526 ms total) 2024-09-11T14:33:25.588 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 3 tests. 2024-09-11T14:33:25.591 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:33:25.591 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:33:25.591 INFO:tasks.workunit.client.0.smithi046.stdout:Skipping EC with Crimson 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' ec_list = ec_io ']' 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' ec_list = ec_list ']' 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo 'Skipping EC with Crimson' 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ continue 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' misc = ec_io ']' 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' misc = ec_list ']' 2024-09-11T14:33:25.592 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_misc 2024-09-11T14:33:25.613 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:33:25.614 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-11T14:33:25.614 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:33:25.614 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 12 tests from NeoRadosMisc 2024-09-11T14:33:25.614 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.Version 2024-09-11T14:33:27.597 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.Version (1984 ms) 2024-09-11T14:33:27.597 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-11T14:33:29.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2007 ms) 2024-09-11T14:33:29.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.LongName 2024-09-11T14:33:32.963 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.LongName (3358 ms) 2024-09-11T14:33:32.963 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-09-11T14:33:33.963 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:33:34.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.LongLocator (2005 ms) 2024-09-11T14:33:34.968 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-09-11T14:33:37.980 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.LongNamespace (3012 ms) 2024-09-11T14:33:37.980 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-09-11T14:33:40.995 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.LongAttrName (3014 ms) 2024-09-11T14:33:40.995 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.Exec 2024-09-11T14:33:44.000 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.Exec (3006 ms) 2024-09-11T14:33:44.001 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-09-11T14:33:47.017 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.Operate1 (3016 ms) 2024-09-11T14:33:47.017 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-09-11T14:33:50.031 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.Operate2 (3014 ms) 2024-09-11T14:33:50.031 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-09-11T14:33:53.040 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.BigObject (3010 ms) 2024-09-11T14:33:53.041 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-09-11T14:33:55.049 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.BigAttr (2009 ms) 2024-09-11T14:33:55.050 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-09-11T14:33:56.052 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:33:57.062 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.WriteSame (2013 ms) 2024-09-11T14:33:57.062 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 12 tests from NeoRadosMisc (31449 ms total) 2024-09-11T14:33:57.062 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:33:57.063 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:33:57.063 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 12 tests from 1 test suite ran. (31449 ms total) 2024-09-11T14:33:57.063 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 12 tests. 2024-09-11T14:33:57.067 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:33:57.067 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:33:57.067 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:33:57.067 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' pool = ec_io ']' 2024-09-11T14:33:57.067 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' pool = ec_list ']' 2024-09-11T14:33:57.067 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_pool 2024-09-11T14:33:57.087 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:33:57.087 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-11T14:33:57.087 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:33:57.088 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from NeoRadosPools 2024-09-11T14:33:57.088 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolList 2024-09-11T14:33:59.070 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolList (1983 ms) 2024-09-11T14:33:59.071 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-09-11T14:34:01.080 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolLookup (2010 ms) 2024-09-11T14:34:01.080 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-11T14:34:02.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (1892 ms) 2024-09-11T14:34:02.972 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-09-11T14:34:06.986 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolDelete (4014 ms) 2024-09-11T14:34:06.986 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-11T14:34:08.999 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2012 ms) 2024-09-11T14:34:08.999 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-11T14:34:11.006 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2008 ms) 2024-09-11T14:34:11.006 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from NeoRadosPools (13919 ms total) 2024-09-11T14:34:11.006 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:34:11.006 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:34:11.007 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 6 tests from 1 test suite ran. (13919 ms total) 2024-09-11T14:34:11.007 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 6 tests. 2024-09-11T14:34:11.010 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:34:11.010 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:34:11.010 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:34:11.010 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' read_operations = ec_io ']' 2024-09-11T14:34:11.010 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' read_operations = ec_list ']' 2024-09-11T14:34:11.010 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_read_operations 2024-09-11T14:34:11.034 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:34:11.034 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-11T14:34:11.034 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:34:11.034 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from NeoRadosReadOps 2024-09-11T14:34:11.034 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-11T14:34:14.018 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2984 ms) 2024-09-11T14:34:14.019 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-09-11T14:34:17.034 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.AssertExists (3015 ms) 2024-09-11T14:34:17.034 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-09-11T14:34:20.045 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3012 ms) 2024-09-11T14:34:20.046 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-09-11T14:34:23.053 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3008 ms) 2024-09-11T14:34:23.054 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Read 2024-09-11T14:34:26.067 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Read (3014 ms) 2024-09-11T14:34:26.067 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-09-11T14:34:29.082 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Checksum (3015 ms) 2024-09-11T14:34:29.082 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-11T14:34:31.974 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (2892 ms) 2024-09-11T14:34:31.974 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-09-11T14:34:35.099 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.ShortRead (3125 ms) 2024-09-11T14:34:35.099 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-09-11T14:34:38.111 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Exec (3012 ms) 2024-09-11T14:34:38.111 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-09-11T14:34:41.125 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Stat (3014 ms) 2024-09-11T14:34:41.125 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-09-11T14:34:43.984 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Omap (2858 ms) 2024-09-11T14:34:43.985 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-09-11T14:34:46.995 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3012 ms) 2024-09-11T14:34:46.995 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-09-11T14:34:50.008 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3012 ms) 2024-09-11T14:34:50.008 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-09-11T14:34:53.023 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.CmpExt (3016 ms) 2024-09-11T14:34:53.023 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from NeoRadosReadOps (41989 ms total) 2024-09-11T14:34:53.023 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:34:53.024 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:34:53.024 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 14 tests from 1 test suite ran. (41990 ms total) 2024-09-11T14:34:53.024 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 14 tests. 2024-09-11T14:34:53.029 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:34:53.029 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:34:53.030 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:34:53.030 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' snapshots = ec_io ']' 2024-09-11T14:34:53.030 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' snapshots = ec_list ']' 2024-09-11T14:34:53.030 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_snapshots 2024-09-11T14:34:53.052 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:34:53.052 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-11T14:34:53.052 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:34:53.052 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-09-11T14:34:53.052 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-09-11T14:34:58.046 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.SnapList (4994 ms) 2024-09-11T14:34:58.046 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-11T14:35:02.989 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (4942 ms) 2024-09-11T14:35:02.989 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-09-11T14:35:07.004 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.Rollback (4015 ms) 2024-09-11T14:35:07.004 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-11T14:35:11.985 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (4981 ms) 2024-09-11T14:35:11.985 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-11T14:35:19.051 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (7066 ms) 2024-09-11T14:35:19.051 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from NeoRadosSnapshots (25998 ms total) 2024-09-11T14:35:19.051 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:35:19.051 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-11T14:35:19.051 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-11T14:35:24.067 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5017 ms) 2024-09-11T14:35:24.067 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-11T14:35:25.076 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:35:26.077 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2009 ms) 2024-09-11T14:35:26.077 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-11T14:35:27.083 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-09-11T14:35:28.088 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2012 ms) 2024-09-11T14:35:28.089 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-11T14:35:34.112 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6024 ms) 2024-09-11T14:35:34.112 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-11T14:35:38.135 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4023 ms) 2024-09-11T14:35:38.135 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-11T14:35:41.148 INFO:tasks.workunit.client.0.smithi046.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi046-95024-11. 2024-09-11T14:35:41.993 INFO:tasks.workunit.client.0.smithi046.stdout:Waiting for snaps to purge. 2024-09-11T14:35:57.626 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19490 ms) 2024-09-11T14:35:57.626 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (38575 ms total) 2024-09-11T14:35:57.626 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:35:57.626 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:35:57.627 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 11 tests from 2 test suites ran. (64573 ms total) 2024-09-11T14:35:57.627 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 11 tests. 2024-09-11T14:35:57.630 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:35:57.631 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:35:57.631 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:35:57.631 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' watch_notify = ec_io ']' 2024-09-11T14:35:57.631 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' watch_notify = ec_list ']' 2024-09-11T14:35:57.631 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_watch_notify 2024-09-11T14:35:57.653 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:35:57.654 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-11T14:35:57.654 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:35:57.654 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-09-11T14:35:57.654 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-11T14:35:59.912 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 17500912 notify_id 2873333121029 notifier_gid 15914 2024-09-11T14:36:00.639 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2986 ms) 2024-09-11T14:36:00.639 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-11T14:36:02.415 INFO:tasks.workunit.client.0.smithi046.stdout:Trying... 2024-09-11T14:36:02.419 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 30706160 notify_id 2886218022914 notifier_gid 15917 2024-09-11T14:36:02.419 INFO:tasks.workunit.client.0.smithi046.stdout:Waiting for 3.000000000s 2024-09-11T14:36:03.418 INFO:tasks.workunit.client.0.smithi046.stdout:Timed out. 2024-09-11T14:36:03.439 INFO:tasks.workunit.client.0.smithi046.stdout:Flushing... 2024-09-11T14:36:03.440 INFO:tasks.workunit.client.0.smithi046.stdout:Flushed... 2024-09-11T14:36:06.650 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (6011 ms) 2024-09-11T14:36:06.650 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from NeoRadosWatchNotify (8997 ms total) 2024-09-11T14:36:06.651 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:36:06.651 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:36:06.651 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 2 tests from 1 test suite ran. (8997 ms total) 2024-09-11T14:36:06.651 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 2 tests. 2024-09-11T14:36:06.653 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-11T14:36:06.653 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:36:06.653 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-09-11T14:36:06.653 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' write_operations = ec_io ']' 2024-09-11T14:36:06.653 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' write_operations = ec_list ']' 2024-09-11T14:36:06.654 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_write_operations 2024-09-11T14:36:06.677 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-09-11T14:36:06.677 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-11T14:36:06.677 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-09-11T14:36:06.677 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-09-11T14:36:06.677 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-09-11T14:36:09.665 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2989 ms) 2024-09-11T14:36:09.665 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-11T14:36:13.006 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3340 ms) 2024-09-11T14:36:13.006 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-09-11T14:36:16.015 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3009 ms) 2024-09-11T14:36:16.015 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-09-11T14:36:19.032 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.Write (3017 ms) 2024-09-11T14:36:19.032 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-09-11T14:36:22.005 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.Exec (2974 ms) 2024-09-11T14:36:22.005 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-09-11T14:36:25.055 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3050 ms) 2024-09-11T14:36:25.055 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-09-11T14:36:38.640 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.CmpExt (13584 ms) 2024-09-11T14:36:38.640 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from NeoRadosWriteOps (31963 ms total) 2024-09-11T14:36:38.640 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-09-11T14:36:38.641 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-09-11T14:36:38.641 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 7 tests from 1 test suite ran. (31963 ms total) 2024-09-11T14:36:38.641 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 7 tests. 2024-09-11T14:36:38.643 INFO:tasks.workunit.client.0.smithi046.stderr:+ ret=0 2024-09-11T14:36:38.643 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-09-11T14:36:38.643 INFO:tasks.workunit.client.0.smithi046.stderr:+ exit 0 2024-09-11T14:36:38.643 INFO:tasks.workunit.client.0.smithi046.stderr:+ cleanup 2024-09-11T14:36:38.643 INFO:tasks.workunit.client.0.smithi046.stderr:+ pkill -P 29446 2024-09-11T14:36:38.668 INFO:tasks.workunit.client.0.smithi046.stderr:+ true 2024-09-11T14:36:38.668 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T14:36:38.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T14:36:38.703 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-11T14:36:38.704 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-11T14:36:38.705 DEBUG:teuthology.orchestra.run.smithi046:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0325fd3c11a225c0fd9eb38fab88aad1370ad779 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-11T14:36:38.767 INFO:tasks.workunit.client.0.smithi046.stderr:++ uuidgen 2024-09-11T14:36:38.770 INFO:tasks.workunit.client.0.smithi046.stderr:+ p=bcc42802-4a92-4251-a537-9d1c078ffecf 2024-09-11T14:36:38.771 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool create bcc42802-4a92-4251-a537-9d1c078ffecf 12 2024-09-11T14:36:38.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.870+0000 7f15bad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:38.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.881+0000 7f15bad91640 1 Processor -- start 2024-09-11T14:36:38.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.881+0000 7f15bad91640 1 -- start start 2024-09-11T14:36:38.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.883+0000 7f15bad91640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f15b4138880 0x7f15b413aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.883+0000 7f15bad91640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b40a2460 con 0x7f15b40a2df0 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.883+0000 7f15bad91640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f15b40a3d40 con 0x7f15b4138880 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.883+0000 7f15b3fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f15b4138880 0x7f15b413aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.883+0000 7f15b8b2d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f15b40a2df0 0x7f15b40a3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37394/0 (socket says 172.21.15.46:37394) 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.883+0000 7f15b3fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f15b4138880 0x7f15b413aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42720/0 (socket says 172.21.15.46:42720) 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.883+0000 7f15b8b2d640 1 -- 172.21.15.46:0/903777317 learned_addr learned my addr 172.21.15.46:0/903777317 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.884+0000 7f15b3fff640 1 -- 172.21.15.46:0/903777317 >> v1:172.21.15.46:6789/0 conn(0x7f15b40a2df0 legacy=0x7f15b40a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.884+0000 7f15b37fe640 1 -- 172.21.15.46:0/903777317 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958366433 0 0) 0x7f15b40a2460 con 0x7f15b40a2df0 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.884+0000 7f15b3fff640 1 -- 172.21.15.46:0/903777317 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b40a29a0 con 0x7f15b4138880 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.884+0000 7f15b3fff640 1 --2- 172.21.15.46:0/903777317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b4138880 0x7f15b413aca0 crc :-1 s=READY pgs=12824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a310f4d8d056e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.884+0000 7f15b37fe640 1 -- 172.21.15.46:0/903777317 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f15a400e040 con 0x7f15b4138880 2024-09-11T14:36:38.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.884+0000 7f15b37fe640 1 -- 172.21.15.46:0/903777317 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f15a4007670 con 0x7f15b4138880 2024-09-11T14:36:38.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.884+0000 7f15b37fe640 1 -- 172.21.15.46:0/903777317 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f15a4007910 con 0x7f15b4138880 2024-09-11T14:36:38.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.885+0000 7f15bad91640 1 -- 172.21.15.46:0/903777317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b4138880 msgr2=0x7f15b413aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:38.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.885+0000 7f15bad91640 1 --2- 172.21.15.46:0/903777317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b4138880 0x7f15b413aca0 crc :-1 s=READY pgs=12824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:38.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.885+0000 7f15bad91640 1 -- 172.21.15.46:0/903777317 shutdown_connections 2024-09-11T14:36:38.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.885+0000 7f15bad91640 1 --2- 172.21.15.46:0/903777317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b4138880 0x7f15b413aca0 unknown :-1 s=CLOSED pgs=12824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:38.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.885+0000 7f15bad91640 1 -- 172.21.15.46:0/903777317 >> 172.21.15.46:0/903777317 conn(0x7f15b40a4ad0 msgr2=0x7f15b40a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:38.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.885+0000 7f15bad91640 1 -- 172.21.15.46:0/903777317 shutdown_connections 2024-09-11T14:36:38.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.885+0000 7f15bad91640 1 -- 172.21.15.46:0/903777317 wait complete. 2024-09-11T14:36:38.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.886+0000 7f15bad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:38.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.888+0000 7f15bad91640 1 Processor -- start 2024-09-11T14:36:38.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.888+0000 7f15bad91640 1 -- start start 2024-09-11T14:36:38.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.890+0000 7f15bad91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b40a2df0 0x7f15b41205c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:38.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.890+0000 7f15bad91640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f15b4121f50 con 0x7f15b40a2df0 2024-09-11T14:36:38.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.890+0000 7f15b8b2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b40a2df0 0x7f15b41205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:38.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.890+0000 7f15b8b2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b40a2df0 0x7f15b41205c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42734/0 (socket says 172.21.15.46:42734) 2024-09-11T14:36:38.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.890+0000 7f15b8b2d640 1 -- 172.21.15.46:0/2776990654 learned_addr learned my addr 172.21.15.46:0/2776990654 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:38.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.891+0000 7f15b8b2d640 1 -- 172.21.15.46:0/2776990654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b4120070 con 0x7f15b40a2df0 2024-09-11T14:36:38.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.891+0000 7f15b8b2d640 1 --2- 172.21.15.46:0/2776990654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b40a2df0 0x7f15b41205c0 crc :-1 s=READY pgs=12825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:38.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.891+0000 7f15b17fa640 1 -- 172.21.15.46:0/2776990654 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f159c004b80 con 0x7f15b40a2df0 2024-09-11T14:36:38.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.891+0000 7f15b17fa640 1 -- 172.21.15.46:0/2776990654 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f159c004ce0 con 0x7f15b40a2df0 2024-09-11T14:36:38.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.891+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b40a5dd0 con 0x7f15b40a2df0 2024-09-11T14:36:38.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.891+0000 7f15b17fa640 1 -- 172.21.15.46:0/2776990654 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f159c007120 con 0x7f15b40a2df0 2024-09-11T14:36:38.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.891+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b411fcd0 con 0x7f15b40a2df0 2024-09-11T14:36:38.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.893+0000 7f15b17fa640 1 -- 172.21.15.46:0/2776990654 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f159c0072d0 con 0x7f15b40a2df0 2024-09-11T14:36:38.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.893+0000 7f15b17fa640 1 --2- 172.21.15.46:0/2776990654 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f159403e960 0x7f1594040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:38.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.893+0000 7f15b17fa640 1 -- 172.21.15.46:0/2776990654 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(698..698 src has 593..698) ==== 3431+0+0 (crc 0 0 0) 0x7f159c04faa0 con 0x7f15b40a2df0 2024-09-11T14:36:38.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.893+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b409c8a0 con 0x7f15b40a2df0 2024-09-11T14:36:38.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.893+0000 7f15b3fff640 1 --2- 172.21.15.46:0/2776990654 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f159403e960 0x7f1594040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:38.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.894+0000 7f15b3fff640 1 --2- 172.21.15.46:0/2776990654 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f159403e960 0x7f1594040e70 crc :-1 s=READY pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:38.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:38.904+0000 7f15b17fa640 1 -- 172.21.15.46:0/2776990654 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f159c00f420 con 0x7f15b40a2df0 2024-09-11T14:36:39.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.148+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "pg_num": 12} v 0) -- 0x7f15b40698c0 con 0x7f15b40a2df0 2024-09-11T14:36:39.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.636+0000 7f15b17fa640 1 -- 172.21.15.46:0/2776990654 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "pg_num": 12}]=0 pool 'bcc42802-4a92-4251-a537-9d1c078ffecf' created v699) ==== 176+0+0 (crc 0 0 0) 0x7f159c00a0c0 con 0x7f15b40a2df0 2024-09-11T14:36:39.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.763+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "pg_num": 12} v 0) -- 0x7f15b4122eb0 con 0x7f15b40a2df0 2024-09-11T14:36:39.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.764+0000 7f15b17fa640 1 -- 172.21.15.46:0/2776990654 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "pg_num": 12}]=0 pool 'bcc42802-4a92-4251-a537-9d1c078ffecf' already exists v699) ==== 183+0+0 (crc 0 0 0) 0x7f159c00a7b0 con 0x7f15b40a2df0 2024-09-11T14:36:39.765 INFO:tasks.workunit.client.0.smithi046.stderr:pool 'bcc42802-4a92-4251-a537-9d1c078ffecf' already exists 2024-09-11T14:36:39.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f159403e960 msgr2=0x7f1594040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:39.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 --2- 172.21.15.46:0/2776990654 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f159403e960 0x7f1594040e70 crc :-1 s=READY pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:39.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b40a2df0 msgr2=0x7f15b41205c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:39.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 --2- 172.21.15.46:0/2776990654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b40a2df0 0x7f15b41205c0 crc :-1 s=READY pgs=12825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:39.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 shutdown_connections 2024-09-11T14:36:39.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 --2- 172.21.15.46:0/2776990654 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f159403e960 0x7f1594040e70 unknown :-1 s=CLOSED pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:39.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 --2- 172.21.15.46:0/2776990654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15b40a2df0 0x7f15b41205c0 unknown :-1 s=CLOSED pgs=12825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:39.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 >> 172.21.15.46:0/2776990654 conn(0x7f15b40a4ad0 msgr2=0x7f15b4135420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:39.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 shutdown_connections 2024-09-11T14:36:39.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.767+0000 7f15bad91640 1 -- 172.21.15.46:0/2776990654 wait complete. 2024-09-11T14:36:39.779 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota bcc42802-4a92-4251-a537-9d1c078ffecf max_objects 10 2024-09-11T14:36:39.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.871+0000 7f7d16b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:39.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.881+0000 7f7d16b91640 1 Processor -- start 2024-09-11T14:36:39.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.881+0000 7f7d16b91640 1 -- start start 2024-09-11T14:36:39.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.882+0000 7f7d16b91640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d1009e9b0 0x7f7d10137040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:39.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.882+0000 7f7d16b91640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1006eec0 con 0x7f7d10070300 2024-09-11T14:36:39.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.882+0000 7f7d16b91640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f7d1006fef0 con 0x7f7d1009e9b0 2024-09-11T14:36:39.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.882+0000 7f7d0ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d1009e9b0 0x7f7d10137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:39.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.882+0000 7f7d1492d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7d10070300 0x7f7d1009e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37404/0 (socket says 172.21.15.46:37404) 2024-09-11T14:36:39.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.882+0000 7f7d1492d640 1 -- 172.21.15.46:0/402645701 learned_addr learned my addr 172.21.15.46:0/402645701 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:36:39.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.883+0000 7f7d0ffff640 1 -- 172.21.15.46:0/402645701 >> v1:172.21.15.46:6789/0 conn(0x7f7d10070300 legacy=0x7f7d1009e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:39.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.883+0000 7f7d0ffff640 1 -- 172.21.15.46:0/402645701 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1009fde0 con 0x7f7d1009e9b0 2024-09-11T14:36:39.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.883+0000 7f7d0ffff640 1 --2- 172.21.15.46:0/402645701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1009e9b0 0x7f7d10137040 crc :-1 s=READY pgs=12827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182092852465057e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:39.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.883+0000 7f7d0f7fe640 1 -- 172.21.15.46:0/402645701 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d04009d80 con 0x7f7d1009e9b0 2024-09-11T14:36:39.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.883+0000 7f7d0f7fe640 1 -- 172.21.15.46:0/402645701 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7d0400f340 con 0x7f7d1009e9b0 2024-09-11T14:36:39.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.883+0000 7f7d0f7fe640 1 -- 172.21.15.46:0/402645701 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d0400f5e0 con 0x7f7d1009e9b0 2024-09-11T14:36:39.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.884+0000 7f7d16b91640 1 -- 172.21.15.46:0/402645701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1009e9b0 msgr2=0x7f7d10137040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:39.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.884+0000 7f7d16b91640 1 --2- 172.21.15.46:0/402645701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1009e9b0 0x7f7d10137040 crc :-1 s=READY pgs=12827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:39.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.884+0000 7f7d16b91640 1 -- 172.21.15.46:0/402645701 shutdown_connections 2024-09-11T14:36:39.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.884+0000 7f7d16b91640 1 --2- 172.21.15.46:0/402645701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d1009e9b0 0x7f7d10137040 unknown :-1 s=CLOSED pgs=12827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:39.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.884+0000 7f7d16b91640 1 -- 172.21.15.46:0/402645701 >> 172.21.15.46:0/402645701 conn(0x7f7d100a1530 msgr2=0x7f7d100a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:39.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.884+0000 7f7d16b91640 1 -- 172.21.15.46:0/402645701 shutdown_connections 2024-09-11T14:36:39.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.884+0000 7f7d16b91640 1 -- 172.21.15.46:0/402645701 wait complete. 2024-09-11T14:36:39.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.884+0000 7f7d16b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:39.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.886+0000 7f7d16b91640 1 Processor -- start 2024-09-11T14:36:39.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.886+0000 7f7d16b91640 1 -- start start 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d16b91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d10070300 0x7f7d101c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d16b91640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10123a20 con 0x7f7d10070300 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d1492d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d10070300 0x7f7d101c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d1492d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d10070300 0x7f7d101c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42762/0 (socket says 172.21.15.46:42762) 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d1492d640 1 -- 172.21.15.46:0/1743071310 learned_addr learned my addr 172.21.15.46:0/1743071310 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d1492d640 1 -- 172.21.15.46:0/1743071310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d10126790 con 0x7f7d10070300 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d1492d640 1 --2- 172.21.15.46:0/1743071310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d10070300 0x7f7d101c81f0 crc :-1 s=READY pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d0d7fa640 1 -- 172.21.15.46:0/1743071310 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d00005a60 con 0x7f7d10070300 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d0d7fa640 1 -- 172.21.15.46:0/1743071310 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7d00005bc0 con 0x7f7d10070300 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d10124b50 con 0x7f7d10070300 2024-09-11T14:36:39.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d0d7fa640 1 -- 172.21.15.46:0/1743071310 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7d00005e60 con 0x7f7d10070300 2024-09-11T14:36:39.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.888+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d10131f90 con 0x7f7d10070300 2024-09-11T14:36:39.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.889+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1006a3e0 con 0x7f7d10070300 2024-09-11T14:36:39.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.890+0000 7f7d0d7fa640 1 -- 172.21.15.46:0/1743071310 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f7d0000c7f0 con 0x7f7d10070300 2024-09-11T14:36:39.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.890+0000 7f7d0d7fa640 1 --2- 172.21.15.46:0/1743071310 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f7cfc03e930 0x7f7cfc040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:39.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.890+0000 7f7d0d7fa640 1 -- 172.21.15.46:0/1743071310 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(699..699 src has 593..699) ==== 3806+0+0 (crc 0 0 0) 0x7f7d0004fb80 con 0x7f7d10070300 2024-09-11T14:36:39.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.890+0000 7f7d0ffff640 1 --2- 172.21.15.46:0/1743071310 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f7cfc03e930 0x7f7cfc040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:39.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.891+0000 7f7d0ffff640 1 --2- 172.21.15.46:0/1743071310 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f7cfc03e930 0x7f7cfc040e40 crc :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:39.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:39.895+0000 7f7d0d7fa640 1 -- 172.21.15.46:0/1743071310 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f7d0000dc10 con 0x7f7d10070300 2024-09-11T14:36:40.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:40.081+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "10"} v 0) -- 0x7f7d10070860 con 0x7f7d10070300 2024-09-11T14:36:40.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:40.644+0000 7f7d0d7fa640 1 -- 172.21.15.46:0/1743071310 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v700) ==== 223+0+0 (crc 0 0 0) 0x7f7d0000d610 con 0x7f7d10070300 2024-09-11T14:36:40.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:40.834+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "10"} v 0) -- 0x7f7d10126980 con 0x7f7d10070300 2024-09-11T14:36:41.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.648+0000 7f7d0d7fa640 1 -- 172.21.15.46:0/1743071310 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v701) ==== 223+0+0 (crc 0 0 0) 0x7f7d0000d7f0 con 0x7f7d10070300 2024-09-11T14:36:41.650 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 10 for pool bcc42802-4a92-4251-a537-9d1c078ffecf 2024-09-11T14:36:41.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f7cfc03e930 msgr2=0x7f7cfc040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:41.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 --2- 172.21.15.46:0/1743071310 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f7cfc03e930 0x7f7cfc040e40 crc :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:41.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d10070300 msgr2=0x7f7d101c81f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:41.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 --2- 172.21.15.46:0/1743071310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d10070300 0x7f7d101c81f0 crc :-1 s=READY pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:41.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 shutdown_connections 2024-09-11T14:36:41.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 --2- 172.21.15.46:0/1743071310 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f7cfc03e930 0x7f7cfc040e40 unknown :-1 s=CLOSED pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:41.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 --2- 172.21.15.46:0/1743071310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d10070300 0x7f7d101c81f0 unknown :-1 s=CLOSED pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:41.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 >> 172.21.15.46:0/1743071310 conn(0x7f7d100a1530 msgr2=0x7f7d1011c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:41.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 shutdown_connections 2024-09-11T14:36:41.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.652+0000 7f7d16b91640 1 -- 172.21.15.46:0/1743071310 wait complete. 2024-09-11T14:36:41.667 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool application enable bcc42802-4a92-4251-a537-9d1c078ffecf rados 2024-09-11T14:36:41.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.768+0000 7f96bc111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.778+0000 7f96bc111640 1 Processor -- start 2024-09-11T14:36:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.778+0000 7f96bc111640 1 -- start start 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.779+0000 7f96bc111640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96b4138880 0x7f96b413aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96bc111640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b40a2460 con 0x7f96b40a2df0 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96bc111640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f96b40a3d40 con 0x7f96b4138880 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b96ac640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f96b4138880 0x7f96b413aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b9ead640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f96b40a2df0 0x7f96b40a3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37406/0 (socket says 172.21.15.46:37406) 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b9ead640 1 -- 172.21.15.46:0/1005134056 learned_addr learned my addr 172.21.15.46:0/1005134056 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b96ac640 1 -- 172.21.15.46:0/1005134056 >> v1:172.21.15.46:6789/0 conn(0x7f96b40a2df0 legacy=0x7f96b40a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b96ac640 1 -- 172.21.15.46:0/1005134056 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b40a29a0 con 0x7f96b4138880 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b8eab640 1 -- 172.21.15.46:0/1005134056 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152483823 0 0) 0x7f96b40a2460 con 0x7f96b40a2df0 2024-09-11T14:36:41.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b96ac640 1 --2- 172.21.15.46:0/1005134056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b4138880 0x7f96b413aca0 crc :-1 s=READY pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03384884bb8eae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:41.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b8eab640 1 -- 172.21.15.46:0/1005134056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f96a4009d90 con 0x7f96b4138880 2024-09-11T14:36:41.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b8eab640 1 -- 172.21.15.46:0/1005134056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f96a400e230 con 0x7f96b4138880 2024-09-11T14:36:41.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.780+0000 7f96b8eab640 1 -- 172.21.15.46:0/1005134056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f96a400e4d0 con 0x7f96b4138880 2024-09-11T14:36:41.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.781+0000 7f96bc111640 1 -- 172.21.15.46:0/1005134056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b4138880 msgr2=0x7f96b413aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:41.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.781+0000 7f96bc111640 1 --2- 172.21.15.46:0/1005134056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b4138880 0x7f96b413aca0 crc :-1 s=READY pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:41.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.781+0000 7f96bc111640 1 -- 172.21.15.46:0/1005134056 shutdown_connections 2024-09-11T14:36:41.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.781+0000 7f96bc111640 1 --2- 172.21.15.46:0/1005134056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b4138880 0x7f96b413aca0 unknown :-1 s=CLOSED pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:41.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.781+0000 7f96bc111640 1 -- 172.21.15.46:0/1005134056 >> 172.21.15.46:0/1005134056 conn(0x7f96b40a4ad0 msgr2=0x7f96b40a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:41.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.781+0000 7f96bc111640 1 -- 172.21.15.46:0/1005134056 shutdown_connections 2024-09-11T14:36:41.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.781+0000 7f96bc111640 1 -- 172.21.15.46:0/1005134056 wait complete. 2024-09-11T14:36:41.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.782+0000 7f96bc111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:41.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.783+0000 7f96bc111640 1 Processor -- start 2024-09-11T14:36:41.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.783+0000 7f96bc111640 1 -- start start 2024-09-11T14:36:41.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.785+0000 7f96bc111640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40a2df0 0x7f96b41205c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:41.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.785+0000 7f96bc111640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4121f50 con 0x7f96b40a2df0 2024-09-11T14:36:41.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.785+0000 7f96b9ead640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40a2df0 0x7f96b41205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:41.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.785+0000 7f96b9ead640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40a2df0 0x7f96b41205c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42766/0 (socket says 172.21.15.46:42766) 2024-09-11T14:36:41.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.785+0000 7f96b9ead640 1 -- 172.21.15.46:0/3697687520 learned_addr learned my addr 172.21.15.46:0/3697687520 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:41.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.785+0000 7f96b9ead640 1 -- 172.21.15.46:0/3697687520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b4120070 con 0x7f96b40a2df0 2024-09-11T14:36:41.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.785+0000 7f96b9ead640 1 --2- 172.21.15.46:0/3697687520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40a2df0 0x7f96b41205c0 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:41.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.786+0000 7f96aa7fc640 1 -- 172.21.15.46:0/3697687520 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f96b0004b80 con 0x7f96b40a2df0 2024-09-11T14:36:41.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.786+0000 7f96aa7fc640 1 -- 172.21.15.46:0/3697687520 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f96b0004ce0 con 0x7f96b40a2df0 2024-09-11T14:36:41.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.786+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b40a5dd0 con 0x7f96b40a2df0 2024-09-11T14:36:41.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.786+0000 7f96aa7fc640 1 -- 172.21.15.46:0/3697687520 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f96b0007120 con 0x7f96b40a2df0 2024-09-11T14:36:41.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.786+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b411fcd0 con 0x7f96b40a2df0 2024-09-11T14:36:41.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.787+0000 7f96aa7fc640 1 -- 172.21.15.46:0/3697687520 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f96b00072d0 con 0x7f96b40a2df0 2024-09-11T14:36:41.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.787+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b409c8a0 con 0x7f96b40a2df0 2024-09-11T14:36:41.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.787+0000 7f96aa7fc640 1 --2- 172.21.15.46:0/3697687520 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f969803e960 0x7f9698040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:41.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.787+0000 7f96aa7fc640 1 -- 172.21.15.46:0/3697687520 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(701..701 src has 593..701) ==== 3806+0+0 (crc 0 0 0) 0x7f96b004fc10 con 0x7f96b40a2df0 2024-09-11T14:36:41.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.787+0000 7f96b96ac640 1 --2- 172.21.15.46:0/3697687520 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f969803e960 0x7f9698040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:41.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.788+0000 7f96b96ac640 1 --2- 172.21.15.46:0/3697687520 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f969803e960 0x7f9698040e70 crc :-1 s=READY pgs=3806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:41.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.793+0000 7f96aa7fc640 1 -- 172.21.15.46:0/3697687520 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f96b000f230 con 0x7f96b40a2df0 2024-09-11T14:36:41.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:41.981+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "app": "rados"} v 0) -- 0x7f96b40698c0 con 0x7f96b40a2df0 2024-09-11T14:36:42.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:42.649+0000 7f96aa7fc640 1 -- 172.21.15.46:0/3697687520 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "app": "rados"}]=0 enabled application 'rados' on pool 'bcc42802-4a92-4251-a537-9d1c078ffecf' v702) ==== 213+0+0 (crc 0 0 0) 0x7f96b000a0c0 con 0x7f96b40a2df0 2024-09-11T14:36:42.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:42.788+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "app": "rados"} v 0) -- 0x7f96b4122eb0 con 0x7f96b40a2df0 2024-09-11T14:36:43.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.654+0000 7f96aa7fc640 1 -- 172.21.15.46:0/3697687520 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "app": "rados"}]=0 enabled application 'rados' on pool 'bcc42802-4a92-4251-a537-9d1c078ffecf' v703) ==== 213+0+0 (crc 0 0 0) 0x7f96b000a7b0 con 0x7f96b40a2df0 2024-09-11T14:36:43.656 INFO:tasks.workunit.client.0.smithi046.stderr:enabled application 'rados' on pool 'bcc42802-4a92-4251-a537-9d1c078ffecf' 2024-09-11T14:36:43.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f969803e960 msgr2=0x7f9698040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 --2- 172.21.15.46:0/3697687520 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f969803e960 0x7f9698040e70 crc :-1 s=READY pgs=3806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40a2df0 msgr2=0x7f96b41205c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 --2- 172.21.15.46:0/3697687520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40a2df0 0x7f96b41205c0 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 shutdown_connections 2024-09-11T14:36:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 --2- 172.21.15.46:0/3697687520 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f969803e960 0x7f9698040e70 unknown :-1 s=CLOSED pgs=3806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 --2- 172.21.15.46:0/3697687520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96b40a2df0 0x7f96b41205c0 unknown :-1 s=CLOSED pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 >> 172.21.15.46:0/3697687520 conn(0x7f96b40a4ad0 msgr2=0x7f96b4135420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 shutdown_connections 2024-09-11T14:36:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.658+0000 7f96bc111640 1 -- 172.21.15.46:0/3697687520 wait complete. 2024-09-11T14:36:43.674 INFO:tasks.workunit.client.0.smithi046.stderr:++ seq 1 10 2024-09-11T14:36:43.681 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:43.681 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj1 /etc/passwd 2024-09-11T14:36:43.730 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.729+0000 7f76b5832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.735+0000 7f76b5832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.735+0000 7f76b5832ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.736+0000 7f76b5832ec0 1 Processor -- start 2024-09-11T14:36:43.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.736+0000 7f76b5832ec0 1 -- start start 2024-09-11T14:36:43.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76b5832ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x18a1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76b5832ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1788520 con 0x1823450 2024-09-11T14:36:43.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76ad99b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x18a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76ad99b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x18a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42786/0 (socket says 172.21.15.46:42786) 2024-09-11T14:36:43.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76ad99b640 1 -- 172.21.15.46:0/2911106928 learned_addr learned my addr 172.21.15.46:0/2911106928 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:43.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76ad99b640 1 -- 172.21.15.46:0/2911106928 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1724e10 con 0x1823450 2024-09-11T14:36:43.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76ad99b640 1 --2- 172.21.15.46:0/2911106928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x18a1890 crc :-1 s=READY pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93ecf63304b2bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76a77fe640 1 -- 172.21.15.46:0/2911106928 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f769800b580 con 0x1823450 2024-09-11T14:36:43.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76a77fe640 1 -- 172.21.15.46:0/2911106928 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f769800b6e0 con 0x1823450 2024-09-11T14:36:43.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.738+0000 7f76a77fe640 1 -- 172.21.15.46:0/2911106928 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f769800b980 con 0x1823450 2024-09-11T14:36:43.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.739+0000 7f76b5832ec0 1 -- 172.21.15.46:0/2911106928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 msgr2=0x18a1890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.739+0000 7f76b5832ec0 1 --2- 172.21.15.46:0/2911106928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x18a1890 crc :-1 s=READY pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.739+0000 7f76b5832ec0 1 -- 172.21.15.46:0/2911106928 shutdown_connections 2024-09-11T14:36:43.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.739+0000 7f76b5832ec0 1 --2- 172.21.15.46:0/2911106928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x18a1890 unknown :-1 s=CLOSED pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.739+0000 7f76b5832ec0 1 -- 172.21.15.46:0/2911106928 >> 172.21.15.46:0/2911106928 conn(0x1748770 msgr2=0x181e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:43.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.739+0000 7f76b5832ec0 1 -- 172.21.15.46:0/2911106928 shutdown_connections 2024-09-11T14:36:43.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.739+0000 7f76b5832ec0 1 -- 172.21.15.46:0/2911106928 wait complete. 2024-09-11T14:36:43.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.740+0000 7f76b5832ec0 1 Processor -- start 2024-09-11T14:36:43.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.740+0000 7f76b5832ec0 1 -- start start 2024-09-11T14:36:43.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76b5832ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x181b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76b5832ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1786280 con 0x1823450 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76ad99b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x181b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76ad99b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x181b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42798/0 (socket says 172.21.15.46:42798) 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76ad99b640 1 -- 172.21.15.46:0/1641585371 learned_addr learned my addr 172.21.15.46:0/1641585371 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76ad99b640 1 -- 172.21.15.46:0/1641585371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1716920 con 0x1823450 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76ad99b640 1 --2- 172.21.15.46:0/1641585371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x181b780 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76a67fc640 1 -- 172.21.15.46:0/1641585371 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f76980129e0 con 0x1823450 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76a67fc640 1 -- 172.21.15.46:0/1641585371 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7698005040 con 0x1823450 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1716380 con 0x1823450 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76a67fc640 1 -- 172.21.15.46:0/1641585371 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7698012c70 con 0x1823450 2024-09-11T14:36:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.742+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x181d070 con 0x1823450 2024-09-11T14:36:43.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.744+0000 7f76a67fc640 1 -- 172.21.15.46:0/1641585371 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f769800d040 con 0x1823450 2024-09-11T14:36:43.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.744+0000 7f76a67fc640 1 --2- 172.21.15.46:0/1641585371 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f769403d1c0 0x7f769403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.744+0000 7f76a67fc640 1 -- 172.21.15.46:0/1641585371 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7f769800a040 con 0x1823450 2024-09-11T14:36:43.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.744+0000 7f76b5832ec0 1 --2- 172.21.15.46:0/1641585371 >> v2:172.21.15.46:6801/1724049974 conn(0x1823f70 0x194d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.744+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:1 199.7 199:ff7b1f36:::obj1:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x18aa840 con 0x1823f70 2024-09-11T14:36:43.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.744+0000 7f76ad19a640 1 --2- 172.21.15.46:0/1641585371 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f769403d1c0 0x7f769403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.745+0000 7f76ad19a640 1 --2- 172.21.15.46:0/1641585371 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f769403d1c0 0x7f769403f6d0 crc :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.745+0000 7f76ae19c640 1 --2- 172.21.15.46:0/1641585371 >> v2:172.21.15.46:6801/1724049974 conn(0x1823f70 0x194d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:43.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.749+0000 7f76ae19c640 1 --2- 172.21.15.46:0/1641585371 >> v2:172.21.15.46:6801/1724049974 conn(0x1823f70 0x194d250 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76ae19c640 1 -- 172.21.15.46:0/1641585371 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== osd_op_reply(1 obj1 [writefull 0~12777] v703'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f76a000a430 con 0x1823f70 2024-09-11T14:36:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 >> v2:172.21.15.46:6801/1724049974 conn(0x1823f70 msgr2=0x194d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 --2- 172.21.15.46:0/1641585371 >> v2:172.21.15.46:6801/1724049974 conn(0x1823f70 0x194d250 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f769403d1c0 msgr2=0x7f769403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 --2- 172.21.15.46:0/1641585371 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f769403d1c0 0x7f769403f6d0 crc :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 msgr2=0x181b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 --2- 172.21.15.46:0/1641585371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x181b780 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 shutdown_connections 2024-09-11T14:36:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 --2- 172.21.15.46:0/1641585371 >> v2:172.21.15.46:6801/1724049974 conn(0x1823f70 0x194d250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 --2- 172.21.15.46:0/1641585371 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f769403d1c0 0x7f769403f6d0 unknown :-1 s=CLOSED pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 --2- 172.21.15.46:0/1641585371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1823450 0x181b780 unknown :-1 s=CLOSED pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 >> 172.21.15.46:0/1641585371 conn(0x1748770 msgr2=0x181e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:43.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 shutdown_connections 2024-09-11T14:36:43.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.768+0000 7f76b5832ec0 1 -- 172.21.15.46:0/1641585371 wait complete. 2024-09-11T14:36:43.772 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:43.772 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj2 /etc/passwd 2024-09-11T14:36:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.808+0000 7f595c13fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.814+0000 7f595c13fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.814+0000 7f595c13fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.815+0000 7f595c13fec0 1 Processor -- start 2024-09-11T14:36:43.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.815+0000 7f595c13fec0 1 -- start start 2024-09-11T14:36:43.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f595c13fec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x7afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f595c13fec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x684520 con 0x7aed90 2024-09-11T14:36:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f594ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x7afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f594ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x7afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42818/0 (socket says 172.21.15.46:42818) 2024-09-11T14:36:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f594ffff640 1 -- 172.21.15.46:0/4087844568 learned_addr learned my addr 172.21.15.46:0/4087844568 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f594ffff640 1 -- 172.21.15.46:0/4087844568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x620e10 con 0x7aed90 2024-09-11T14:36:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f594ffff640 1 --2- 172.21.15.46:0/4087844568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x7afb70 crc :-1 s=READY pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5a2f82f6649656 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f594e7fc640 1 -- 172.21.15.46:0/4087844568 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f594800c490 con 0x7aed90 2024-09-11T14:36:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f594e7fc640 1 -- 172.21.15.46:0/4087844568 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f594800c5f0 con 0x7aed90 2024-09-11T14:36:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.817+0000 7f594e7fc640 1 -- 172.21.15.46:0/4087844568 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f594800c890 con 0x7aed90 2024-09-11T14:36:43.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.818+0000 7f595c13fec0 1 -- 172.21.15.46:0/4087844568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 msgr2=0x7afb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.818+0000 7f595c13fec0 1 --2- 172.21.15.46:0/4087844568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x7afb70 crc :-1 s=READY pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.818+0000 7f595c13fec0 1 -- 172.21.15.46:0/4087844568 shutdown_connections 2024-09-11T14:36:43.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.818+0000 7f595c13fec0 1 --2- 172.21.15.46:0/4087844568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x7afb70 unknown :-1 s=CLOSED pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.818+0000 7f595c13fec0 1 -- 172.21.15.46:0/4087844568 >> 172.21.15.46:0/4087844568 conn(0x644770 msgr2=0x7ac7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:43.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.818+0000 7f595c13fec0 1 -- 172.21.15.46:0/4087844568 shutdown_connections 2024-09-11T14:36:43.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.818+0000 7f595c13fec0 1 -- 172.21.15.46:0/4087844568 wait complete. 2024-09-11T14:36:43.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.819+0000 7f595c13fec0 1 Processor -- start 2024-09-11T14:36:43.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.819+0000 7f595c13fec0 1 -- start start 2024-09-11T14:36:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f595c13fec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x849640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f595c13fec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x682280 con 0x7aed90 2024-09-11T14:36:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f594ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x849640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f594ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x849640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42830/0 (socket says 172.21.15.46:42830) 2024-09-11T14:36:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f594ffff640 1 -- 172.21.15.46:0/2721074185 learned_addr learned my addr 172.21.15.46:0/2721074185 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f594ffff640 1 -- 172.21.15.46:0/2721074185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x612920 con 0x7aed90 2024-09-11T14:36:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f594ffff640 1 --2- 172.21.15.46:0/2721074185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x849640 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f594d7fa640 1 -- 172.21.15.46:0/2721074185 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59480111e0 con 0x7aed90 2024-09-11T14:36:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f594d7fa640 1 -- 172.21.15.46:0/2721074185 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5948011980 con 0x7aed90 2024-09-11T14:36:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.821+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x612380 con 0x7aed90 2024-09-11T14:36:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.822+0000 7f594d7fa640 1 -- 172.21.15.46:0/2721074185 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5948011af0 con 0x7aed90 2024-09-11T14:36:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.822+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7b1ed0 con 0x7aed90 2024-09-11T14:36:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.822+0000 7f594d7fa640 1 -- 172.21.15.46:0/2721074185 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f5948011ce0 con 0x7aed90 2024-09-11T14:36:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.823+0000 7f594d7fa640 1 --2- 172.21.15.46:0/2721074185 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f593003d1c0 0x7f593003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.823+0000 7f594d7fa640 1 -- 172.21.15.46:0/2721074185 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7f5948050220 con 0x7aed90 2024-09-11T14:36:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.823+0000 7f595c13fec0 1 --2- 172.21.15.46:0/2721074185 >> v2:172.21.15.47:6805/1666238977 conn(0x7b50e0 0x716fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.823+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 199.8 199:104778fc:::obj2:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x79f670 con 0x7b50e0 2024-09-11T14:36:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.823+0000 7f594f7fe640 1 --2- 172.21.15.46:0/2721074185 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f593003d1c0 0x7f593003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.824+0000 7f594f7fe640 1 --2- 172.21.15.46:0/2721074185 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f593003d1c0 0x7f593003f6d0 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.824+0000 7f5954d9c640 1 --2- 172.21.15.46:0/2721074185 >> v2:172.21.15.47:6805/1666238977 conn(0x7b50e0 0x716fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:43.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.829+0000 7f5954d9c640 1 --2- 172.21.15.46:0/2721074185 >> v2:172.21.15.47:6805/1666238977 conn(0x7b50e0 0x716fb0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f5954d9c640 1 -- 172.21.15.46:0/2721074185 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 obj2 [writefull 0~12777] v703'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f594000a430 con 0x7b50e0 2024-09-11T14:36:43.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 >> v2:172.21.15.47:6805/1666238977 conn(0x7b50e0 msgr2=0x716fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 --2- 172.21.15.46:0/2721074185 >> v2:172.21.15.47:6805/1666238977 conn(0x7b50e0 0x716fb0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f593003d1c0 msgr2=0x7f593003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 --2- 172.21.15.46:0/2721074185 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f593003d1c0 0x7f593003f6d0 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 msgr2=0x849640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 --2- 172.21.15.46:0/2721074185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x849640 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 shutdown_connections 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 --2- 172.21.15.46:0/2721074185 >> v2:172.21.15.47:6805/1666238977 conn(0x7b50e0 0x716fb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 --2- 172.21.15.46:0/2721074185 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f593003d1c0 0x7f593003f6d0 unknown :-1 s=CLOSED pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 --2- 172.21.15.46:0/2721074185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7aed90 0x849640 unknown :-1 s=CLOSED pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 >> 172.21.15.46:0/2721074185 conn(0x644770 msgr2=0x7afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 shutdown_connections 2024-09-11T14:36:43.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.850+0000 7f595c13fec0 1 -- 172.21.15.46:0/2721074185 wait complete. 2024-09-11T14:36:43.853 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:43.853 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj3 /etc/passwd 2024-09-11T14:36:43.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.889+0000 7f83e02edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.895+0000 7f83e02edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.895+0000 7f83e02edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.897 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.896+0000 7f83e02edec0 1 Processor -- start 2024-09-11T14:36:43.897 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.896+0000 7f83e02edec0 1 -- start start 2024-09-11T14:36:43.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.897+0000 7f83e02edec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x19630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.897+0000 7f83e02edec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x17ac520 con 0x1848120 2024-09-11T14:36:43.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.897+0000 7f83d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x19630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.897+0000 7f83d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x19630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42860/0 (socket says 172.21.15.46:42860) 2024-09-11T14:36:43.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.897+0000 7f83d37fe640 1 -- 172.21.15.46:0/1257691990 learned_addr learned my addr 172.21.15.46:0/1257691990 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:43.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.897+0000 7f83d37fe640 1 -- 172.21.15.46:0/1257691990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1748e10 con 0x1848120 2024-09-11T14:36:43.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.898+0000 7f83d37fe640 1 --2- 172.21.15.46:0/1257691990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x19630a0 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fadda167f025da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.898+0000 7f83d1ffb640 1 -- 172.21.15.46:0/1257691990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83c40061e0 con 0x1848120 2024-09-11T14:36:43.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.898+0000 7f83d1ffb640 1 -- 172.21.15.46:0/1257691990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f83c4006340 con 0x1848120 2024-09-11T14:36:43.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.898+0000 7f83d1ffb640 1 -- 172.21.15.46:0/1257691990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83c4004880 con 0x1848120 2024-09-11T14:36:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.898+0000 7f83e02edec0 1 -- 172.21.15.46:0/1257691990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 msgr2=0x19630a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.898+0000 7f83e02edec0 1 --2- 172.21.15.46:0/1257691990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x19630a0 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.898+0000 7f83e02edec0 1 -- 172.21.15.46:0/1257691990 shutdown_connections 2024-09-11T14:36:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.898+0000 7f83e02edec0 1 --2- 172.21.15.46:0/1257691990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x19630a0 unknown :-1 s=CLOSED pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.898+0000 7f83e02edec0 1 -- 172.21.15.46:0/1257691990 >> 172.21.15.46:0/1257691990 conn(0x176c770 msgr2=0x1842110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.899+0000 7f83e02edec0 1 -- 172.21.15.46:0/1257691990 shutdown_connections 2024-09-11T14:36:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.899+0000 7f83e02edec0 1 -- 172.21.15.46:0/1257691990 wait complete. 2024-09-11T14:36:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.899+0000 7f83e02edec0 1 Processor -- start 2024-09-11T14:36:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.900+0000 7f83e02edec0 1 -- start start 2024-09-11T14:36:43.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.901+0000 7f83e02edec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x18c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.901+0000 7f83e02edec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x17aa280 con 0x1848120 2024-09-11T14:36:43.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.901+0000 7f83d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x18c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.901+0000 7f83d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x18c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42866/0 (socket says 172.21.15.46:42866) 2024-09-11T14:36:43.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.901+0000 7f83d37fe640 1 -- 172.21.15.46:0/3324381777 learned_addr learned my addr 172.21.15.46:0/3324381777 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:43.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.901+0000 7f83d37fe640 1 -- 172.21.15.46:0/3324381777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x173a920 con 0x1848120 2024-09-11T14:36:43.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.901+0000 7f83d37fe640 1 --2- 172.21.15.46:0/3324381777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x18c5350 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.902+0000 7f83d0ff9640 1 -- 172.21.15.46:0/3324381777 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83c4001aa0 con 0x1848120 2024-09-11T14:36:43.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.902+0000 7f83d0ff9640 1 -- 172.21.15.46:0/3324381777 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f83c4001c00 con 0x1848120 2024-09-11T14:36:43.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.902+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x173a380 con 0x1848120 2024-09-11T14:36:43.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.902+0000 7f83d0ff9640 1 -- 172.21.15.46:0/3324381777 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83c4001ea0 con 0x1848120 2024-09-11T14:36:43.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.902+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x18c85d0 con 0x1848120 2024-09-11T14:36:43.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.903+0000 7f83d0ff9640 1 -- 172.21.15.46:0/3324381777 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f83c4013340 con 0x1848120 2024-09-11T14:36:43.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.903+0000 7f83d0ff9640 1 --2- 172.21.15.46:0/3324381777 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f83b403d1c0 0x7f83b403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.903+0000 7f83d0ff9640 1 -- 172.21.15.46:0/3324381777 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7f83c404f770 con 0x1848120 2024-09-11T14:36:43.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.903+0000 7f83e02edec0 1 --2- 172.21.15.46:0/3324381777 >> v2:172.21.15.46:6801/1724049974 conn(0x1848c40 0x18d85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.903+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:1 199.1 199:8dd16f86:::obj3:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x18c8d60 con 0x1848c40 2024-09-11T14:36:43.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.903+0000 7f83d2ffd640 1 --2- 172.21.15.46:0/3324381777 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f83b403d1c0 0x7f83b403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.904+0000 7f83d2ffd640 1 --2- 172.21.15.46:0/3324381777 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f83b403d1c0 0x7f83b403f6d0 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.904+0000 7f83d8f9c640 1 --2- 172.21.15.46:0/3324381777 >> v2:172.21.15.46:6801/1724049974 conn(0x1848c40 0x18d85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:43.909 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.908+0000 7f83d8f9c640 1 --2- 172.21.15.46:0/3324381777 >> v2:172.21.15.46:6801/1724049974 conn(0x1848c40 0x18d85d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83d8f9c640 1 -- 172.21.15.46:0/3324381777 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== osd_op_reply(1 obj3 [writefull 0~12777] v703'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f83cc00c430 con 0x1848c40 2024-09-11T14:36:43.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 >> v2:172.21.15.46:6801/1724049974 conn(0x1848c40 msgr2=0x18d85d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 --2- 172.21.15.46:0/3324381777 >> v2:172.21.15.46:6801/1724049974 conn(0x1848c40 0x18d85d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f83b403d1c0 msgr2=0x7f83b403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 --2- 172.21.15.46:0/3324381777 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f83b403d1c0 0x7f83b403f6d0 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 msgr2=0x18c5350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 --2- 172.21.15.46:0/3324381777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x18c5350 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 shutdown_connections 2024-09-11T14:36:43.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 --2- 172.21.15.46:0/3324381777 >> v2:172.21.15.46:6801/1724049974 conn(0x1848c40 0x18d85d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 --2- 172.21.15.46:0/3324381777 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f83b403d1c0 0x7f83b403f6d0 unknown :-1 s=CLOSED pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 --2- 172.21.15.46:0/3324381777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1848120 0x18c5350 unknown :-1 s=CLOSED pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 >> 172.21.15.46:0/3324381777 conn(0x176c770 msgr2=0x1842110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:43.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 shutdown_connections 2024-09-11T14:36:43.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.927+0000 7f83e02edec0 1 -- 172.21.15.46:0/3324381777 wait complete. 2024-09-11T14:36:43.931 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:43.931 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj4 /etc/passwd 2024-09-11T14:36:43.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.966+0000 7fd982e52ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.972+0000 7fd982e52ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.972+0000 7fd982e52ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:43.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.973+0000 7fd982e52ec0 1 Processor -- start 2024-09-11T14:36:43.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.973+0000 7fd982e52ec0 1 -- start start 2024-09-11T14:36:43.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd982e52ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cf120 0x2261aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd982e52ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x2133520 con 0x21cf120 2024-09-11T14:36:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd97af9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cf120 0x2261aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd97af9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cf120 0x2261aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42886/0 (socket says 172.21.15.46:42886) 2024-09-11T14:36:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd97af9b640 1 -- 172.21.15.46:0/314458177 learned_addr learned my addr 172.21.15.46:0/314458177 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd97af9b640 1 -- 172.21.15.46:0/314458177 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20cfe10 con 0x21cf120 2024-09-11T14:36:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd97af9b640 1 --2- 172.21.15.46:0/314458177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cf120 0x2261aa0 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e9d7cc4709870a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd979798640 1 -- 172.21.15.46:0/314458177 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd96400b580 con 0x21cf120 2024-09-11T14:36:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd979798640 1 -- 172.21.15.46:0/314458177 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd96400b6e0 con 0x21cf120 2024-09-11T14:36:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.975+0000 7fd979798640 1 -- 172.21.15.46:0/314458177 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd96400b980 con 0x21cf120 2024-09-11T14:36:43.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.976+0000 7fd982e52ec0 1 -- 172.21.15.46:0/314458177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cf120 msgr2=0x2261aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:43.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.976+0000 7fd982e52ec0 1 --2- 172.21.15.46:0/314458177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cf120 0x2261aa0 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.976+0000 7fd982e52ec0 1 -- 172.21.15.46:0/314458177 shutdown_connections 2024-09-11T14:36:43.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.976+0000 7fd982e52ec0 1 --2- 172.21.15.46:0/314458177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cf120 0x2261aa0 unknown :-1 s=CLOSED pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:43.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.976+0000 7fd982e52ec0 1 -- 172.21.15.46:0/314458177 >> 172.21.15.46:0/314458177 conn(0x20f3770 msgr2=0x21cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:43.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.976+0000 7fd982e52ec0 1 -- 172.21.15.46:0/314458177 shutdown_connections 2024-09-11T14:36:43.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.976+0000 7fd982e52ec0 1 -- 172.21.15.46:0/314458177 wait complete. 2024-09-11T14:36:43.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.977+0000 7fd982e52ec0 1 Processor -- start 2024-09-11T14:36:43.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.977+0000 7fd982e52ec0 1 -- start start 2024-09-11T14:36:43.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd982e52ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cfc40 0x224c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd982e52ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x2131280 con 0x21cfc40 2024-09-11T14:36:43.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd97af9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cfc40 0x224c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd97af9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cfc40 0x224c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42890/0 (socket says 172.21.15.46:42890) 2024-09-11T14:36:43.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd97af9b640 1 -- 172.21.15.46:0/3107520079 learned_addr learned my addr 172.21.15.46:0/3107520079 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:43.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd97af9b640 1 -- 172.21.15.46:0/3107520079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20c1920 con 0x21cfc40 2024-09-11T14:36:43.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd97af9b640 1 --2- 172.21.15.46:0/3107520079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cfc40 0x224c720 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd9737fe640 1 -- 172.21.15.46:0/3107520079 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd9640128a0 con 0x21cfc40 2024-09-11T14:36:43.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd9737fe640 1 -- 172.21.15.46:0/3107520079 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd964005040 con 0x21cfc40 2024-09-11T14:36:43.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x20c1380 con 0x21cfc40 2024-09-11T14:36:43.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.979+0000 7fd9737fe640 1 -- 172.21.15.46:0/3107520079 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd964012b30 con 0x21cfc40 2024-09-11T14:36:43.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.980+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x224e750 con 0x21cfc40 2024-09-11T14:36:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.980+0000 7fd9737fe640 1 -- 172.21.15.46:0/3107520079 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd96400d040 con 0x21cfc40 2024-09-11T14:36:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.981+0000 7fd9737fe640 1 --2- 172.21.15.46:0/3107520079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd96003d1c0 0x7fd96003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.981+0000 7fd9737fe640 1 -- 172.21.15.46:0/3107520079 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7fd96400a040 con 0x21cfc40 2024-09-11T14:36:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.981+0000 7fd982e52ec0 1 --2- 172.21.15.46:0/3107520079 >> v2:172.21.15.46:6805/1751227380 conn(0x225f9d0 0x225fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.981+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:1 199.0 199:0ee9ae15:::obj4:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x224ff40 con 0x225f9d0 2024-09-11T14:36:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.981+0000 7fd97a79a640 1 --2- 172.21.15.46:0/3107520079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd96003d1c0 0x7fd96003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.981+0000 7fd97a79a640 1 --2- 172.21.15.46:0/3107520079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd96003d1c0 0x7fd96003f6d0 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.982+0000 7fd97b79c640 1 --2- 172.21.15.46:0/3107520079 >> v2:172.21.15.46:6805/1751227380 conn(0x225f9d0 0x225fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:43.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:43.985+0000 7fd97b79c640 1 --2- 172.21.15.46:0/3107520079 >> v2:172.21.15.46:6805/1751227380 conn(0x225f9d0 0x225fde0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd97b79c640 1 -- 172.21.15.46:0/3107520079 <== osd.1 v2:172.21.15.46:6805/1751227380 1 ==== osd_op_reply(1 obj4 [writefull 0~12777] v703'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd96c00a430 con 0x225f9d0 2024-09-11T14:36:44.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 >> v2:172.21.15.46:6805/1751227380 conn(0x225f9d0 msgr2=0x225fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 --2- 172.21.15.46:0/3107520079 >> v2:172.21.15.46:6805/1751227380 conn(0x225f9d0 0x225fde0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd96003d1c0 msgr2=0x7fd96003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 --2- 172.21.15.46:0/3107520079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd96003d1c0 0x7fd96003f6d0 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cfc40 msgr2=0x224c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 --2- 172.21.15.46:0/3107520079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cfc40 0x224c720 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 shutdown_connections 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 --2- 172.21.15.46:0/3107520079 >> v2:172.21.15.46:6805/1751227380 conn(0x225f9d0 0x225fde0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 --2- 172.21.15.46:0/3107520079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd96003d1c0 0x7fd96003f6d0 unknown :-1 s=CLOSED pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 --2- 172.21.15.46:0/3107520079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x21cfc40 0x224c720 unknown :-1 s=CLOSED pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.006+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 >> 172.21.15.46:0/3107520079 conn(0x20f3770 msgr2=0x2261750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.007+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 shutdown_connections 2024-09-11T14:36:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.007+0000 7fd982e52ec0 1 -- 172.21.15.46:0/3107520079 wait complete. 2024-09-11T14:36:44.010 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:44.010 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj5 /etc/passwd 2024-09-11T14:36:44.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.046+0000 7f63d7440ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.052+0000 7f63d7440ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.052+0000 7f63d7440ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.053+0000 7f63d7440ec0 1 Processor -- start 2024-09-11T14:36:44.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.053+0000 7f63d7440ec0 1 -- start start 2024-09-11T14:36:44.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.054+0000 7f63d7440ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x7d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.054+0000 7f63d7440ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x6a8520 con 0x742820 2024-09-11T14:36:44.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.054+0000 7f63cf59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x7d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.054+0000 7f63cf59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x7d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42908/0 (socket says 172.21.15.46:42908) 2024-09-11T14:36:44.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.054+0000 7f63cf59b640 1 -- 172.21.15.46:0/1931129392 learned_addr learned my addr 172.21.15.46:0/1931129392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.055+0000 7f63cf59b640 1 -- 172.21.15.46:0/1931129392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x644e10 con 0x742820 2024-09-11T14:36:44.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.055+0000 7f63cf59b640 1 --2- 172.21.15.46:0/1931129392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x7d4d00 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5865810d8011ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.055+0000 7f63cdd98640 1 -- 172.21.15.46:0/1931129392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f63b802db00 con 0x742820 2024-09-11T14:36:44.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.055+0000 7f63cdd98640 1 -- 172.21.15.46:0/1931129392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f63b802dc60 con 0x742820 2024-09-11T14:36:44.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.055+0000 7f63cdd98640 1 -- 172.21.15.46:0/1931129392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f63b802ddd0 con 0x742820 2024-09-11T14:36:44.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.056+0000 7f63d7440ec0 1 -- 172.21.15.46:0/1931129392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 msgr2=0x7d4d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.056+0000 7f63d7440ec0 1 --2- 172.21.15.46:0/1931129392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x7d4d00 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.056+0000 7f63d7440ec0 1 -- 172.21.15.46:0/1931129392 shutdown_connections 2024-09-11T14:36:44.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.056+0000 7f63d7440ec0 1 --2- 172.21.15.46:0/1931129392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x7d4d00 unknown :-1 s=CLOSED pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.056+0000 7f63d7440ec0 1 -- 172.21.15.46:0/1931129392 >> 172.21.15.46:0/1931129392 conn(0x668770 msgr2=0x7d6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.056+0000 7f63d7440ec0 1 -- 172.21.15.46:0/1931129392 shutdown_connections 2024-09-11T14:36:44.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.056+0000 7f63d7440ec0 1 -- 172.21.15.46:0/1931129392 wait complete. 2024-09-11T14:36:44.059 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.057+0000 7f63d7440ec0 1 Processor -- start 2024-09-11T14:36:44.059 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.057+0000 7f63d7440ec0 1 -- start start 2024-09-11T14:36:44.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.058+0000 7f63d7440ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x8640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.058+0000 7f63d7440ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x6a6280 con 0x742820 2024-09-11T14:36:44.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.058+0000 7f63cf59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x8640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.058+0000 7f63cf59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x8640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42916/0 (socket says 172.21.15.46:42916) 2024-09-11T14:36:44.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.058+0000 7f63cf59b640 1 -- 172.21.15.46:0/3870926641 learned_addr learned my addr 172.21.15.46:0/3870926641 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.059+0000 7f63cf59b640 1 -- 172.21.15.46:0/3870926641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x636920 con 0x742820 2024-09-11T14:36:44.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.059+0000 7f63cf59b640 1 --2- 172.21.15.46:0/3870926641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x8640a0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.059+0000 7f63ccd96640 1 -- 172.21.15.46:0/3870926641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f63b8005aa0 con 0x742820 2024-09-11T14:36:44.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.059+0000 7f63ccd96640 1 -- 172.21.15.46:0/3870926641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f63b802d7d0 con 0x742820 2024-09-11T14:36:44.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.059+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x636380 con 0x742820 2024-09-11T14:36:44.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.059+0000 7f63ccd96640 1 -- 172.21.15.46:0/3870926641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f63b8038b10 con 0x742820 2024-09-11T14:36:44.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.059+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x73c500 con 0x742820 2024-09-11T14:36:44.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.060+0000 7f63ccd96640 1 -- 172.21.15.46:0/3870926641 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f63b8003040 con 0x742820 2024-09-11T14:36:44.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.060+0000 7f63ccd96640 1 --2- 172.21.15.46:0/3870926641 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f63b403d1c0 0x7f63b403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.060+0000 7f63ccd96640 1 -- 172.21.15.46:0/3870926641 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7f63b803f040 con 0x742820 2024-09-11T14:36:44.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.060+0000 7f63d7440ec0 1 --2- 172.21.15.46:0/3870926641 >> v2:172.21.15.47:6805/1666238977 conn(0x7d2d90 0x86d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.060+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 199.3 199:c52c9666:::obj5:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x862b50 con 0x7d2d90 2024-09-11T14:36:44.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.061+0000 7f63ced9a640 1 --2- 172.21.15.46:0/3870926641 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f63b403d1c0 0x7f63b403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.061+0000 7f63ced9a640 1 --2- 172.21.15.46:0/3870926641 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f63b403d1c0 0x7f63b403f6d0 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.062+0000 7f63cfd9c640 1 --2- 172.21.15.46:0/3870926641 >> v2:172.21.15.47:6805/1666238977 conn(0x7d2d90 0x86d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:44.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.066+0000 7f63cfd9c640 1 --2- 172.21.15.46:0/3870926641 >> v2:172.21.15.47:6805/1666238977 conn(0x7d2d90 0x86d900 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63cfd9c640 1 -- 172.21.15.46:0/3870926641 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 obj5 [writefull 0~12777] v703'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f63c000c430 con 0x7d2d90 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 >> v2:172.21.15.47:6805/1666238977 conn(0x7d2d90 msgr2=0x86d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 --2- 172.21.15.46:0/3870926641 >> v2:172.21.15.47:6805/1666238977 conn(0x7d2d90 0x86d900 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f63b403d1c0 msgr2=0x7f63b403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 --2- 172.21.15.46:0/3870926641 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f63b403d1c0 0x7f63b403f6d0 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 msgr2=0x8640a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 --2- 172.21.15.46:0/3870926641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x8640a0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 shutdown_connections 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 --2- 172.21.15.46:0/3870926641 >> v2:172.21.15.47:6805/1666238977 conn(0x7d2d90 0x86d900 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 --2- 172.21.15.46:0/3870926641 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f63b403d1c0 0x7f63b403f6d0 unknown :-1 s=CLOSED pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 --2- 172.21.15.46:0/3870926641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x742820 0x8640a0 unknown :-1 s=CLOSED pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 >> 172.21.15.46:0/3870926641 conn(0x668770 msgr2=0x742c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 shutdown_connections 2024-09-11T14:36:44.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.091+0000 7f63d7440ec0 1 -- 172.21.15.46:0/3870926641 wait complete. 2024-09-11T14:36:44.094 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:44.094 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj6 /etc/passwd 2024-09-11T14:36:44.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.130+0000 7f3fb3635ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.136+0000 7f3fb3635ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.136+0000 7f3fb3635ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.137+0000 7f3fb3635ec0 1 Processor -- start 2024-09-11T14:36:44.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.137+0000 7f3fb3635ec0 1 -- start start 2024-09-11T14:36:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.138+0000 7f3fb3635ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x14d6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.138+0000 7f3fb3635ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x143d520 con 0x14d0810 2024-09-11T14:36:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.138+0000 7f3fab79b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x14d6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.138+0000 7f3fab79b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x14d6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42938/0 (socket says 172.21.15.46:42938) 2024-09-11T14:36:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.138+0000 7f3fab79b640 1 -- 172.21.15.46:0/17890917 learned_addr learned my addr 172.21.15.46:0/17890917 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.139+0000 7f3fab79b640 1 -- 172.21.15.46:0/17890917 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13d9e10 con 0x14d0810 2024-09-11T14:36:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.139+0000 7f3fab79b640 1 --2- 172.21.15.46:0/17890917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x14d6020 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f3d7a929dadc5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.139+0000 7f3fa9f98640 1 -- 172.21.15.46:0/17890917 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f9402dc90 con 0x14d0810 2024-09-11T14:36:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.139+0000 7f3fa9f98640 1 -- 172.21.15.46:0/17890917 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3f9402de90 con 0x14d0810 2024-09-11T14:36:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.139+0000 7f3fa9f98640 1 -- 172.21.15.46:0/17890917 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f9400a170 con 0x14d0810 2024-09-11T14:36:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.139+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/17890917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 msgr2=0x14d6020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.139+0000 7f3fb3635ec0 1 --2- 172.21.15.46:0/17890917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x14d6020 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.140+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/17890917 shutdown_connections 2024-09-11T14:36:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.140+0000 7f3fb3635ec0 1 --2- 172.21.15.46:0/17890917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x14d6020 unknown :-1 s=CLOSED pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.140+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/17890917 >> 172.21.15.46:0/17890917 conn(0x13fd770 msgr2=0x14d4670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.140+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/17890917 shutdown_connections 2024-09-11T14:36:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.140+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/17890917 wait complete. 2024-09-11T14:36:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.141+0000 7f3fb3635ec0 1 Processor -- start 2024-09-11T14:36:44.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.141+0000 7f3fb3635ec0 1 -- start start 2024-09-11T14:36:44.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.142+0000 7f3fb3635ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x15f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.142+0000 7f3fb3635ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x143b280 con 0x14d0810 2024-09-11T14:36:44.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.142+0000 7f3fab79b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x15f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.142+0000 7f3fab79b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x15f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42954/0 (socket says 172.21.15.46:42954) 2024-09-11T14:36:44.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.142+0000 7f3fab79b640 1 -- 172.21.15.46:0/208709728 learned_addr learned my addr 172.21.15.46:0/208709728 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.142+0000 7f3fab79b640 1 -- 172.21.15.46:0/208709728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13cb920 con 0x14d0810 2024-09-11T14:36:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.143+0000 7f3fab79b640 1 --2- 172.21.15.46:0/208709728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x15f4c30 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.143+0000 7f3fa8f96640 1 -- 172.21.15.46:0/208709728 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f94009820 con 0x14d0810 2024-09-11T14:36:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.143+0000 7f3fa8f96640 1 -- 172.21.15.46:0/208709728 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3f94009980 con 0x14d0810 2024-09-11T14:36:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.143+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13cb380 con 0x14d0810 2024-09-11T14:36:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.143+0000 7f3fa8f96640 1 -- 172.21.15.46:0/208709728 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f94009c20 con 0x14d0810 2024-09-11T14:36:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.143+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15f4130 con 0x14d0810 2024-09-11T14:36:44.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.144+0000 7f3fa8f96640 1 -- 172.21.15.46:0/208709728 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3f940393f0 con 0x14d0810 2024-09-11T14:36:44.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.144+0000 7f3fa8f96640 1 --2- 172.21.15.46:0/208709728 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3f9003d1c0 0x7f3f9003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.144+0000 7f3fa8f96640 1 -- 172.21.15.46:0/208709728 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7f3f94032040 con 0x14d0810 2024-09-11T14:36:44.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.144+0000 7f3fb3635ec0 1 --2- 172.21.15.46:0/208709728 >> v2:172.21.15.46:6801/1724049974 conn(0x14d9660 0x15f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.144+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:1 199.4 199:233a42c1:::obj6:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x15f3190 con 0x14d9660 2024-09-11T14:36:44.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.144+0000 7f3faaf9a640 1 --2- 172.21.15.46:0/208709728 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3f9003d1c0 0x7f3f9003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.145+0000 7f3faaf9a640 1 --2- 172.21.15.46:0/208709728 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3f9003d1c0 0x7f3f9003f6d0 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.145+0000 7f3fabf9c640 1 --2- 172.21.15.46:0/208709728 >> v2:172.21.15.46:6801/1724049974 conn(0x14d9660 0x15f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:44.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.149+0000 7f3fabf9c640 1 --2- 172.21.15.46:0/208709728 >> v2:172.21.15.46:6801/1724049974 conn(0x14d9660 0x15f09c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.168+0000 7f3fabf9c640 1 -- 172.21.15.46:0/208709728 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== osd_op_reply(1 obj6 [writefull 0~12777] v703'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3f9c00a430 con 0x14d9660 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 >> v2:172.21.15.46:6801/1724049974 conn(0x14d9660 msgr2=0x15f09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 --2- 172.21.15.46:0/208709728 >> v2:172.21.15.46:6801/1724049974 conn(0x14d9660 0x15f09c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3f9003d1c0 msgr2=0x7f3f9003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 --2- 172.21.15.46:0/208709728 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3f9003d1c0 0x7f3f9003f6d0 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 msgr2=0x15f4c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 --2- 172.21.15.46:0/208709728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x15f4c30 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 shutdown_connections 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 --2- 172.21.15.46:0/208709728 >> v2:172.21.15.46:6801/1724049974 conn(0x14d9660 0x15f09c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 --2- 172.21.15.46:0/208709728 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f3f9003d1c0 0x7f3f9003f6d0 unknown :-1 s=CLOSED pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 --2- 172.21.15.46:0/208709728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14d0810 0x15f4c30 unknown :-1 s=CLOSED pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 >> 172.21.15.46:0/208709728 conn(0x13fd770 msgr2=0x14d42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 shutdown_connections 2024-09-11T14:36:44.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.169+0000 7f3fb3635ec0 1 -- 172.21.15.46:0/208709728 wait complete. 2024-09-11T14:36:44.173 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:44.173 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj7 /etc/passwd 2024-09-11T14:36:44.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.208+0000 7f0e1b363ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.214+0000 7f0e1b363ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.215+0000 7f0e1b363ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.216+0000 7f0e1b363ec0 1 Processor -- start 2024-09-11T14:36:44.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.216+0000 7f0e1b363ec0 1 -- start start 2024-09-11T14:36:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.217+0000 7f0e1b363ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x166a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.217+0000 7f0e1b363ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x14b3520 con 0x154f120 2024-09-11T14:36:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.217+0000 7f0e1379b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x166a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.217+0000 7f0e1379b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x166a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42960/0 (socket says 172.21.15.46:42960) 2024-09-11T14:36:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.217+0000 7f0e1379b640 1 -- 172.21.15.46:0/4030095897 learned_addr learned my addr 172.21.15.46:0/4030095897 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.217+0000 7f0e1379b640 1 -- 172.21.15.46:0/4030095897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x144fe10 con 0x154f120 2024-09-11T14:36:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e1379b640 1 --2- 172.21.15.46:0/4030095897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x166a0a0 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21fabc3120f22db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e11f98640 1 -- 172.21.15.46:0/4030095897 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0dfc00b500 con 0x154f120 2024-09-11T14:36:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e11f98640 1 -- 172.21.15.46:0/4030095897 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0dfc00b660 con 0x154f120 2024-09-11T14:36:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e11f98640 1 -- 172.21.15.46:0/4030095897 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0dfc00b900 con 0x154f120 2024-09-11T14:36:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/4030095897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 msgr2=0x166a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e1b363ec0 1 --2- 172.21.15.46:0/4030095897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x166a0a0 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/4030095897 shutdown_connections 2024-09-11T14:36:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e1b363ec0 1 --2- 172.21.15.46:0/4030095897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x166a0a0 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/4030095897 >> 172.21.15.46:0/4030095897 conn(0x1473770 msgr2=0x1549110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/4030095897 shutdown_connections 2024-09-11T14:36:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.218+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/4030095897 wait complete. 2024-09-11T14:36:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.219+0000 7f0e1b363ec0 1 Processor -- start 2024-09-11T14:36:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.220+0000 7f0e1b363ec0 1 -- start start 2024-09-11T14:36:44.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.221+0000 7f0e1b363ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x15cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.221+0000 7f0e1b363ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x14b1280 con 0x154f120 2024-09-11T14:36:44.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.221+0000 7f0e1379b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x15cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.221+0000 7f0e1379b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x15cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42970/0 (socket says 172.21.15.46:42970) 2024-09-11T14:36:44.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.221+0000 7f0e1379b640 1 -- 172.21.15.46:0/163790661 learned_addr learned my addr 172.21.15.46:0/163790661 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.221+0000 7f0e1379b640 1 -- 172.21.15.46:0/163790661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1441920 con 0x154f120 2024-09-11T14:36:44.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.222+0000 7f0e1379b640 1 --2- 172.21.15.46:0/163790661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x15cc350 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.222+0000 7f0e10f96640 1 -- 172.21.15.46:0/163790661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0dfc0111e0 con 0x154f120 2024-09-11T14:36:44.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.222+0000 7f0e10f96640 1 -- 172.21.15.46:0/163790661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0dfc011880 con 0x154f120 2024-09-11T14:36:44.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.222+0000 7f0e10f96640 1 -- 172.21.15.46:0/163790661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0dfc0119f0 con 0x154f120 2024-09-11T14:36:44.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.222+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1441380 con 0x154f120 2024-09-11T14:36:44.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.222+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15cf5d0 con 0x154f120 2024-09-11T14:36:44.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.223+0000 7f0e10f96640 1 -- 172.21.15.46:0/163790661 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0dfc011ba0 con 0x154f120 2024-09-11T14:36:44.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.223+0000 7f0e10f96640 1 --2- 172.21.15.46:0/163790661 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0df803d1c0 0x7f0df803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.223+0000 7f0e10f96640 1 -- 172.21.15.46:0/163790661 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7f0dfc050120 con 0x154f120 2024-09-11T14:36:44.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.223+0000 7f0e1b363ec0 1 --2- 172.21.15.46:0/163790661 >> v2:172.21.15.46:6805/1751227380 conn(0x154fc40 0x15df5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.223+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:1 199.9 199:9a09113a:::obj7:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x15cfd60 con 0x154fc40 2024-09-11T14:36:44.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.223+0000 7f0e12f9a640 1 --2- 172.21.15.46:0/163790661 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0df803d1c0 0x7f0df803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.224+0000 7f0e12f9a640 1 --2- 172.21.15.46:0/163790661 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0df803d1c0 0x7f0df803f6d0 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.224+0000 7f0e13f9c640 1 --2- 172.21.15.46:0/163790661 >> v2:172.21.15.46:6805/1751227380 conn(0x154fc40 0x15df5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:44.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.227+0000 7f0e13f9c640 1 --2- 172.21.15.46:0/163790661 >> v2:172.21.15.46:6805/1751227380 conn(0x154fc40 0x15df5d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.248+0000 7f0e13f9c640 1 -- 172.21.15.46:0/163790661 <== osd.1 v2:172.21.15.46:6805/1751227380 1 ==== osd_op_reply(1 obj7 [writefull 0~12777] v703'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0e0400a430 con 0x154fc40 2024-09-11T14:36:44.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.248+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 >> v2:172.21.15.46:6805/1751227380 conn(0x154fc40 msgr2=0x15df5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.248+0000 7f0e1b363ec0 1 --2- 172.21.15.46:0/163790661 >> v2:172.21.15.46:6805/1751227380 conn(0x154fc40 0x15df5d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0df803d1c0 msgr2=0x7f0df803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 --2- 172.21.15.46:0/163790661 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0df803d1c0 0x7f0df803f6d0 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 msgr2=0x15cc350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 --2- 172.21.15.46:0/163790661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x15cc350 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 shutdown_connections 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 --2- 172.21.15.46:0/163790661 >> v2:172.21.15.46:6805/1751227380 conn(0x154fc40 0x15df5d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 --2- 172.21.15.46:0/163790661 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0df803d1c0 0x7f0df803f6d0 unknown :-1 s=CLOSED pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 --2- 172.21.15.46:0/163790661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x154f120 0x15cc350 unknown :-1 s=CLOSED pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 >> 172.21.15.46:0/163790661 conn(0x1473770 msgr2=0x1549110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 shutdown_connections 2024-09-11T14:36:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.249+0000 7f0e1b363ec0 1 -- 172.21.15.46:0/163790661 wait complete. 2024-09-11T14:36:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj8 /etc/passwd 2024-09-11T14:36:44.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.289+0000 7faf99041ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.295+0000 7faf99041ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.295+0000 7faf99041ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.296+0000 7faf99041ec0 1 Processor -- start 2024-09-11T14:36:44.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.296+0000 7faf99041ec0 1 -- start start 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.297+0000 7faf99041ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a2e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.297+0000 7faf99041ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1878520 con 0x1914120 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.297+0000 7faf9119b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a2e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.297+0000 7faf9119b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a2e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42988/0 (socket says 172.21.15.46:42988) 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.297+0000 7faf9119b640 1 -- 172.21.15.46:0/4183653365 learned_addr learned my addr 172.21.15.46:0/4183653365 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.297+0000 7faf9119b640 1 -- 172.21.15.46:0/4183653365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1814e10 con 0x1914120 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.298+0000 7faf9119b640 1 --2- 172.21.15.46:0/4183653365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a2e090 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa98c0377abb44b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.298+0000 7faf8affd640 1 -- 172.21.15.46:0/4183653365 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faf7c02d8e0 con 0x1914120 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.298+0000 7faf8affd640 1 -- 172.21.15.46:0/4183653365 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faf7c02da90 con 0x1914120 2024-09-11T14:36:44.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.298+0000 7faf8affd640 1 -- 172.21.15.46:0/4183653365 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faf7c02dd30 con 0x1914120 2024-09-11T14:36:44.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.298+0000 7faf99041ec0 1 -- 172.21.15.46:0/4183653365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 msgr2=0x1a2e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.298+0000 7faf99041ec0 1 --2- 172.21.15.46:0/4183653365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a2e090 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.298+0000 7faf99041ec0 1 -- 172.21.15.46:0/4183653365 shutdown_connections 2024-09-11T14:36:44.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.298+0000 7faf99041ec0 1 --2- 172.21.15.46:0/4183653365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a2e090 unknown :-1 s=CLOSED pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.298+0000 7faf99041ec0 1 -- 172.21.15.46:0/4183653365 >> 172.21.15.46:0/4183653365 conn(0x1838770 msgr2=0x190e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.299+0000 7faf99041ec0 1 -- 172.21.15.46:0/4183653365 shutdown_connections 2024-09-11T14:36:44.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.299+0000 7faf99041ec0 1 -- 172.21.15.46:0/4183653365 wait complete. 2024-09-11T14:36:44.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.300+0000 7faf99041ec0 1 Processor -- start 2024-09-11T14:36:44.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.300+0000 7faf99041ec0 1 -- start start 2024-09-11T14:36:44.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.301+0000 7faf99041ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a3d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.301+0000 7faf99041ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1876280 con 0x1914120 2024-09-11T14:36:44.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.301+0000 7faf9119b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a3d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.301+0000 7faf9119b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a3d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42996/0 (socket says 172.21.15.46:42996) 2024-09-11T14:36:44.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.301+0000 7faf9119b640 1 -- 172.21.15.46:0/786694239 learned_addr learned my addr 172.21.15.46:0/786694239 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.301+0000 7faf9119b640 1 -- 172.21.15.46:0/786694239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1806920 con 0x1914120 2024-09-11T14:36:44.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.302+0000 7faf9119b640 1 --2- 172.21.15.46:0/786694239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a3d3c0 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.302+0000 7faf89ffb640 1 -- 172.21.15.46:0/786694239 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faf7c039660 con 0x1914120 2024-09-11T14:36:44.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.302+0000 7faf89ffb640 1 -- 172.21.15.46:0/786694239 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faf7c0397c0 con 0x1914120 2024-09-11T14:36:44.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.302+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1806380 con 0x1914120 2024-09-11T14:36:44.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.302+0000 7faf89ffb640 1 -- 172.21.15.46:0/786694239 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faf7c039a60 con 0x1914120 2024-09-11T14:36:44.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.302+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1996a60 con 0x1914120 2024-09-11T14:36:44.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.303+0000 7faf89ffb640 1 -- 172.21.15.46:0/786694239 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7faf7c039c60 con 0x1914120 2024-09-11T14:36:44.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.303+0000 7faf89ffb640 1 --2- 172.21.15.46:0/786694239 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7faf7803d170 0x7faf7803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.303+0000 7faf89ffb640 1 -- 172.21.15.46:0/786694239 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7faf7c03e040 con 0x1914120 2024-09-11T14:36:44.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.303+0000 7faf9099a640 1 --2- 172.21.15.46:0/786694239 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7faf7803d170 0x7faf7803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.304+0000 7faf99041ec0 1 --2- 172.21.15.46:0/786694239 >> v2:172.21.15.47:6803/3757354244 conn(0x1914a70 0x19946d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.304+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 --> v2:172.21.15.47:6803/3757354244 -- osd_op(unknown.0.0:1 199.5 199:a557efb1:::obj8:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x1a2ed10 con 0x1914a70 2024-09-11T14:36:44.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.304+0000 7faf9099a640 1 --2- 172.21.15.46:0/786694239 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7faf7803d170 0x7faf7803f680 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.305+0000 7faf9199c640 1 --2- 172.21.15.46:0/786694239 >> v2:172.21.15.47:6803/3757354244 conn(0x1914a70 0x19946d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:44.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.309+0000 7faf9199c640 1 --2- 172.21.15.46:0/786694239 >> v2:172.21.15.47:6803/3757354244 conn(0x1914a70 0x19946d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf9199c640 1 -- 172.21.15.46:0/786694239 <== osd.2 v2:172.21.15.47:6803/3757354244 1 ==== osd_op_reply(1 obj8 [writefull 0~12777] v703'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7faf8400c430 con 0x1914a70 2024-09-11T14:36:44.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 >> v2:172.21.15.47:6803/3757354244 conn(0x1914a70 msgr2=0x19946d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 --2- 172.21.15.46:0/786694239 >> v2:172.21.15.47:6803/3757354244 conn(0x1914a70 0x19946d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7faf7803d170 msgr2=0x7faf7803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 --2- 172.21.15.46:0/786694239 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7faf7803d170 0x7faf7803f680 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 msgr2=0x1a3d3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 --2- 172.21.15.46:0/786694239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a3d3c0 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 shutdown_connections 2024-09-11T14:36:44.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 --2- 172.21.15.46:0/786694239 >> v2:172.21.15.47:6803/3757354244 conn(0x1914a70 0x19946d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 --2- 172.21.15.46:0/786694239 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7faf7803d170 0x7faf7803f680 unknown :-1 s=CLOSED pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 --2- 172.21.15.46:0/786694239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1914120 0x1a3d3c0 unknown :-1 s=CLOSED pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 >> 172.21.15.46:0/786694239 conn(0x1838770 msgr2=0x190e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 shutdown_connections 2024-09-11T14:36:44.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.330+0000 7faf99041ec0 1 -- 172.21.15.46:0/786694239 wait complete. 2024-09-11T14:36:44.334 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:44.334 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj9 /etc/passwd 2024-09-11T14:36:44.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.371+0000 7fe318f09ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.376+0000 7fe318f09ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.377+0000 7fe318f09ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.377+0000 7fe318f09ec0 1 Processor -- start 2024-09-11T14:36:44.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.378+0000 7fe318f09ec0 1 -- start start 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.379+0000 7fe318f09ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1ab6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.379+0000 7fe318f09ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1a24520 con 0x1b50f40 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.379+0000 7fe31183f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1ab6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.379+0000 7fe31183f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1ab6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43000/0 (socket says 172.21.15.46:43000) 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.379+0000 7fe31183f640 1 -- 172.21.15.46:0/3986439555 learned_addr learned my addr 172.21.15.46:0/3986439555 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.379+0000 7fe31183f640 1 -- 172.21.15.46:0/3986439555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19c0e10 con 0x1b50f40 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.379+0000 7fe31183f640 1 --2- 172.21.15.46:0/3986439555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1ab6670 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6146e34764ccb38c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe30bfff640 1 -- 172.21.15.46:0/3986439555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe2fc00b580 con 0x1b50f40 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe30bfff640 1 -- 172.21.15.46:0/3986439555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe2fc00b6e0 con 0x1b50f40 2024-09-11T14:36:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe30bfff640 1 -- 172.21.15.46:0/3986439555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe2fc00b980 con 0x1b50f40 2024-09-11T14:36:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe318f09ec0 1 -- 172.21.15.46:0/3986439555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 msgr2=0x1ab6670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe318f09ec0 1 --2- 172.21.15.46:0/3986439555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1ab6670 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe318f09ec0 1 -- 172.21.15.46:0/3986439555 shutdown_connections 2024-09-11T14:36:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe318f09ec0 1 --2- 172.21.15.46:0/3986439555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1ab6670 unknown :-1 s=CLOSED pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe318f09ec0 1 -- 172.21.15.46:0/3986439555 >> 172.21.15.46:0/3986439555 conn(0x19e4770 msgr2=0x1b4d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe318f09ec0 1 -- 172.21.15.46:0/3986439555 shutdown_connections 2024-09-11T14:36:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.380+0000 7fe318f09ec0 1 -- 172.21.15.46:0/3986439555 wait complete. 2024-09-11T14:36:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.381+0000 7fe318f09ec0 1 Processor -- start 2024-09-11T14:36:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.381+0000 7fe318f09ec0 1 -- start start 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.383+0000 7fe318f09ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1b3bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.383+0000 7fe318f09ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1a22280 con 0x1b50f40 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.383+0000 7fe31183f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1b3bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.383+0000 7fe31183f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1b3bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43012/0 (socket says 172.21.15.46:43012) 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.383+0000 7fe31183f640 1 -- 172.21.15.46:0/70265779 learned_addr learned my addr 172.21.15.46:0/70265779 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.383+0000 7fe31183f640 1 -- 172.21.15.46:0/70265779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19b2920 con 0x1b50f40 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.383+0000 7fe31183f640 1 --2- 172.21.15.46:0/70265779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1b3bf40 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.383+0000 7fe30affd640 1 -- 172.21.15.46:0/70265779 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe2fc0128e0 con 0x1b50f40 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.384+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x19b2380 con 0x1b50f40 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.383+0000 7fe30affd640 1 -- 172.21.15.46:0/70265779 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe2fc005040 con 0x1b50f40 2024-09-11T14:36:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.384+0000 7fe30affd640 1 -- 172.21.15.46:0/70265779 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe2fc012b70 con 0x1b50f40 2024-09-11T14:36:44.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.384+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1abd120 con 0x1b50f40 2024-09-11T14:36:44.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.385+0000 7fe30affd640 1 -- 172.21.15.46:0/70265779 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe2fc00d040 con 0x1b50f40 2024-09-11T14:36:44.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.385+0000 7fe30affd640 1 --2- 172.21.15.46:0/70265779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe2f803d170 0x7fe2f803f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.385+0000 7fe30affd640 1 -- 172.21.15.46:0/70265779 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7fe2fc00a040 con 0x1b50f40 2024-09-11T14:36:44.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.385+0000 7fe318f09ec0 1 --2- 172.21.15.46:0/70265779 >> v2:172.21.15.46:6801/1724049974 conn(0x1b53ef0 0x1feb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.385+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:1 199.7 199:fe351e27:::obj9:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x1b3f820 con 0x1b53ef0 2024-09-11T14:36:44.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.385+0000 7fe31103e640 1 --2- 172.21.15.46:0/70265779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe2f803d170 0x7fe2f803f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.386+0000 7fe31103e640 1 --2- 172.21.15.46:0/70265779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe2f803d170 0x7fe2f803f680 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.386+0000 7fe312040640 1 --2- 172.21.15.46:0/70265779 >> v2:172.21.15.46:6801/1724049974 conn(0x1b53ef0 0x1feb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:44.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.388+0000 7fe312040640 1 --2- 172.21.15.46:0/70265779 >> v2:172.21.15.46:6801/1724049974 conn(0x1b53ef0 0x1feb120 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe312040640 1 -- 172.21.15.46:0/70265779 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== osd_op_reply(1 obj9 [writefull 0~12777] v703'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe30400a430 con 0x1b53ef0 2024-09-11T14:36:44.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 >> v2:172.21.15.46:6801/1724049974 conn(0x1b53ef0 msgr2=0x1feb120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 --2- 172.21.15.46:0/70265779 >> v2:172.21.15.46:6801/1724049974 conn(0x1b53ef0 0x1feb120 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe2f803d170 msgr2=0x7fe2f803f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 --2- 172.21.15.46:0/70265779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe2f803d170 0x7fe2f803f680 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 msgr2=0x1b3bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 --2- 172.21.15.46:0/70265779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1b3bf40 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 shutdown_connections 2024-09-11T14:36:44.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 --2- 172.21.15.46:0/70265779 >> v2:172.21.15.46:6801/1724049974 conn(0x1b53ef0 0x1feb120 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 --2- 172.21.15.46:0/70265779 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe2f803d170 0x7fe2f803f680 unknown :-1 s=CLOSED pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 --2- 172.21.15.46:0/70265779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1b50f40 0x1b3bf40 unknown :-1 s=CLOSED pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 >> 172.21.15.46:0/70265779 conn(0x19e4770 msgr2=0x1ac0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 shutdown_connections 2024-09-11T14:36:44.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.407+0000 7fe318f09ec0 1 -- 172.21.15.46:0/70265779 wait complete. 2024-09-11T14:36:44.411 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:36:44.411 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put obj10 /etc/passwd 2024-09-11T14:36:44.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.448+0000 7f51cce33ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.453+0000 7f51cce33ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.453+0000 7f51cce33ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:36:44.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.454+0000 7f51cce33ec0 1 Processor -- start 2024-09-11T14:36:44.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.454+0000 7f51cce33ec0 1 -- start start 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.456+0000 7f51cce33ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x1a02bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.456+0000 7f51cce33ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x184b520 con 0x18cc650 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.456+0000 7f51c4e3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x1a02bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.456+0000 7f51c4e3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x1a02bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43022/0 (socket says 172.21.15.46:43022) 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.456+0000 7f51c4e3f640 1 -- 172.21.15.46:0/3285477257 learned_addr learned my addr 172.21.15.46:0/3285477257 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.456+0000 7f51c4e3f640 1 -- 172.21.15.46:0/3285477257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17e7e10 con 0x18cc650 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.456+0000 7f51c4e3f640 1 --2- 172.21.15.46:0/3285477257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x1a02bd0 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116d78250e1ffd39 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.456+0000 7f51beffd640 1 -- 172.21.15.46:0/3285477257 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f51b002d980 con 0x18cc650 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.457+0000 7f51beffd640 1 -- 172.21.15.46:0/3285477257 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f51b002db80 con 0x18cc650 2024-09-11T14:36:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.457+0000 7f51beffd640 1 -- 172.21.15.46:0/3285477257 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f51b002de20 con 0x18cc650 2024-09-11T14:36:44.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.457+0000 7f51cce33ec0 1 -- 172.21.15.46:0/3285477257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 msgr2=0x1a02bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.457+0000 7f51cce33ec0 1 --2- 172.21.15.46:0/3285477257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x1a02bd0 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.457+0000 7f51cce33ec0 1 -- 172.21.15.46:0/3285477257 shutdown_connections 2024-09-11T14:36:44.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.457+0000 7f51cce33ec0 1 --2- 172.21.15.46:0/3285477257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x1a02bd0 unknown :-1 s=CLOSED pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.457+0000 7f51cce33ec0 1 -- 172.21.15.46:0/3285477257 >> 172.21.15.46:0/3285477257 conn(0x180b770 msgr2=0x18e1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.457+0000 7f51cce33ec0 1 -- 172.21.15.46:0/3285477257 shutdown_connections 2024-09-11T14:36:44.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.457+0000 7f51cce33ec0 1 -- 172.21.15.46:0/3285477257 wait complete. 2024-09-11T14:36:44.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.458+0000 7f51cce33ec0 1 Processor -- start 2024-09-11T14:36:44.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.458+0000 7f51cce33ec0 1 -- start start 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51cce33ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x18ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51cce33ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1849280 con 0x18cc650 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51c4e3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x18ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51c4e3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x18ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43028/0 (socket says 172.21.15.46:43028) 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51c4e3f640 1 -- 172.21.15.46:0/2160066086 learned_addr learned my addr 172.21.15.46:0/2160066086 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51c4e3f640 1 -- 172.21.15.46:0/2160066086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17d9920 con 0x18cc650 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51c4e3f640 1 --2- 172.21.15.46:0/2160066086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x18ce0e0 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51bdffb640 1 -- 172.21.15.46:0/2160066086 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f51b002d980 con 0x18cc650 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51bdffb640 1 -- 172.21.15.46:0/2160066086 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f51b0037b20 con 0x18cc650 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x17d9380 con 0x18cc650 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51bdffb640 1 -- 172.21.15.46:0/2160066086 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f51b0037dc0 con 0x18cc650 2024-09-11T14:36:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.460+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x18cddc0 con 0x18cc650 2024-09-11T14:36:44.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.461+0000 7f51bdffb640 1 -- 172.21.15.46:0/2160066086 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f51b0003040 con 0x18cc650 2024-09-11T14:36:44.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.462+0000 7f51bdffb640 1 --2- 172.21.15.46:0/2160066086 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f51ac03d210 0x7f51ac03f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.462+0000 7f51bdffb640 1 -- 172.21.15.46:0/2160066086 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 593..703) ==== 3819+0+0 (crc 0 0 0) 0x7f51b0032040 con 0x18cc650 2024-09-11T14:36:44.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.462+0000 7f51cce33ec0 1 --2- 172.21.15.46:0/2160066086 >> v2:172.21.15.46:6801/1724049974 conn(0x18e8780 0x1a10820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:36:44.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.462+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:1 199.b 199:d1337354:::obj10:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x196aa60 con 0x18e8780 2024-09-11T14:36:44.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.462+0000 7f51bffff640 1 --2- 172.21.15.46:0/2160066086 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f51ac03d210 0x7f51ac03f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:36:44.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.463+0000 7f51bffff640 1 --2- 172.21.15.46:0/2160066086 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f51ac03d210 0x7f51ac03f720 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.463+0000 7f51c5640640 1 --2- 172.21.15.46:0/2160066086 >> v2:172.21.15.46:6801/1724049974 conn(0x18e8780 0x1a10820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:36:44.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.467+0000 7f51c5640640 1 --2- 172.21.15.46:0/2160066086 >> v2:172.21.15.46:6801/1724049974 conn(0x18e8780 0x1a10820 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:36:44.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51c5640640 1 -- 172.21.15.46:0/2160066086 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== osd_op_reply(1 obj10 [writefull 0~12777] v703'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f51b800c430 con 0x18e8780 2024-09-11T14:36:44.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 >> v2:172.21.15.46:6801/1724049974 conn(0x18e8780 msgr2=0x1a10820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 --2- 172.21.15.46:0/2160066086 >> v2:172.21.15.46:6801/1724049974 conn(0x18e8780 0x1a10820 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f51ac03d210 msgr2=0x7f51ac03f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 --2- 172.21.15.46:0/2160066086 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f51ac03d210 0x7f51ac03f720 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 msgr2=0x18ce0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:36:44.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 --2- 172.21.15.46:0/2160066086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x18ce0e0 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 shutdown_connections 2024-09-11T14:36:44.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 --2- 172.21.15.46:0/2160066086 >> v2:172.21.15.46:6801/1724049974 conn(0x18e8780 0x1a10820 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 --2- 172.21.15.46:0/2160066086 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f51ac03d210 0x7f51ac03f720 unknown :-1 s=CLOSED pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 --2- 172.21.15.46:0/2160066086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18cc650 0x18ce0e0 unknown :-1 s=CLOSED pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:36:44.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 >> 172.21.15.46:0/2160066086 conn(0x180b770 msgr2=0x18e1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:36:44.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 shutdown_connections 2024-09-11T14:36:44.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:36:44.488+0000 7f51cce33ec0 1 -- 172.21.15.46:0/2160066086 wait complete. 2024-09-11T14:36:44.492 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-09-11T14:37:14.494 INFO:tasks.workunit.client.0.smithi046.stderr:+ pid=95656 2024-09-11T14:37:14.494 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota bcc42802-4a92-4251-a537-9d1c078ffecf max_objects 100 2024-09-11T14:37:14.494 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put onemore /etc/passwd 2024-09-11T14:37:14.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.537+0000 7f05b4c2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:14.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.544+0000 7f05b4c2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:14.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.544+0000 7f05b4c2bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:14.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.545+0000 7f05b4c2bec0 1 Processor -- start 2024-09-11T14:37:14.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.545+0000 7f05b4c2bec0 1 -- start start 2024-09-11T14:37:14.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.547+0000 7f05b4c2bec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2570890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:14.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.547+0000 7f05b4c2bec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x2457520 con 0x24f2450 2024-09-11T14:37:14.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.547+0000 7f05acd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2570890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:14.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.547+0000 7f05acd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2570890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53324/0 (socket says 172.21.15.46:53324) 2024-09-11T14:37:14.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.547+0000 7f05acd9b640 1 -- 172.21.15.46:0/2469309462 learned_addr learned my addr 172.21.15.46:0/2469309462 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.547+0000 7f05acd9b640 1 -- 172.21.15.46:0/2469309462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x23f3e10 con 0x24f2450 2024-09-11T14:37:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.547+0000 7f05acd9b640 1 --2- 172.21.15.46:0/2469309462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2570890 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6224779c87c155a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.548+0000 7f05a6ffd640 1 -- 172.21.15.46:0/2469309462 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f059802db60 con 0x24f2450 2024-09-11T14:37:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.548+0000 7f05a6ffd640 1 -- 172.21.15.46:0/2469309462 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0598037370 con 0x24f2450 2024-09-11T14:37:14.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.548+0000 7f05a6ffd640 1 -- 172.21.15.46:0/2469309462 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0598037610 con 0x24f2450 2024-09-11T14:37:14.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.549+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2469309462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 msgr2=0x2570890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:14.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.549+0000 7f05b4c2bec0 1 --2- 172.21.15.46:0/2469309462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2570890 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:14.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.549+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2469309462 shutdown_connections 2024-09-11T14:37:14.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.549+0000 7f05b4c2bec0 1 --2- 172.21.15.46:0/2469309462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2570890 unknown :-1 s=CLOSED pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:14.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.549+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2469309462 >> 172.21.15.46:0/2469309462 conn(0x2417770 msgr2=0x24ed050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:14.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.549+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2469309462 shutdown_connections 2024-09-11T14:37:14.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.549+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2469309462 wait complete. 2024-09-11T14:37:14.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.550+0000 7f05b4c2bec0 1 Processor -- start 2024-09-11T14:37:14.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.550+0000 7f05b4c2bec0 1 -- start start 2024-09-11T14:37:14.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.551+0000 7f05b4c2bec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2577770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:14.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.551+0000 7f05b4c2bec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x2455280 con 0x24f2450 2024-09-11T14:37:14.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.552+0000 7f05acd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2577770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:14.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.552+0000 7f05acd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2577770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53330/0 (socket says 172.21.15.46:53330) 2024-09-11T14:37:14.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.552+0000 7f05acd9b640 1 -- 172.21.15.46:0/2791029373 learned_addr learned my addr 172.21.15.46:0/2791029373 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:14.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.552+0000 7f05acd9b640 1 -- 172.21.15.46:0/2791029373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x23e5920 con 0x24f2450 2024-09-11T14:37:14.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.552+0000 7f05acd9b640 1 --2- 172.21.15.46:0/2791029373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2577770 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:14.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.553+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f05980377c0 con 0x24f2450 2024-09-11T14:37:14.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.553+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0598037920 con 0x24f2450 2024-09-11T14:37:14.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.553+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2791029373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x23e5380 con 0x24f2450 2024-09-11T14:37:14.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.553+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0598037bc0 con 0x24f2450 2024-09-11T14:37:14.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.553+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2791029373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x25773e0 con 0x24f2450 2024-09-11T14:37:14.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.554+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0598037d70 con 0x24f2450 2024-09-11T14:37:14.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.554+0000 7f05a5ffb640 1 --2- 172.21.15.46:0/2791029373 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f058803d1c0 0x7f058803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:14.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.554+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(705..705 src has 593..705) ==== 3819+0+0 (crc 0 0 0) 0x7f0598032040 con 0x24f2450 2024-09-11T14:37:14.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.555+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7f0588043450 con 0x24f2450 2024-09-11T14:37:14.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.555+0000 7f05b4c2bec0 1 --2- 172.21.15.46:0/2791029373 >> v2:172.21.15.47:6803/3757354244 conn(0x24f2da0 0x2574b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:14.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.555+0000 7f059ffff640 1 --2- 172.21.15.46:0/2791029373 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f058803d1c0 0x7f058803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:14.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.555+0000 7f059ffff640 1 --2- 172.21.15.46:0/2791029373 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f058803d1c0 0x7f058803f6d0 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:14.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.556+0000 7f05ad59c640 1 --2- 172.21.15.46:0/2791029373 >> v2:172.21.15.47:6803/3757354244 conn(0x24f2da0 0x2574b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:37:14.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.561+0000 7f05ad59c640 1 --2- 172.21.15.46:0/2791029373 >> v2:172.21.15.47:6803/3757354244 conn(0x24f2da0 0x2574b80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:14.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.596+0000 7f82e3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:14.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.606+0000 7f82e3f91640 1 Processor -- start 2024-09-11T14:37:14.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.606+0000 7f82e3f91640 1 -- start start 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e3f91640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f82dc136580 0x7f82dc1389a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e3f91640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82dc071170 con 0x7f82dc133700 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e3f91640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f82dc134220 con 0x7f82dc136580 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e152c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f82dc136580 0x7f82dc1389a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e1d2d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f82dc133700 0x7f82dc133b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43950/0 (socket says 172.21.15.46:43950) 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e152c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f82dc136580 0x7f82dc1389a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53342/0 (socket says 172.21.15.46:53342) 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e1d2d640 1 -- 172.21.15.46:0/627951949 learned_addr learned my addr 172.21.15.46:0/627951949 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e152c640 1 -- 172.21.15.46:0/627951949 >> v1:172.21.15.46:6789/0 conn(0x7f82dc133700 legacy=0x7f82dc133b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e152c640 1 -- 172.21.15.46:0/627951949 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82dc133310 con 0x7f82dc136580 2024-09-11T14:37:14.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.608+0000 7f82e152c640 1 --2- 172.21.15.46:0/627951949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc136580 0x7f82dc1389a0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6eb0c112758e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:14.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.609+0000 7f82e0d2b640 1 -- 172.21.15.46:0/627951949 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82cc009d90 con 0x7f82dc136580 2024-09-11T14:37:14.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.609+0000 7f82e0d2b640 1 -- 172.21.15.46:0/627951949 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f82cc00e230 con 0x7f82dc136580 2024-09-11T14:37:14.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.609+0000 7f82e0d2b640 1 -- 172.21.15.46:0/627951949 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82cc00e4d0 con 0x7f82dc136580 2024-09-11T14:37:14.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.609+0000 7f82e3f91640 1 -- 172.21.15.46:0/627951949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc136580 msgr2=0x7f82dc1389a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:14.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.609+0000 7f82e3f91640 1 --2- 172.21.15.46:0/627951949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc136580 0x7f82dc1389a0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:14.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.609+0000 7f82e3f91640 1 -- 172.21.15.46:0/627951949 shutdown_connections 2024-09-11T14:37:14.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.609+0000 7f82e3f91640 1 --2- 172.21.15.46:0/627951949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc136580 0x7f82dc1389a0 unknown :-1 s=CLOSED pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:14.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.609+0000 7f82e3f91640 1 -- 172.21.15.46:0/627951949 >> 172.21.15.46:0/627951949 conn(0x7f82dc0a26b0 msgr2=0x7f82dc0a2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:14.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.610+0000 7f82e3f91640 1 -- 172.21.15.46:0/627951949 shutdown_connections 2024-09-11T14:37:14.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.610+0000 7f82e3f91640 1 -- 172.21.15.46:0/627951949 wait complete. 2024-09-11T14:37:14.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.610+0000 7f82e3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:14.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.612+0000 7f82e3f91640 1 Processor -- start 2024-09-11T14:37:14.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.612+0000 7f82e3f91640 1 -- start start 2024-09-11T14:37:14.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.613+0000 7f82e3f91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc133700 0x7f82dc11cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:14.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.613+0000 7f82e3f91640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc12fef0 con 0x7f82dc133700 2024-09-11T14:37:14.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.613+0000 7f82e1d2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc133700 0x7f82dc11cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:14.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.613+0000 7f82e1d2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc133700 0x7f82dc11cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53356/0 (socket says 172.21.15.46:53356) 2024-09-11T14:37:14.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.613+0000 7f82e1d2d640 1 -- 172.21.15.46:0/2509698780 learned_addr learned my addr 172.21.15.46:0/2509698780 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:14.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.614+0000 7f82e1d2d640 1 -- 172.21.15.46:0/2509698780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82dc130100 con 0x7f82dc133700 2024-09-11T14:37:14.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.614+0000 7f82e1d2d640 1 --2- 172.21.15.46:0/2509698780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc133700 0x7f82dc11cf00 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:14.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.614+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82d8005a60 con 0x7f82dc133700 2024-09-11T14:37:14.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.614+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f82d8005bc0 con 0x7f82dc133700 2024-09-11T14:37:14.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.614+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82dc120f00 con 0x7f82dc133700 2024-09-11T14:37:14.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.614+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82d8005e60 con 0x7f82dc133700 2024-09-11T14:37:14.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.614+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82dc11e980 con 0x7f82dc133700 2024-09-11T14:37:14.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.615+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82dc11f290 con 0x7f82dc133700 2024-09-11T14:37:14.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.615+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f82d80070b0 con 0x7f82dc133700 2024-09-11T14:37:14.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.615+0000 7f82d27fc640 1 --2- 172.21.15.46:0/2509698780 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f82c003e8e0 0x7f82c0040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:14.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.615+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(705..705 src has 593..705) ==== 3819+0+0 (crc 0 0 0) 0x7f82d804fa60 con 0x7f82dc133700 2024-09-11T14:37:14.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.615+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=706}) -- 0x7f82c0044b70 con 0x7f82dc133700 2024-09-11T14:37:14.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.616+0000 7f82e152c640 1 --2- 172.21.15.46:0/2509698780 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f82c003e8e0 0x7f82c0040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:14.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.616+0000 7f82e152c640 1 --2- 172.21.15.46:0/2509698780 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f82c003e8e0 0x7f82c0040df0 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:14.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.620+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f82d800f230 con 0x7f82dc133700 2024-09-11T14:37:14.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:14.809+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "100"} v 0) -- 0x7f82dc06e170 con 0x7f82dc133700 2024-09-11T14:37:15.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:15.639+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v706) ==== 225+0+0 (crc 0 0 0) 0x7f82d800d610 con 0x7f82dc133700 2024-09-11T14:37:15.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:15.639+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(706..706 src has 593..706) ==== 628+0+0 (crc 0 0 0) 0x7f82d800d9b0 con 0x7f82dc133700 2024-09-11T14:37:15.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:15.639+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7f82c0045a40 con 0x7f82dc133700 2024-09-11T14:37:15.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:15.639+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 <== mon.0 v2:172.21.15.46:3300/0 6 ==== osd_map(706..706 src has 593..706) ==== 628+0+0 (crc 0 0 0) 0x7f0598035a30 con 0x24f2450 2024-09-11T14:37:15.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:15.640+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7f0588043b90 con 0x24f2450 2024-09-11T14:37:15.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:15.776+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "100"} v 0) -- 0x7f82dc11f7a0 con 0x7f82dc133700 2024-09-11T14:37:16.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.643+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v707) ==== 225+0+0 (crc 0 0 0) 0x7f82d800d7f0 con 0x7f82dc133700 2024-09-11T14:37:16.645 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 100 for pool bcc42802-4a92-4251-a537-9d1c078ffecf 2024-09-11T14:37:16.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.643+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 <== mon.0 v2:172.21.15.46:3300/0 7 ==== osd_map(707..707 src has 593..707) ==== 628+0+0 (crc 0 0 0) 0x7f0598034280 con 0x24f2450 2024-09-11T14:37:16.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.643+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(707..707 src has 593..707) ==== 628+0+0 (crc 0 0 0) 0x7f82d8021d40 con 0x7f82dc133700 2024-09-11T14:37:16.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.643+0000 7f82d27fc640 1 -- 172.21.15.46:0/2509698780 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f82c0045c30 con 0x7f82dc133700 2024-09-11T14:37:16.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.643+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f0588043db0 con 0x24f2450 2024-09-11T14:37:16.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.647+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f82c003e8e0 msgr2=0x7f82c0040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:16.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.647+0000 7f82e3f91640 1 --2- 172.21.15.46:0/2509698780 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f82c003e8e0 0x7f82c0040df0 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:16.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.647+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc133700 msgr2=0x7f82dc11cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:16.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.647+0000 7f82e3f91640 1 --2- 172.21.15.46:0/2509698780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc133700 0x7f82dc11cf00 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:16.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.647+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 shutdown_connections 2024-09-11T14:37:16.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.647+0000 7f82e3f91640 1 --2- 172.21.15.46:0/2509698780 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f82c003e8e0 0x7f82c0040df0 crc :-1 s=CLOSED pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:16.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.647+0000 7f82e3f91640 1 --2- 172.21.15.46:0/2509698780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82dc133700 0x7f82dc11cf00 unknown :-1 s=CLOSED pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:16.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.647+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 >> 172.21.15.46:0/2509698780 conn(0x7f82dc0a26b0 msgr2=0x7f82dc131f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:16.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.648+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 shutdown_connections 2024-09-11T14:37:16.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:16.648+0000 7f82e3f91640 1 -- 172.21.15.46:0/2509698780 wait complete. 2024-09-11T14:37:16.663 INFO:tasks.workunit.client.0.smithi046.stderr:+ wait 95656 2024-09-11T14:37:17.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.010+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(708..708 src has 593..708) ==== 628+0+0 (crc 0 0 0) 0x7f0598035c40 con 0x24f2450 2024-09-11T14:37:17.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.010+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f0588043db0 con 0x24f2450 2024-09-11T14:37:17.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.010+0000 7f05a5ffb640 1 -- 172.21.15.46:0/2791029373 --> v2:172.21.15.47:6803/3757354244 -- osd_op(unknown.0.0:1 199.5 199:b9ff7440:::onemore:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e708) -- 0x7f0588044030 con 0x24f2da0 2024-09-11T14:37:17.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05ad59c640 1 -- 172.21.15.46:0/2791029373 <== osd.2 v2:172.21.15.47:6803/3757354244 1 ==== osd_op_reply(1 onemore [writefull 0~12777] v708'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f05a000a430 con 0x24f2da0 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2791029373 >> v2:172.21.15.47:6803/3757354244 conn(0x24f2da0 msgr2=0x2574b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 --2- 172.21.15.46:0/2791029373 >> v2:172.21.15.47:6803/3757354244 conn(0x24f2da0 0x2574b80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2791029373 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f058803d1c0 msgr2=0x7f058803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 --2- 172.21.15.46:0/2791029373 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f058803d1c0 0x7f058803f6d0 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2791029373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 msgr2=0x2577770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 --2- 172.21.15.46:0/2791029373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2577770 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2791029373 shutdown_connections 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 --2- 172.21.15.46:0/2791029373 >> v2:172.21.15.47:6803/3757354244 conn(0x24f2da0 0x2574b80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 --2- 172.21.15.46:0/2791029373 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f058803d1c0 0x7f058803f6d0 unknown :-1 s=CLOSED pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 --2- 172.21.15.46:0/2791029373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x24f2450 0x2577770 unknown :-1 s=CLOSED pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2791029373 >> 172.21.15.46:0/2791029373 conn(0x2417770 msgr2=0x24efbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2791029373 shutdown_connections 2024-09-11T14:37:17.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.066+0000 7f05b4c2bec0 1 -- 172.21.15.46:0/2791029373 wait complete. 2024-09-11T14:37:17.070 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -ne 0 ']' 2024-09-11T14:37:17.071 INFO:tasks.workunit.client.0.smithi046.stderr:+ true 2024-09-11T14:37:17.071 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put twomore /etc/passwd 2024-09-11T14:37:17.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.109+0000 7f2fabe7bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:17.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.115+0000 7f2fabe7bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:17.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.115+0000 7f2fabe7bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:17.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.116+0000 7f2fabe7bec0 1 Processor -- start 2024-09-11T14:37:17.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.116+0000 7f2fabe7bec0 1 -- start start 2024-09-11T14:37:17.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2fabe7bec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x14e86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2fabe7bec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1467520 con 0x14fa810 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2f9f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x14e86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2f9f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x14e86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53376/0 (socket says 172.21.15.46:53376) 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2f9f7fe640 1 -- 172.21.15.46:0/739831353 learned_addr learned my addr 172.21.15.46:0/739831353 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2f9f7fe640 1 -- 172.21.15.46:0/739831353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1403e10 con 0x14fa810 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2f9f7fe640 1 --2- 172.21.15.46:0/739831353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x14e86f0 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904b0e091de30927 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2f9dffb640 1 -- 172.21.15.46:0/739831353 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f8c02d980 con 0x14fa810 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2f9dffb640 1 -- 172.21.15.46:0/739831353 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f8c02db80 con 0x14fa810 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.118+0000 7f2f9dffb640 1 -- 172.21.15.46:0/739831353 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f8c02de20 con 0x14fa810 2024-09-11T14:37:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.119+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/739831353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 msgr2=0x14e86f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:17.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.119+0000 7f2fabe7bec0 1 --2- 172.21.15.46:0/739831353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x14e86f0 crc :-1 s=READY pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.119+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/739831353 shutdown_connections 2024-09-11T14:37:17.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.119+0000 7f2fabe7bec0 1 --2- 172.21.15.46:0/739831353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x14e86f0 unknown :-1 s=CLOSED pgs=12881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.119+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/739831353 >> 172.21.15.46:0/739831353 conn(0x1427770 msgr2=0x14fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:17.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.119+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/739831353 shutdown_connections 2024-09-11T14:37:17.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.119+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/739831353 wait complete. 2024-09-11T14:37:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.120+0000 7f2fabe7bec0 1 Processor -- start 2024-09-11T14:37:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.120+0000 7f2fabe7bec0 1 -- start start 2024-09-11T14:37:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2fabe7bec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x15846d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2fabe7bec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1465280 con 0x14fa810 2024-09-11T14:37:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2f9f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x15846d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2f9f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x15846d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53388/0 (socket says 172.21.15.46:53388) 2024-09-11T14:37:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2f9f7fe640 1 -- 172.21.15.46:0/2786358192 learned_addr learned my addr 172.21.15.46:0/2786358192 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2f9f7fe640 1 -- 172.21.15.46:0/2786358192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13f5920 con 0x14fa810 2024-09-11T14:37:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2f9f7fe640 1 --2- 172.21.15.46:0/2786358192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x15846d0 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:17.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2f9cff9640 1 -- 172.21.15.46:0/2786358192 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f8c02d980 con 0x14fa810 2024-09-11T14:37:17.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2f9cff9640 1 -- 172.21.15.46:0/2786358192 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f8c037b50 con 0x14fa810 2024-09-11T14:37:17.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13f5380 con 0x14fa810 2024-09-11T14:37:17.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2f9cff9640 1 -- 172.21.15.46:0/2786358192 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f8c037df0 con 0x14fa810 2024-09-11T14:37:17.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.122+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1587900 con 0x14fa810 2024-09-11T14:37:17.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.123+0000 7f2f9cff9640 1 -- 172.21.15.46:0/2786358192 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2f8c003040 con 0x14fa810 2024-09-11T14:37:17.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.124+0000 7f2f9cff9640 1 --2- 172.21.15.46:0/2786358192 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f2f8803d1c0 0x7f2f8803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:17.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.124+0000 7f2f9cff9640 1 -- 172.21.15.46:0/2786358192 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(708..708 src has 593..708) ==== 3819+0+0 (crc 0 0 0) 0x7f2f8c032040 con 0x14fa810 2024-09-11T14:37:17.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.124+0000 7f2fabe7bec0 1 --2- 172.21.15.46:0/2786358192 >> v2:172.21.15.47:6805/1666238977 conn(0x1503660 0x162a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:17.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.124+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 199.6 199:7019d845:::twomore:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e708) -- 0x1587fd0 con 0x1503660 2024-09-11T14:37:17.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.124+0000 7f2f9effd640 1 --2- 172.21.15.46:0/2786358192 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f2f8803d1c0 0x7f2f8803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:17.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.125+0000 7f2f9effd640 1 --2- 172.21.15.46:0/2786358192 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f2f8803d1c0 0x7f2f8803f6d0 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:17.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.125+0000 7f2f9ffff640 1 --2- 172.21.15.46:0/2786358192 >> v2:172.21.15.47:6805/1666238977 conn(0x1503660 0x162a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:37:17.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.127+0000 7f2f9ffff640 1 --2- 172.21.15.46:0/2786358192 >> v2:172.21.15.47:6805/1666238977 conn(0x1503660 0x162a100 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:17.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2f9ffff640 1 -- 172.21.15.46:0/2786358192 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 twomore [writefull 0~12777] v708'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f2f9400c430 con 0x1503660 2024-09-11T14:37:17.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 >> v2:172.21.15.47:6805/1666238977 conn(0x1503660 msgr2=0x162a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:17.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 --2- 172.21.15.46:0/2786358192 >> v2:172.21.15.47:6805/1666238977 conn(0x1503660 0x162a100 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f2f8803d1c0 msgr2=0x7f2f8803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:17.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 --2- 172.21.15.46:0/2786358192 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f2f8803d1c0 0x7f2f8803f6d0 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 msgr2=0x15846d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:17.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 --2- 172.21.15.46:0/2786358192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x15846d0 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 shutdown_connections 2024-09-11T14:37:17.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 --2- 172.21.15.46:0/2786358192 >> v2:172.21.15.47:6805/1666238977 conn(0x1503660 0x162a100 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 --2- 172.21.15.46:0/2786358192 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f2f8803d1c0 0x7f2f8803f6d0 unknown :-1 s=CLOSED pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 --2- 172.21.15.46:0/2786358192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14fa810 0x15846d0 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 >> 172.21.15.46:0/2786358192 conn(0x1427770 msgr2=0x1506420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:17.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 shutdown_connections 2024-09-11T14:37:17.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.148+0000 7f2fabe7bec0 1 -- 172.21.15.46:0/2786358192 wait complete. 2024-09-11T14:37:17.152 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota bcc42802-4a92-4251-a537-9d1c078ffecf max_bytes 100 2024-09-11T14:37:17.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.238+0000 7fb681991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:17.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.248+0000 7fb681991640 1 Processor -- start 2024-09-11T14:37:17.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.248+0000 7fb681991640 1 -- start start 2024-09-11T14:37:17.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb681991640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb67c09cf00 0x7fb67c133730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:17.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb681991640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c09d820 con 0x7fb67c133c70 2024-09-11T14:37:17.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb681991640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fb67c09cd40 con 0x7fb67c09cf00 2024-09-11T14:37:17.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb67affd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb67c09cf00 0x7fb67c133730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:17.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb67a7fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb67c133c70 0x7fb67c09ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43972/0 (socket says 172.21.15.46:43972) 2024-09-11T14:37:17.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb67a7fc640 1 -- 172.21.15.46:0/3516281269 learned_addr learned my addr 172.21.15.46:0/3516281269 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:37:17.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb67affd640 1 -- 172.21.15.46:0/3516281269 >> v1:172.21.15.46:6789/0 conn(0x7fb67c133c70 legacy=0x7fb67c09ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:17.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb67affd640 1 -- 172.21.15.46:0/3516281269 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c09fae0 con 0x7fb67c09cf00 2024-09-11T14:37:17.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb679ffb640 1 -- 172.21.15.46:0/3516281269 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102669251 0 0) 0x7fb670001110 con 0x7fb67c133c70 2024-09-11T14:37:17.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.250+0000 7fb67affd640 1 --2- 172.21.15.46:0/3516281269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 0x7fb67c133730 crc :-1 s=READY pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2a299d0d7e1b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:17.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb679ffb640 1 -- 172.21.15.46:0/3516281269 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb66c009d90 con 0x7fb67c09cf00 2024-09-11T14:37:17.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb679ffb640 1 -- 172.21.15.46:0/3516281269 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb66c00e230 con 0x7fb67c09cf00 2024-09-11T14:37:17.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb679ffb640 1 -- 172.21.15.46:0/3516281269 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb66c00e4d0 con 0x7fb67c09cf00 2024-09-11T14:37:17.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb681991640 1 -- 172.21.15.46:0/3516281269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 msgr2=0x7fb67c133730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:17.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb681991640 1 --2- 172.21.15.46:0/3516281269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 0x7fb67c133730 crc :-1 s=READY pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb681991640 1 -- 172.21.15.46:0/3516281269 shutdown_connections 2024-09-11T14:37:17.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb681991640 1 --2- 172.21.15.46:0/3516281269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 0x7fb67c133730 unknown :-1 s=CLOSED pgs=12884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:17.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb681991640 1 -- 172.21.15.46:0/3516281269 >> 172.21.15.46:0/3516281269 conn(0x7fb67c0a0600 msgr2=0x7fb67c0a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:17.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb681991640 1 -- 172.21.15.46:0/3516281269 shutdown_connections 2024-09-11T14:37:17.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.251+0000 7fb681991640 1 -- 172.21.15.46:0/3516281269 wait complete. 2024-09-11T14:37:17.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.252+0000 7fb681991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:17.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.253+0000 7fb681991640 1 Processor -- start 2024-09-11T14:37:17.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.254+0000 7fb681991640 1 -- start start 2024-09-11T14:37:17.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.255+0000 7fb681991640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 0x7fb67c11e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:17.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.255+0000 7fb681991640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c132690 con 0x7fb67c09cf00 2024-09-11T14:37:17.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.255+0000 7fb67affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 0x7fb67c11e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:17.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.255+0000 7fb67affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 0x7fb67c11e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53412/0 (socket says 172.21.15.46:53412) 2024-09-11T14:37:17.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.255+0000 7fb67affd640 1 -- 172.21.15.46:0/1840448193 learned_addr learned my addr 172.21.15.46:0/1840448193 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:17.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.255+0000 7fb67affd640 1 -- 172.21.15.46:0/1840448193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c122160 con 0x7fb67c09cf00 2024-09-11T14:37:17.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.256+0000 7fb67affd640 1 --2- 172.21.15.46:0/1840448193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 0x7fb67c11e1c0 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:17.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.256+0000 7fb663fff640 1 -- 172.21.15.46:0/1840448193 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb66c013610 con 0x7fb67c09cf00 2024-09-11T14:37:17.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.256+0000 7fb663fff640 1 -- 172.21.15.46:0/1840448193 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb66c013770 con 0x7fb67c09cf00 2024-09-11T14:37:17.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.256+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67c120a20 con 0x7fb67c09cf00 2024-09-11T14:37:17.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.256+0000 7fb663fff640 1 -- 172.21.15.46:0/1840448193 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb66c013a10 con 0x7fb67c09cf00 2024-09-11T14:37:17.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.256+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67c131ee0 con 0x7fb67c09cf00 2024-09-11T14:37:17.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.257+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c120c00 con 0x7fb67c09cf00 2024-09-11T14:37:17.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.257+0000 7fb663fff640 1 -- 172.21.15.46:0/1840448193 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb66c013bc0 con 0x7fb67c09cf00 2024-09-11T14:37:17.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.257+0000 7fb663fff640 1 --2- 172.21.15.46:0/1840448193 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb66803e930 0x7fb668040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:17.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.257+0000 7fb663fff640 1 -- 172.21.15.46:0/1840448193 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(708..708 src has 593..708) ==== 3819+0+0 (crc 0 0 0) 0x7fb66c018040 con 0x7fb67c09cf00 2024-09-11T14:37:17.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.257+0000 7fb67a7fc640 1 --2- 172.21.15.46:0/1840448193 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb66803e930 0x7fb668040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:17.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.258+0000 7fb67a7fc640 1 --2- 172.21.15.46:0/1840448193 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb66803e930 0x7fb668040e40 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:17.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.262+0000 7fb663fff640 1 -- 172.21.15.46:0/1840448193 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fb66c011380 con 0x7fb67c09cf00 2024-09-11T14:37:17.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:17.450+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "100"} v 0) -- 0x7fb67c133730 con 0x7fb67c09cf00 2024-09-11T14:37:18.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:18.011+0000 7fb663fff640 1 -- 172.21.15.46:0/1840448193 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v709) ==== 221+0+0 (crc 0 0 0) 0x7fb66c018a50 con 0x7fb67c09cf00 2024-09-11T14:37:18.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:18.146+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "100"} v 0) -- 0x7fb67c0008d0 con 0x7fb67c09cf00 2024-09-11T14:37:19.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.014+0000 7fb663fff640 1 -- 172.21.15.46:0/1840448193 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v710) ==== 221+0+0 (crc 0 0 0) 0x7fb66c011380 con 0x7fb67c09cf00 2024-09-11T14:37:19.017 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_bytes = 100 for pool bcc42802-4a92-4251-a537-9d1c078ffecf 2024-09-11T14:37:19.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.017+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb66803e930 msgr2=0x7fb668040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:19.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.017+0000 7fb681991640 1 --2- 172.21.15.46:0/1840448193 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb66803e930 0x7fb668040e40 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:19.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.017+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 msgr2=0x7fb67c11e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:19.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.017+0000 7fb681991640 1 --2- 172.21.15.46:0/1840448193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 0x7fb67c11e1c0 crc :-1 s=READY pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:19.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.017+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 shutdown_connections 2024-09-11T14:37:19.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.017+0000 7fb681991640 1 --2- 172.21.15.46:0/1840448193 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb66803e930 0x7fb668040e40 unknown :-1 s=CLOSED pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:19.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.017+0000 7fb681991640 1 --2- 172.21.15.46:0/1840448193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb67c09cf00 0x7fb67c11e1c0 unknown :-1 s=CLOSED pgs=12885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:19.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.018+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 >> 172.21.15.46:0/1840448193 conn(0x7fb67c0a0600 msgr2=0x7fb67c0730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:19.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.018+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 shutdown_connections 2024-09-11T14:37:19.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:19.018+0000 7fb681991640 1 -- 172.21.15.46:0/1840448193 wait complete. 2024-09-11T14:37:19.034 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-09-11T14:37:49.037 INFO:tasks.workunit.client.0.smithi046.stderr:+ pid=95747 2024-09-11T14:37:49.037 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota bcc42802-4a92-4251-a537-9d1c078ffecf max_bytes 0 2024-09-11T14:37:49.037 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put two /etc/passwd 2024-09-11T14:37:49.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.079+0000 7f9012d3fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:49.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.086+0000 7f9012d3fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:49.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.086+0000 7f9012d3fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:49.088 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.087+0000 7f9012d3fec0 1 Processor -- start 2024-09-11T14:37:49.088 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.087+0000 7f9012d3fec0 1 -- start start 2024-09-11T14:37:49.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.089+0000 7f9012d3fec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x1543b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:49.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.089+0000 7f9012d3fec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1418520 con 0x1542d90 2024-09-11T14:37:49.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.089+0000 7f900b19b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x1543b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:49.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.089+0000 7f900b19b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x1543b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47066/0 (socket says 172.21.15.46:47066) 2024-09-11T14:37:49.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.089+0000 7f900b19b640 1 -- 172.21.15.46:0/3616417145 learned_addr learned my addr 172.21.15.46:0/3616417145 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:49.091 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.089+0000 7f900b19b640 1 -- 172.21.15.46:0/3616417145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13b4e10 con 0x1542d90 2024-09-11T14:37:49.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.089+0000 7f900b19b640 1 --2- 172.21.15.46:0/3616417145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x1543b70 crc :-1 s=READY pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9587d7a7bcd95a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:49.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.090+0000 7f9009998640 1 -- 172.21.15.46:0/3616417145 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ff400c490 con 0x1542d90 2024-09-11T14:37:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.090+0000 7f9009998640 1 -- 172.21.15.46:0/3616417145 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ff400c5f0 con 0x1542d90 2024-09-11T14:37:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.090+0000 7f9009998640 1 -- 172.21.15.46:0/3616417145 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ff400c890 con 0x1542d90 2024-09-11T14:37:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.091+0000 7f9012d3fec0 1 -- 172.21.15.46:0/3616417145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 msgr2=0x1543b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.091+0000 7f9012d3fec0 1 --2- 172.21.15.46:0/3616417145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x1543b70 crc :-1 s=READY pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.091+0000 7f9012d3fec0 1 -- 172.21.15.46:0/3616417145 shutdown_connections 2024-09-11T14:37:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.091+0000 7f9012d3fec0 1 --2- 172.21.15.46:0/3616417145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x1543b70 unknown :-1 s=CLOSED pgs=12888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.091+0000 7f9012d3fec0 1 -- 172.21.15.46:0/3616417145 >> 172.21.15.46:0/3616417145 conn(0x13d8770 msgr2=0x15407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.091+0000 7f9012d3fec0 1 -- 172.21.15.46:0/3616417145 shutdown_connections 2024-09-11T14:37:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.091+0000 7f9012d3fec0 1 -- 172.21.15.46:0/3616417145 wait complete. 2024-09-11T14:37:49.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.092+0000 7f9012d3fec0 1 Processor -- start 2024-09-11T14:37:49.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.092+0000 7f9012d3fec0 1 -- start start 2024-09-11T14:37:49.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.094+0000 7f9012d3fec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x152e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:49.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.094+0000 7f9012d3fec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1416280 con 0x1542d90 2024-09-11T14:37:49.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.094+0000 7f900b19b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x152e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:49.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.094+0000 7f900b19b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x152e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47076/0 (socket says 172.21.15.46:47076) 2024-09-11T14:37:49.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.094+0000 7f900b19b640 1 -- 172.21.15.46:0/1659041135 learned_addr learned my addr 172.21.15.46:0/1659041135 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:49.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.094+0000 7f900b19b640 1 -- 172.21.15.46:0/1659041135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13a6920 con 0x1542d90 2024-09-11T14:37:49.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.095+0000 7f900b19b640 1 --2- 172.21.15.46:0/1659041135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x152e470 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:49.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.095+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ff40111e0 con 0x1542d90 2024-09-11T14:37:49.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.095+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ff40119d0 con 0x1542d90 2024-09-11T14:37:49.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.095+0000 7f9012d3fec0 1 -- 172.21.15.46:0/1659041135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13a6380 con 0x1542d90 2024-09-11T14:37:49.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.095+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ff4011b40 con 0x1542d90 2024-09-11T14:37:49.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.095+0000 7f9012d3fec0 1 -- 172.21.15.46:0/1659041135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1530da0 con 0x1542d90 2024-09-11T14:37:49.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.096+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8ff4011d40 con 0x1542d90 2024-09-11T14:37:49.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.096+0000 7f9008996640 1 --2- 172.21.15.46:0/1659041135 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8ff003d170 0x7f8ff003f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:49.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.097+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(711..711 src has 593..711) ==== 3819+0+0 (crc 0 0 0) 0x7f8ff4050220 con 0x1542d90 2024-09-11T14:37:49.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.097+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=712}) -- 0x7f8ff0043460 con 0x1542d90 2024-09-11T14:37:49.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.097+0000 7f9012d3fec0 1 --2- 172.21.15.46:0/1659041135 >> v2:172.21.15.47:6805/1666238977 conn(0x15490e0 0x153ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:49.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.097+0000 7f900a99a640 1 --2- 172.21.15.46:0/1659041135 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8ff003d170 0x7f8ff003f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:49.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.097+0000 7f900a99a640 1 --2- 172.21.15.46:0/1659041135 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8ff003d170 0x7f8ff003f680 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:49.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.098+0000 7f900b99c640 1 --2- 172.21.15.46:0/1659041135 >> v2:172.21.15.47:6805/1666238977 conn(0x15490e0 0x153ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:37:49.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.103+0000 7f900b99c640 1 --2- 172.21.15.46:0/1659041135 >> v2:172.21.15.47:6805/1666238977 conn(0x15490e0 0x153ee10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:49.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.136+0000 7f74de551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:49.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.146+0000 7f74de551640 1 Processor -- start 2024-09-11T14:37:49.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.146+0000 7f74de551640 1 -- start start 2024-09-11T14:37:49.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74de551640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74d8072fe0 0x7f74d81304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:49.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74de551640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d809fc50 con 0x7f74d8130a10 2024-09-11T14:37:49.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74de551640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f74d80a3380 con 0x7f74d8072fe0 2024-09-11T14:37:49.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74d7fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74d8072fe0 0x7f74d81304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:49.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74d77fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f74d8130a10 0x7f74d8071830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41014/0 (socket says 172.21.15.46:41014) 2024-09-11T14:37:49.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74d7fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f74d8072fe0 0x7f74d81304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47092/0 (socket says 172.21.15.46:47092) 2024-09-11T14:37:49.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74d77fe640 1 -- 172.21.15.46:0/2460592762 learned_addr learned my addr 172.21.15.46:0/2460592762 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74d7fff640 1 -- 172.21.15.46:0/2460592762 >> v1:172.21.15.46:6789/0 conn(0x7f74d8130a10 legacy=0x7f74d8071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74d7fff640 1 -- 172.21.15.46:0/2460592762 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d80748d0 con 0x7f74d8072fe0 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.148+0000 7f74d7fff640 1 --2- 172.21.15.46:0/2460592762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 0x7f74d81304d0 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe86a60379e39eba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74d6ffd640 1 -- 172.21.15.46:0/2460592762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74c8009d90 con 0x7f74d8072fe0 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74d6ffd640 1 -- 172.21.15.46:0/2460592762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f74c800e230 con 0x7f74d8072fe0 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74d6ffd640 1 -- 172.21.15.46:0/2460592762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74c800e4d0 con 0x7f74d8072fe0 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74de551640 1 -- 172.21.15.46:0/2460592762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 msgr2=0x7f74d81304d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74de551640 1 --2- 172.21.15.46:0/2460592762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 0x7f74d81304d0 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74de551640 1 -- 172.21.15.46:0/2460592762 shutdown_connections 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74de551640 1 --2- 172.21.15.46:0/2460592762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 0x7f74d81304d0 unknown :-1 s=CLOSED pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74de551640 1 -- 172.21.15.46:0/2460592762 >> 172.21.15.46:0/2460592762 conn(0x7f74d80a3b90 msgr2=0x7f74d80a23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:49.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74de551640 1 -- 172.21.15.46:0/2460592762 shutdown_connections 2024-09-11T14:37:49.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.149+0000 7f74de551640 1 -- 172.21.15.46:0/2460592762 wait complete. 2024-09-11T14:37:49.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.150+0000 7f74de551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:49.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.151+0000 7f74de551640 1 Processor -- start 2024-09-11T14:37:49.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.152+0000 7f74de551640 1 -- start start 2024-09-11T14:37:49.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.153+0000 7f74de551640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 0x7f74d811f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:49.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.153+0000 7f74de551640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f74d8123200 con 0x7f74d8072fe0 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.153+0000 7f74d7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 0x7f74d811f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.153+0000 7f74d7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 0x7f74d811f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47102/0 (socket says 172.21.15.46:47102) 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.153+0000 7f74d7fff640 1 -- 172.21.15.46:0/1307425595 learned_addr learned my addr 172.21.15.46:0/1307425595 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.154+0000 7f74d7fff640 1 -- 172.21.15.46:0/1307425595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d8122510 con 0x7f74d8072fe0 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.154+0000 7f74d7fff640 1 --2- 172.21.15.46:0/1307425595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 0x7f74d811f1b0 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.154+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74c8014620 con 0x7f74d8072fe0 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.154+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f74c8014780 con 0x7f74d8072fe0 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.154+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d8120c30 con 0x7f74d8072fe0 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.154+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74c8014a20 con 0x7f74d8072fe0 2024-09-11T14:37:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.154+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d8122d60 con 0x7f74d8072fe0 2024-09-11T14:37:49.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.155+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d80a2d50 con 0x7f74d8072fe0 2024-09-11T14:37:49.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.155+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f74c8014bd0 con 0x7f74d8072fe0 2024-09-11T14:37:49.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.155+0000 7f74d4ff9640 1 --2- 172.21.15.46:0/1307425595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f74c403e930 0x7f74c4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:49.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.155+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(711..711 src has 593..711) ==== 3819+0+0 (crc 0 0 0) 0x7f74c8019040 con 0x7f74d8072fe0 2024-09-11T14:37:49.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.156+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=712}) -- 0x7f74c4044bc0 con 0x7f74d8072fe0 2024-09-11T14:37:49.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.156+0000 7f74d77fe640 1 --2- 172.21.15.46:0/1307425595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f74c403e930 0x7f74c4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:49.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.156+0000 7f74d77fe640 1 --2- 172.21.15.46:0/1307425595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f74c403e930 0x7f74c4040e40 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:49.162 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.161+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f74c8012580 con 0x7f74d8072fe0 2024-09-11T14:37:49.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.345+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "0"} v 0) -- 0x7f74d80a1900 con 0x7f74d8072fe0 2024-09-11T14:37:49.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.647+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v712) ==== 217+0+0 (crc 0 0 0) 0x7f74c8018190 con 0x7f74d8072fe0 2024-09-11T14:37:49.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.647+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 <== mon.0 v2:172.21.15.46:3300/0 6 ==== osd_map(712..712 src has 593..712) ==== 628+0+0 (crc 0 0 0) 0x7f8ff4008840 con 0x1542d90 2024-09-11T14:37:49.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.647+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7f8ff0043ba0 con 0x1542d90 2024-09-11T14:37:49.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.647+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(712..712 src has 593..712) ==== 628+0+0 (crc 0 0 0) 0x7f74c8018710 con 0x7f74d8072fe0 2024-09-11T14:37:49.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.648+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7f74c4045bb0 con 0x7f74d8072fe0 2024-09-11T14:37:49.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:49.767+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "0"} v 0) -- 0x7f74d80008d0 con 0x7f74d8072fe0 2024-09-11T14:37:50.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.654+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v713) ==== 217+0+0 (crc 0 0 0) 0x7f74c8018370 con 0x7f74d8072fe0 2024-09-11T14:37:50.656 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_bytes = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf 2024-09-11T14:37:50.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.654+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(713..713 src has 593..713) ==== 628+0+0 (crc 0 0 0) 0x7f74c800fbc0 con 0x7f74d8072fe0 2024-09-11T14:37:50.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.655+0000 7f74d4ff9640 1 -- 172.21.15.46:0/1307425595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7f74c4045cd0 con 0x7f74d8072fe0 2024-09-11T14:37:50.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.654+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 <== mon.0 v2:172.21.15.46:3300/0 7 ==== osd_map(713..713 src has 593..713) ==== 628+0+0 (crc 0 0 0) 0x7f8ff4009c30 con 0x1542d90 2024-09-11T14:37:50.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.655+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7f8ff0043dc0 con 0x1542d90 2024-09-11T14:37:50.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f74c403e930 msgr2=0x7f74c4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:50.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 --2- 172.21.15.46:0/1307425595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f74c403e930 0x7f74c4040e40 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:50.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 msgr2=0x7f74d811f1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:50.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 --2- 172.21.15.46:0/1307425595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 0x7f74d811f1b0 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:50.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 shutdown_connections 2024-09-11T14:37:50.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 --2- 172.21.15.46:0/1307425595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f74c403e930 0x7f74c4040e40 crc :-1 s=CLOSED pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:50.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 --2- 172.21.15.46:0/1307425595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74d8072fe0 0x7f74d811f1b0 unknown :-1 s=CLOSED pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:50.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 >> 172.21.15.46:0/1307425595 conn(0x7f74d80a3b90 msgr2=0x7f74d8132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:50.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 shutdown_connections 2024-09-11T14:37:50.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.658+0000 7f74de551640 1 -- 172.21.15.46:0/1307425595 wait complete. 2024-09-11T14:37:50.672 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota bcc42802-4a92-4251-a537-9d1c078ffecf max_objects 0 2024-09-11T14:37:50.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.774+0000 7f67c3911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:50.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.784+0000 7f67c3911640 1 Processor -- start 2024-09-11T14:37:50.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.784+0000 7f67c3911640 1 -- start start 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.785+0000 7f67c3911640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f67bc072fe0 0x7f67bc1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.785+0000 7f67c3911640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67bc09fc50 con 0x7f67bc130a10 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.785+0000 7f67c3911640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f67bc0a3380 con 0x7f67bc072fe0 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67c16ad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f67bc072fe0 0x7f67bc1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67c16ad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f67bc072fe0 0x7f67bc1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47116/0 (socket says 172.21.15.46:47116) 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67c16ad640 1 -- 172.21.15.46:0/1770745178 learned_addr learned my addr 172.21.15.46:0/1770745178 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67c0eac640 1 --1- 172.21.15.46:0/1770745178 >> v1:172.21.15.46:6789/0 conn(0x7f67bc130a10 0x7f67bc071830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41020/0 (socket says 172.21.15.46:41020) 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67c16ad640 1 -- 172.21.15.46:0/1770745178 >> v1:172.21.15.46:6789/0 conn(0x7f67bc130a10 legacy=0x7f67bc071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67c16ad640 1 -- 172.21.15.46:0/1770745178 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc0748d0 con 0x7f67bc072fe0 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67c16ad640 1 --2- 172.21.15.46:0/1770745178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 0x7f67bc1304d0 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b864247e8bbc7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67affff640 1 -- 172.21.15.46:0/1770745178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f67b0009e50 con 0x7f67bc072fe0 2024-09-11T14:37:50.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67affff640 1 -- 172.21.15.46:0/1770745178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f67b000e230 con 0x7f67bc072fe0 2024-09-11T14:37:50.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.786+0000 7f67affff640 1 -- 172.21.15.46:0/1770745178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f67b000e4d0 con 0x7f67bc072fe0 2024-09-11T14:37:50.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.787+0000 7f67c3911640 1 -- 172.21.15.46:0/1770745178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 msgr2=0x7f67bc1304d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:50.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.787+0000 7f67c3911640 1 --2- 172.21.15.46:0/1770745178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 0x7f67bc1304d0 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.787+0000 7f67c3911640 1 -- 172.21.15.46:0/1770745178 shutdown_connections 2024-09-11T14:37:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.787+0000 7f67c3911640 1 --2- 172.21.15.46:0/1770745178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 0x7f67bc1304d0 unknown :-1 s=CLOSED pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.787+0000 7f67c3911640 1 -- 172.21.15.46:0/1770745178 >> 172.21.15.46:0/1770745178 conn(0x7f67bc0a3b90 msgr2=0x7f67bc0a23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.787+0000 7f67c3911640 1 -- 172.21.15.46:0/1770745178 shutdown_connections 2024-09-11T14:37:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.787+0000 7f67c3911640 1 -- 172.21.15.46:0/1770745178 wait complete. 2024-09-11T14:37:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.787+0000 7f67c3911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.789+0000 7f67c3911640 1 Processor -- start 2024-09-11T14:37:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.789+0000 7f67c3911640 1 -- start start 2024-09-11T14:37:50.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67c3911640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 0x7f67bc11f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:50.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67c3911640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc123200 con 0x7f67bc072fe0 2024-09-11T14:37:50.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67c16ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 0x7f67bc11f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:50.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67c16ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 0x7f67bc11f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47124/0 (socket says 172.21.15.46:47124) 2024-09-11T14:37:50.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67c16ad640 1 -- 172.21.15.46:0/2607817237 learned_addr learned my addr 172.21.15.46:0/2607817237 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:50.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67c16ad640 1 -- 172.21.15.46:0/2607817237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc122510 con 0x7f67bc072fe0 2024-09-11T14:37:50.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67c16ad640 1 --2- 172.21.15.46:0/2607817237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 0x7f67bc11f1b0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:50.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f67b000eda0 con 0x7f67bc072fe0 2024-09-11T14:37:50.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f67b0015420 con 0x7f67bc072fe0 2024-09-11T14:37:50.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67bc120c30 con 0x7f67bc072fe0 2024-09-11T14:37:50.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.791+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f67b00156c0 con 0x7f67bc072fe0 2024-09-11T14:37:50.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.792+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67bc122d60 con 0x7f67bc072fe0 2024-09-11T14:37:50.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.793+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67bc0a2d50 con 0x7f67bc072fe0 2024-09-11T14:37:50.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.793+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f67b0015870 con 0x7f67bc072fe0 2024-09-11T14:37:50.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.793+0000 7f67adffb640 1 --2- 172.21.15.46:0/2607817237 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f67a003e930 0x7f67a0040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:50.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.793+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(713..713 src has 593..713) ==== 3819+0+0 (crc 0 0 0) 0x7f67b0051160 con 0x7f67bc072fe0 2024-09-11T14:37:50.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.793+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7f67a0044bc0 con 0x7f67bc072fe0 2024-09-11T14:37:50.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.793+0000 7f67c0eac640 1 --2- 172.21.15.46:0/2607817237 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f67a003e930 0x7f67a0040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:50.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.794+0000 7f67c0eac640 1 --2- 172.21.15.46:0/2607817237 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f67a003e930 0x7f67a0040e40 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:50.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.798+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f67b0014c60 con 0x7f67bc072fe0 2024-09-11T14:37:50.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:50.985+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "0"} v 0) -- 0x7f67bc0a1900 con 0x7f67bc072fe0 2024-09-11T14:37:51.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:51.655+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v714) ==== 221+0+0 (crc 0 0 0) 0x7f67b0011e00 con 0x7f67bc072fe0 2024-09-11T14:37:51.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:51.655+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(714..714 src has 593..714) ==== 628+0+0 (crc 0 0 0) 0x7f8ff4012890 con 0x1542d90 2024-09-11T14:37:51.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:51.656+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f8ff0043dc0 con 0x1542d90 2024-09-11T14:37:51.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:51.656+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(714..714 src has 593..714) ==== 628+0+0 (crc 0 0 0) 0x7f67b0012d80 con 0x7f67bc072fe0 2024-09-11T14:37:51.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:51.656+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f67a0045b00 con 0x7f67bc072fe0 2024-09-11T14:37:51.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:51.782+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "0"} v 0) -- 0x7f67bc0008d0 con 0x7f67bc072fe0 2024-09-11T14:37:52.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.018+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v715) ==== 221+0+0 (crc 0 0 0) 0x7f67b00129e0 con 0x7f67bc072fe0 2024-09-11T14:37:52.020 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf 2024-09-11T14:37:52.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.018+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 <== mon.0 v2:172.21.15.46:3300/0 9 ==== osd_map(715..715 src has 593..715) ==== 628+0+0 (crc 0 0 0) 0x7f8ff40062a0 con 0x1542d90 2024-09-11T14:37:52.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.018+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(715..715 src has 593..715) ==== 628+0+0 (crc 0 0 0) 0x7f67b00143b0 con 0x7f67bc072fe0 2024-09-11T14:37:52.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.018+0000 7f67adffb640 1 -- 172.21.15.46:0/2607817237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=716}) -- 0x7f67a0045c20 con 0x7f67bc072fe0 2024-09-11T14:37:52.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.018+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=716}) -- 0x7f8ff0043dc0 con 0x1542d90 2024-09-11T14:37:52.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.018+0000 7f9008996640 1 -- 172.21.15.46:0/1659041135 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 199.6 199:6b5d76a5:::two:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x7f8ff00440a0 con 0x15490e0 2024-09-11T14:37:52.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f67a003e930 msgr2=0x7f67a0040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 --2- 172.21.15.46:0/2607817237 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f67a003e930 0x7f67a0040e40 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 msgr2=0x7f67bc11f1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 --2- 172.21.15.46:0/2607817237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 0x7f67bc11f1b0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 shutdown_connections 2024-09-11T14:37:52.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 --2- 172.21.15.46:0/2607817237 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f67a003e930 0x7f67a0040e40 unknown :-1 s=CLOSED pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 --2- 172.21.15.46:0/2607817237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc072fe0 0x7f67bc11f1b0 unknown :-1 s=CLOSED pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 >> 172.21.15.46:0/2607817237 conn(0x7f67bc0a3b90 msgr2=0x7f67bc132b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:52.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 shutdown_connections 2024-09-11T14:37:52.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.021+0000 7f67c3911640 1 -- 172.21.15.46:0/2607817237 wait complete. 2024-09-11T14:37:52.034 INFO:tasks.workunit.client.0.smithi046.stderr:+ wait 95747 2024-09-11T14:37:52.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f900b99c640 1 -- 172.21.15.46:0/1659041135 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 two [writefull 0~12777] v715'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f8ffc00a430 con 0x15490e0 2024-09-11T14:37:52.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 -- 172.21.15.46:0/1659041135 >> v2:172.21.15.47:6805/1666238977 conn(0x15490e0 msgr2=0x153ee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 --2- 172.21.15.46:0/1659041135 >> v2:172.21.15.47:6805/1666238977 conn(0x15490e0 0x153ee10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 -- 172.21.15.46:0/1659041135 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8ff003d170 msgr2=0x7f8ff003f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 --2- 172.21.15.46:0/1659041135 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8ff003d170 0x7f8ff003f680 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 -- 172.21.15.46:0/1659041135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 msgr2=0x152e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 --2- 172.21.15.46:0/1659041135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x152e470 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 -- 172.21.15.46:0/1659041135 shutdown_connections 2024-09-11T14:37:52.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 --2- 172.21.15.46:0/1659041135 >> v2:172.21.15.47:6805/1666238977 conn(0x15490e0 0x153ee10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 --2- 172.21.15.46:0/1659041135 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f8ff003d170 0x7f8ff003f680 unknown :-1 s=CLOSED pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 --2- 172.21.15.46:0/1659041135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1542d90 0x152e470 unknown :-1 s=CLOSED pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 -- 172.21.15.46:0/1659041135 >> 172.21.15.46:0/1659041135 conn(0x13d8770 msgr2=0x1543b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:52.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 -- 172.21.15.46:0/1659041135 shutdown_connections 2024-09-11T14:37:52.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.079+0000 7f9012d3fec0 1 -- 172.21.15.46:0/1659041135 wait complete. 2024-09-11T14:37:52.083 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -ne 0 ']' 2024-09-11T14:37:52.083 INFO:tasks.workunit.client.0.smithi046.stderr:+ true 2024-09-11T14:37:52.083 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put three /etc/passwd 2024-09-11T14:37:52.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.121+0000 7f4f61639ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:52.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.127+0000 7f4f61639ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:52.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.127+0000 7f4f61639ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:52.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.128+0000 7f4f61639ec0 1 Processor -- start 2024-09-11T14:37:52.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.128+0000 7f4f61639ec0 1 -- start start 2024-09-11T14:37:52.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.129+0000 7f4f61639ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x24578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:52.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.129+0000 7f4f61639ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x229d520 con 0x2330810 2024-09-11T14:37:52.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.129+0000 7f4f5963f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x24578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:52.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.129+0000 7f4f5963f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x24578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47144/0 (socket says 172.21.15.46:47144) 2024-09-11T14:37:52.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.129+0000 7f4f5963f640 1 -- 172.21.15.46:0/3616910964 learned_addr learned my addr 172.21.15.46:0/3616910964 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:52.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.129+0000 7f4f5963f640 1 -- 172.21.15.46:0/3616910964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2239e10 con 0x2330810 2024-09-11T14:37:52.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.129+0000 7f4f5963f640 1 --2- 172.21.15.46:0/3616910964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x24578f0 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f70a721bc1924eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:52.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f52ffd640 1 -- 172.21.15.46:0/3616910964 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f4c0061f0 con 0x2330810 2024-09-11T14:37:52.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f52ffd640 1 -- 172.21.15.46:0/3616910964 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4f4c001a30 con 0x2330810 2024-09-11T14:37:52.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f52ffd640 1 -- 172.21.15.46:0/3616910964 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f4c001ba0 con 0x2330810 2024-09-11T14:37:52.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3616910964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 msgr2=0x24578f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f61639ec0 1 --2- 172.21.15.46:0/3616910964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x24578f0 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3616910964 shutdown_connections 2024-09-11T14:37:52.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f61639ec0 1 --2- 172.21.15.46:0/3616910964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x24578f0 unknown :-1 s=CLOSED pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3616910964 >> 172.21.15.46:0/3616910964 conn(0x225d770 msgr2=0x2334510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:52.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3616910964 shutdown_connections 2024-09-11T14:37:52.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.130+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3616910964 wait complete. 2024-09-11T14:37:52.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.131+0000 7f4f61639ec0 1 Processor -- start 2024-09-11T14:37:52.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.131+0000 7f4f61639ec0 1 -- start start 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f61639ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x245dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f61639ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x229b280 con 0x2330810 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f5963f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x245dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f5963f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x245dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47158/0 (socket says 172.21.15.46:47158) 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f5963f640 1 -- 172.21.15.46:0/3753618891 learned_addr learned my addr 172.21.15.46:0/3753618891 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f5963f640 1 -- 172.21.15.46:0/3753618891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x222b920 con 0x2330810 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f5963f640 1 --2- 172.21.15.46:0/3753618891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x245dc80 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f51ffb640 1 -- 172.21.15.46:0/3753618891 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f4c011e80 con 0x2330810 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f51ffb640 1 -- 172.21.15.46:0/3753618891 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4f4c0060c0 con 0x2330810 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.133+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x222b380 con 0x2330810 2024-09-11T14:37:52.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.134+0000 7f4f51ffb640 1 -- 172.21.15.46:0/3753618891 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f4c003450 con 0x2330810 2024-09-11T14:37:52.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.134+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x245d9c0 con 0x2330810 2024-09-11T14:37:52.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.134+0000 7f4f51ffb640 1 -- 172.21.15.46:0/3753618891 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4f4c003600 con 0x2330810 2024-09-11T14:37:52.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.135+0000 7f4f51ffb640 1 --2- 172.21.15.46:0/3753618891 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4f3403d1c0 0x7f4f3403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:52.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.135+0000 7f4f51ffb640 1 -- 172.21.15.46:0/3753618891 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(715..715 src has 593..715) ==== 3819+0+0 (crc 0 0 0) 0x7f4f4c052220 con 0x2330810 2024-09-11T14:37:52.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.135+0000 7f4f61639ec0 1 --2- 172.21.15.46:0/3753618891 >> v2:172.21.15.47:6805/1666238977 conn(0x2339830 0x2450510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:52.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.135+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 199.3 199:c57798d7:::three:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e715) -- 0x2451b60 con 0x2339830 2024-09-11T14:37:52.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.135+0000 7f4f58e3e640 1 --2- 172.21.15.46:0/3753618891 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4f3403d1c0 0x7f4f3403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:52.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.136+0000 7f4f58e3e640 1 --2- 172.21.15.46:0/3753618891 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4f3403d1c0 0x7f4f3403f6d0 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:52.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.136+0000 7f4f59e40640 1 --2- 172.21.15.46:0/3753618891 >> v2:172.21.15.47:6805/1666238977 conn(0x2339830 0x2450510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:37:52.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.140+0000 7f4f59e40640 1 --2- 172.21.15.46:0/3753618891 >> v2:172.21.15.47:6805/1666238977 conn(0x2339830 0x2450510 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:52.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f59e40640 1 -- 172.21.15.46:0/3753618891 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 three [writefull 0~12777] v715'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f4f4400c430 con 0x2339830 2024-09-11T14:37:52.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 >> v2:172.21.15.47:6805/1666238977 conn(0x2339830 msgr2=0x2450510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 --2- 172.21.15.46:0/3753618891 >> v2:172.21.15.47:6805/1666238977 conn(0x2339830 0x2450510 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4f3403d1c0 msgr2=0x7f4f3403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 --2- 172.21.15.46:0/3753618891 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4f3403d1c0 0x7f4f3403f6d0 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 msgr2=0x245dc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 --2- 172.21.15.46:0/3753618891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x245dc80 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 shutdown_connections 2024-09-11T14:37:52.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 --2- 172.21.15.46:0/3753618891 >> v2:172.21.15.47:6805/1666238977 conn(0x2339830 0x2450510 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 --2- 172.21.15.46:0/3753618891 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f4f3403d1c0 0x7f4f3403f6d0 unknown :-1 s=CLOSED pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 --2- 172.21.15.46:0/3753618891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2330810 0x245dc80 unknown :-1 s=CLOSED pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 >> 172.21.15.46:0/3753618891 conn(0x225d770 msgr2=0x2334300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:52.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 shutdown_connections 2024-09-11T14:37:52.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.163+0000 7f4f61639ec0 1 -- 172.21.15.46:0/3753618891 wait complete. 2024-09-11T14:37:52.167 INFO:tasks.workunit.client.0.smithi046.stderr:++ uuidgen 2024-09-11T14:37:52.168 INFO:tasks.workunit.client.0.smithi046.stderr:+ pp=48ced627-17b4-4855-926a-7d45bdad78a6 2024-09-11T14:37:52.168 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool create 48ced627-17b4-4855-926a-7d45bdad78a6 12 2024-09-11T14:37:52.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.254+0000 7fa38707d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:52.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.263+0000 7fa38707d640 1 Processor -- start 2024-09-11T14:37:52.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.263+0000 7fa38707d640 1 -- start start 2024-09-11T14:37:52.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.264+0000 7fa38707d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa38009c520 0x7fa380137680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:52.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.264+0000 7fa38707d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38009d030 con 0x7fa38009ba00 2024-09-11T14:37:52.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.264+0000 7fa38707d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fa38009d230 con 0x7fa38009c520 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.264+0000 7fa384e19640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa38009ba00 0x7fa38009be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41036/0 (socket says 172.21.15.46:41036) 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.264+0000 7fa384e19640 1 -- 172.21.15.46:0/2520881023 learned_addr learned my addr 172.21.15.46:0/2520881023 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.264+0000 7fa37ffff640 1 --2- 172.21.15.46:0/2520881023 >> v2:172.21.15.46:3300/0 conn(0x7fa38009c520 0x7fa380137680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.265+0000 7fa37f7fe640 1 -- 172.21.15.46:0/2520881023 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958100251 0 0) 0x7fa38009d030 con 0x7fa38009ba00 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.265+0000 7fa37f7fe640 1 -- 172.21.15.46:0/2520881023 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa36c003580 con 0x7fa38009ba00 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.265+0000 7fa37ffff640 1 -- 172.21.15.46:0/2520881023 >> v1:172.21.15.46:6789/0 conn(0x7fa38009ba00 legacy=0x7fa38009be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.265+0000 7fa37ffff640 1 -- 172.21.15.46:0/2520881023 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38009ee50 con 0x7fa38009c520 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.265+0000 7fa37ffff640 1 --2- 172.21.15.46:0/2520881023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009c520 0x7fa380137680 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce74536934847ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.265+0000 7fa37f7fe640 1 -- 172.21.15.46:0/2520881023 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa368009d90 con 0x7fa38009c520 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.265+0000 7fa37f7fe640 1 -- 172.21.15.46:0/2520881023 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa36800e230 con 0x7fa38009c520 2024-09-11T14:37:52.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.265+0000 7fa37f7fe640 1 -- 172.21.15.46:0/2520881023 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa36800e4d0 con 0x7fa38009c520 2024-09-11T14:37:52.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.266+0000 7fa38707d640 1 -- 172.21.15.46:0/2520881023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009c520 msgr2=0x7fa380137680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:52.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.266+0000 7fa38707d640 1 --2- 172.21.15.46:0/2520881023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009c520 0x7fa380137680 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.266+0000 7fa38707d640 1 -- 172.21.15.46:0/2520881023 shutdown_connections 2024-09-11T14:37:52.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.266+0000 7fa38707d640 1 --2- 172.21.15.46:0/2520881023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009c520 0x7fa380137680 unknown :-1 s=CLOSED pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:52.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.266+0000 7fa38707d640 1 -- 172.21.15.46:0/2520881023 >> 172.21.15.46:0/2520881023 conn(0x7fa3800a26b0 msgr2=0x7fa3800a2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:52.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.266+0000 7fa38707d640 1 -- 172.21.15.46:0/2520881023 shutdown_connections 2024-09-11T14:37:52.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.266+0000 7fa38707d640 1 -- 172.21.15.46:0/2520881023 wait complete. 2024-09-11T14:37:52.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.266+0000 7fa38707d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:52.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.268+0000 7fa38707d640 1 Processor -- start 2024-09-11T14:37:52.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.268+0000 7fa38707d640 1 -- start start 2024-09-11T14:37:52.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa38707d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009ba00 0x7fa38011cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa38707d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa38011df70 con 0x7fa38009ba00 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa384e19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009ba00 0x7fa38011cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa384e19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009ba00 0x7fa38011cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47176/0 (socket says 172.21.15.46:47176) 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa384e19640 1 -- 172.21.15.46:0/3386235287 learned_addr learned my addr 172.21.15.46:0/3386235287 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa384e19640 1 -- 172.21.15.46:0/3386235287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38011e550 con 0x7fa38009ba00 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa384e19640 1 --2- 172.21.15.46:0/3386235287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009ba00 0x7fa38011cad0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa37d7fa640 1 -- 172.21.15.46:0/3386235287 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa370005a60 con 0x7fa38009ba00 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa37d7fa640 1 -- 172.21.15.46:0/3386235287 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa370005bc0 con 0x7fa38009ba00 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38011dc60 con 0x7fa38009ba00 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa37d7fa640 1 -- 172.21.15.46:0/3386235287 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa370005e60 con 0x7fa38009ba00 2024-09-11T14:37:52.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.270+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38011f370 con 0x7fa38009ba00 2024-09-11T14:37:52.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.271+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3800a4380 con 0x7fa38009ba00 2024-09-11T14:37:52.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.271+0000 7fa37d7fa640 1 -- 172.21.15.46:0/3386235287 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa3700070b0 con 0x7fa38009ba00 2024-09-11T14:37:52.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.272+0000 7fa37d7fa640 1 --2- 172.21.15.46:0/3386235287 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa36003e8e0 0x7fa360040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:52.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.272+0000 7fa37d7fa640 1 -- 172.21.15.46:0/3386235287 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(715..715 src has 593..715) ==== 3819+0+0 (crc 0 0 0) 0x7fa37004fb10 con 0x7fa38009ba00 2024-09-11T14:37:52.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.272+0000 7fa37ffff640 1 --2- 172.21.15.46:0/3386235287 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa36003e8e0 0x7fa360040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:52.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.273+0000 7fa37ffff640 1 --2- 172.21.15.46:0/3386235287 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa36003e8e0 0x7fa360040df0 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:52.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.277+0000 7fa37d7fa640 1 -- 172.21.15.46:0/3386235287 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fa37000dc60 con 0x7fa38009ba00 2024-09-11T14:37:52.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:52.463+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "pg_num": 12} v 0) -- 0x7fa38006e170 con 0x7fa38009ba00 2024-09-11T14:37:53.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.021+0000 7fa37d7fa640 1 -- 172.21.15.46:0/3386235287 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "pg_num": 12}]=0 pool '48ced627-17b4-4855-926a-7d45bdad78a6' created v716) ==== 176+0+0 (crc 0 0 0) 0x7fa37000d660 con 0x7fa38009ba00 2024-09-11T14:37:53.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.152+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "pg_num": 12} v 0) -- 0x7fa38009c520 con 0x7fa38009ba00 2024-09-11T14:37:53.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.153+0000 7fa37d7fa640 1 -- 172.21.15.46:0/3386235287 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "pg_num": 12}]=0 pool '48ced627-17b4-4855-926a-7d45bdad78a6' already exists v716) ==== 183+0+0 (crc 0 0 0) 0x7fa37000d840 con 0x7fa38009ba00 2024-09-11T14:37:53.154 INFO:tasks.workunit.client.0.smithi046.stderr:pool '48ced627-17b4-4855-926a-7d45bdad78a6' already exists 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa36003e8e0 msgr2=0x7fa360040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 --2- 172.21.15.46:0/3386235287 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa36003e8e0 0x7fa360040df0 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009ba00 msgr2=0x7fa38011cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 --2- 172.21.15.46:0/3386235287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009ba00 0x7fa38011cad0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 shutdown_connections 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 --2- 172.21.15.46:0/3386235287 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa36003e8e0 0x7fa360040df0 unknown :-1 s=CLOSED pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 --2- 172.21.15.46:0/3386235287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa38009ba00 0x7fa38011cad0 unknown :-1 s=CLOSED pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 >> 172.21.15.46:0/3386235287 conn(0x7fa3800a26b0 msgr2=0x7fa38009f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 shutdown_connections 2024-09-11T14:37:53.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.155+0000 7fa38707d640 1 -- 172.21.15.46:0/3386235287 wait complete. 2024-09-11T14:37:53.166 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool application enable 48ced627-17b4-4855-926a-7d45bdad78a6 rados 2024-09-11T14:37:53.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.253+0000 7f00f7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:53.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.263+0000 7f00f7151640 1 Processor -- start 2024-09-11T14:37:53.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.263+0000 7f00f7151640 1 -- start start 2024-09-11T14:37:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00f7151640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f00f0130bc0 0x7f00f0138810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00f7151640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00f0072ac0 con 0x7f00f0073860 2024-09-11T14:37:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00f7151640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f00f0073230 con 0x7f00f0130bc0 2024-09-11T14:37:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00f4eed640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f00f0073860 0x7f00f01304b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41040/0 (socket says 172.21.15.46:41040) 2024-09-11T14:37:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00f4eed640 1 -- 172.21.15.46:0/2836402256 learned_addr learned my addr 172.21.15.46:0/2836402256 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:37:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00effff640 1 --2- 172.21.15.46:0/2836402256 >> v2:172.21.15.46:3300/0 conn(0x7f00f0130bc0 0x7f00f0138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00ef7fe640 1 -- 172.21.15.46:0/2836402256 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983068049 0 0) 0x7f00f0072ac0 con 0x7f00f0073860 2024-09-11T14:37:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00ef7fe640 1 -- 172.21.15.46:0/2836402256 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00d8003580 con 0x7f00f0073860 2024-09-11T14:37:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00effff640 1 -- 172.21.15.46:0/2836402256 >> v1:172.21.15.46:6789/0 conn(0x7f00f0073860 legacy=0x7f00f01304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.265+0000 7f00effff640 1 -- 172.21.15.46:0/2836402256 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f0074760 con 0x7f00f0130bc0 2024-09-11T14:37:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.266+0000 7f00effff640 1 --2- 172.21.15.46:0/2836402256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0130bc0 0x7f00f0138810 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba26ce83aaee31e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.266+0000 7f00ef7fe640 1 -- 172.21.15.46:0/2836402256 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f00e4009d90 con 0x7f00f0130bc0 2024-09-11T14:37:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.266+0000 7f00ef7fe640 1 -- 172.21.15.46:0/2836402256 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f00e400e230 con 0x7f00f0130bc0 2024-09-11T14:37:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.266+0000 7f00ef7fe640 1 -- 172.21.15.46:0/2836402256 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f00e400e4d0 con 0x7f00f0130bc0 2024-09-11T14:37:53.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.266+0000 7f00f7151640 1 -- 172.21.15.46:0/2836402256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0130bc0 msgr2=0x7f00f0138810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.266+0000 7f00f7151640 1 --2- 172.21.15.46:0/2836402256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0130bc0 0x7f00f0138810 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.266+0000 7f00f7151640 1 -- 172.21.15.46:0/2836402256 shutdown_connections 2024-09-11T14:37:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.267+0000 7f00f7151640 1 --2- 172.21.15.46:0/2836402256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0130bc0 0x7f00f0138810 unknown :-1 s=CLOSED pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.267+0000 7f00f7151640 1 -- 172.21.15.46:0/2836402256 >> 172.21.15.46:0/2836402256 conn(0x7f00f00a37d0 msgr2=0x7f00f00a3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.267+0000 7f00f7151640 1 -- 172.21.15.46:0/2836402256 shutdown_connections 2024-09-11T14:37:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.267+0000 7f00f7151640 1 -- 172.21.15.46:0/2836402256 wait complete. 2024-09-11T14:37:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.267+0000 7f00f7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.268+0000 7f00f7151640 1 Processor -- start 2024-09-11T14:37:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.269+0000 7f00f7151640 1 -- start start 2024-09-11T14:37:53.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.270+0000 7f00f7151640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0073860 0x7f00f01c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.270+0000 7f00f7151640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f00f011cc80 con 0x7f00f0073860 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.270+0000 7f00f4eed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0073860 0x7f00f01c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.270+0000 7f00f4eed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0073860 0x7f00f01c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47188/0 (socket says 172.21.15.46:47188) 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.270+0000 7f00f4eed640 1 -- 172.21.15.46:0/3846340799 learned_addr learned my addr 172.21.15.46:0/3846340799 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.271+0000 7f00f4eed640 1 -- 172.21.15.46:0/3846340799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f011cf80 con 0x7f00f0073860 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.271+0000 7f00f4eed640 1 --2- 172.21.15.46:0/3846340799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0073860 0x7f00f01c7d60 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.271+0000 7f00ed7fa640 1 -- 172.21.15.46:0/3846340799 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f00e0005a60 con 0x7f00f0073860 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.271+0000 7f00ed7fa640 1 -- 172.21.15.46:0/3846340799 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f00e0005bc0 con 0x7f00f0073860 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.271+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f0137370 con 0x7f00f0073860 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.271+0000 7f00ed7fa640 1 -- 172.21.15.46:0/3846340799 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f00e0005e60 con 0x7f00f0073860 2024-09-11T14:37:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.271+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f011e770 con 0x7f00f0073860 2024-09-11T14:37:53.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.272+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f0074a90 con 0x7f00f0073860 2024-09-11T14:37:53.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.272+0000 7f00ed7fa640 1 -- 172.21.15.46:0/3846340799 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f00e00070b0 con 0x7f00f0073860 2024-09-11T14:37:53.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.273+0000 7f00ed7fa640 1 --2- 172.21.15.46:0/3846340799 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f00dc03e930 0x7f00dc040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:53.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.273+0000 7f00ed7fa640 1 -- 172.21.15.46:0/3846340799 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(716..716 src has 593..716) ==== 4194+0+0 (crc 0 0 0) 0x7f00e004fc20 con 0x7f00f0073860 2024-09-11T14:37:53.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.273+0000 7f00effff640 1 --2- 172.21.15.46:0/3846340799 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f00dc03e930 0x7f00dc040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:53.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.273+0000 7f00effff640 1 --2- 172.21.15.46:0/3846340799 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f00dc03e930 0x7f00dc040e40 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:53.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.278+0000 7f00ed7fa640 1 -- 172.21.15.46:0/3846340799 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f00e000dc60 con 0x7f00f0073860 2024-09-11T14:37:53.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:53.465+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "app": "rados"} v 0) -- 0x7f00f01304b0 con 0x7f00f0073860 2024-09-11T14:37:54.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:54.023+0000 7f00ed7fa640 1 -- 172.21.15.46:0/3846340799 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "app": "rados"}]=0 enabled application 'rados' on pool '48ced627-17b4-4855-926a-7d45bdad78a6' v717) ==== 213+0+0 (crc 0 0 0) 0x7f00e000d660 con 0x7f00f0073860 2024-09-11T14:37:54.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:54.226+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "app": "rados"} v 0) -- 0x7f00f00008d0 con 0x7f00f0073860 2024-09-11T14:37:55.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.027+0000 7f00ed7fa640 1 -- 172.21.15.46:0/3846340799 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "app": "rados"}]=0 enabled application 'rados' on pool '48ced627-17b4-4855-926a-7d45bdad78a6' v718) ==== 213+0+0 (crc 0 0 0) 0x7f00e000d840 con 0x7f00f0073860 2024-09-11T14:37:55.028 INFO:tasks.workunit.client.0.smithi046.stderr:enabled application 'rados' on pool '48ced627-17b4-4855-926a-7d45bdad78a6' 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f00dc03e930 msgr2=0x7f00dc040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 --2- 172.21.15.46:0/3846340799 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f00dc03e930 0x7f00dc040e40 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0073860 msgr2=0x7f00f01c7d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 --2- 172.21.15.46:0/3846340799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0073860 0x7f00f01c7d60 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 shutdown_connections 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 --2- 172.21.15.46:0/3846340799 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f00dc03e930 0x7f00dc040e40 unknown :-1 s=CLOSED pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 --2- 172.21.15.46:0/3846340799 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f0073860 0x7f00f01c7d60 unknown :-1 s=CLOSED pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 >> 172.21.15.46:0/3846340799 conn(0x7f00f00a37d0 msgr2=0x7f00f00a02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 shutdown_connections 2024-09-11T14:37:55.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.030+0000 7f00f7151640 1 -- 172.21.15.46:0/3846340799 wait complete. 2024-09-11T14:37:55.051 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota 48ced627-17b4-4855-926a-7d45bdad78a6 max_objects 10 2024-09-11T14:37:55.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.157+0000 7fc416d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:55.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.167+0000 7fc416d11640 1 Processor -- start 2024-09-11T14:37:55.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.167+0000 7fc416d11640 1 -- start start 2024-09-11T14:37:55.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.169+0000 7fc416d11640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc41012f120 0x7fc41012f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:55.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.169+0000 7fc416d11640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4100711e0 con 0x7fc410132230 2024-09-11T14:37:55.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.169+0000 7fc416d11640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc4100a3060 con 0x7fc41012f120 2024-09-11T14:37:55.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.169+0000 7fc414aad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc41012f120 0x7fc41012f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:55.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.169+0000 7fc40ffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc410132230 0x7fc410132640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41054/0 (socket says 172.21.15.46:41054) 2024-09-11T14:37:55.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.169+0000 7fc40ffff640 1 -- 172.21.15.46:0/1663942638 learned_addr learned my addr 172.21.15.46:0/1663942638 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:37:55.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.170+0000 7fc414aad640 1 -- 172.21.15.46:0/1663942638 >> v1:172.21.15.46:6789/0 conn(0x7fc410132230 legacy=0x7fc410132640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:55.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.170+0000 7fc414aad640 1 -- 172.21.15.46:0/1663942638 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41006f630 con 0x7fc41012f120 2024-09-11T14:37:55.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.170+0000 7fc414aad640 1 --2- 172.21.15.46:0/1663942638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 0x7fc41012f530 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b64981d050316e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:55.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.170+0000 7fc40f7fe640 1 -- 172.21.15.46:0/1663942638 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc400009d90 con 0x7fc41012f120 2024-09-11T14:37:55.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.170+0000 7fc40f7fe640 1 -- 172.21.15.46:0/1663942638 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc40000e230 con 0x7fc41012f120 2024-09-11T14:37:55.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.170+0000 7fc40f7fe640 1 -- 172.21.15.46:0/1663942638 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc40000e4d0 con 0x7fc41012f120 2024-09-11T14:37:55.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.171+0000 7fc416d11640 1 -- 172.21.15.46:0/1663942638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 msgr2=0x7fc41012f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:55.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.171+0000 7fc416d11640 1 --2- 172.21.15.46:0/1663942638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 0x7fc41012f530 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:55.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.171+0000 7fc416d11640 1 -- 172.21.15.46:0/1663942638 shutdown_connections 2024-09-11T14:37:55.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.171+0000 7fc416d11640 1 --2- 172.21.15.46:0/1663942638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 0x7fc41012f530 unknown :-1 s=CLOSED pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:55.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.171+0000 7fc416d11640 1 -- 172.21.15.46:0/1663942638 >> 172.21.15.46:0/1663942638 conn(0x7fc4100a1530 msgr2=0x7fc4100a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:55.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.171+0000 7fc416d11640 1 -- 172.21.15.46:0/1663942638 shutdown_connections 2024-09-11T14:37:55.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.171+0000 7fc416d11640 1 -- 172.21.15.46:0/1663942638 wait complete. 2024-09-11T14:37:55.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.171+0000 7fc416d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:37:55.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.173+0000 7fc416d11640 1 Processor -- start 2024-09-11T14:37:55.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.173+0000 7fc416d11640 1 -- start start 2024-09-11T14:37:55.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.174+0000 7fc416d11640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 0x7fc41011fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:55.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.174+0000 7fc416d11640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc410122580 con 0x7fc41012f120 2024-09-11T14:37:55.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc414aad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 0x7fc41011fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:55.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc414aad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 0x7fc41011fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47196/0 (socket says 172.21.15.46:47196) 2024-09-11T14:37:55.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc414aad640 1 -- 172.21.15.46:0/1120060973 learned_addr learned my addr 172.21.15.46:0/1120060973 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:37:55.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc414aad640 1 -- 172.21.15.46:0/1120060973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41009ed60 con 0x7fc41012f120 2024-09-11T14:37:55.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc414aad640 1 --2- 172.21.15.46:0/1120060973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 0x7fc41011fd80 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:55.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc40d7fa640 1 -- 172.21.15.46:0/1120060973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc400014620 con 0x7fc41012f120 2024-09-11T14:37:55.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc40d7fa640 1 -- 172.21.15.46:0/1120060973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc400014780 con 0x7fc41012f120 2024-09-11T14:37:55.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41012ea80 con 0x7fc41012f120 2024-09-11T14:37:55.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc40d7fa640 1 -- 172.21.15.46:0/1120060973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc400014a20 con 0x7fc41012f120 2024-09-11T14:37:55.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.175+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc41009e5c0 con 0x7fc41012f120 2024-09-11T14:37:55.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.176+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc410122da0 con 0x7fc41012f120 2024-09-11T14:37:55.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.177+0000 7fc40d7fa640 1 -- 172.21.15.46:0/1120060973 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc400014bd0 con 0x7fc41012f120 2024-09-11T14:37:55.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.177+0000 7fc40d7fa640 1 --2- 172.21.15.46:0/1120060973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc3fc03e930 0x7fc3fc040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:37:55.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.177+0000 7fc40d7fa640 1 -- 172.21.15.46:0/1120060973 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(718..718 src has 593..718) ==== 4207+0+0 (crc 0 0 0) 0x7fc400019040 con 0x7fc41012f120 2024-09-11T14:37:55.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.177+0000 7fc40ffff640 1 --2- 172.21.15.46:0/1120060973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc3fc03e930 0x7fc3fc040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:37:55.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.178+0000 7fc40ffff640 1 --2- 172.21.15.46:0/1120060973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc3fc03e930 0x7fc3fc040e40 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:37:55.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.182+0000 7fc40d7fa640 1 -- 172.21.15.46:0/1120060973 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc410122da0 con 0x7fc41012f120 2024-09-11T14:37:55.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:55.368+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "field": "max_objects", "val": "10"} v 0) -- 0x7fc410122da0 con 0x7fc41012f120 2024-09-11T14:37:56.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:56.028+0000 7fc40d7fa640 1 -- 172.21.15.46:0/1120060973 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 48ced627-17b4-4855-926a-7d45bdad78a6 v719) ==== 223+0+0 (crc 0 0 0) 0x7fc410122da0 con 0x7fc41012f120 2024-09-11T14:37:56.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:56.164+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "field": "max_objects", "val": "10"} v 0) -- 0x7fc410122da0 con 0x7fc41012f120 2024-09-11T14:37:57.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.036+0000 7fc40d7fa640 1 -- 172.21.15.46:0/1120060973 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 48ced627-17b4-4855-926a-7d45bdad78a6 v720) ==== 223+0+0 (crc 0 0 0) 0x7fc410122da0 con 0x7fc41012f120 2024-09-11T14:37:57.038 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 10 for pool 48ced627-17b4-4855-926a-7d45bdad78a6 2024-09-11T14:37:57.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.040+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc3fc03e930 msgr2=0x7fc3fc040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:57.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.040+0000 7fc416d11640 1 --2- 172.21.15.46:0/1120060973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc3fc03e930 0x7fc3fc040e40 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:57.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.041+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 msgr2=0x7fc41011fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:37:57.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.041+0000 7fc416d11640 1 --2- 172.21.15.46:0/1120060973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 0x7fc41011fd80 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:57.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.041+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 shutdown_connections 2024-09-11T14:37:57.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.041+0000 7fc416d11640 1 --2- 172.21.15.46:0/1120060973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc3fc03e930 0x7fc3fc040e40 unknown :-1 s=CLOSED pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:57.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.041+0000 7fc416d11640 1 --2- 172.21.15.46:0/1120060973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc41012f120 0x7fc41011fd80 unknown :-1 s=CLOSED pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:37:57.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.041+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 >> 172.21.15.46:0/1120060973 conn(0x7fc4100a1530 msgr2=0x7fc41009d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:37:57.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.041+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 shutdown_connections 2024-09-11T14:37:57.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:37:57.041+0000 7fc416d11640 1 -- 172.21.15.46:0/1120060973 wait complete. 2024-09-11T14:37:57.061 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-09-11T14:38:27.064 INFO:tasks.workunit.client.0.smithi046.stderr:++ seq 1 10 2024-09-11T14:38:27.065 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.065 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj1 /etc/passwd 2024-09-11T14:38:27.112 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.111+0000 7fe404c30ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.117+0000 7fe404c30ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.117+0000 7fe404c30ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.118+0000 7fe404c30ec0 1 Processor -- start 2024-09-11T14:38:27.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.118+0000 7fe404c30ec0 1 -- start start 2024-09-11T14:38:27.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.119+0000 7fe404c30ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x6c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.119+0000 7fe404c30ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5ae520 con 0x641810 2024-09-11T14:38:27.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.120+0000 7fe3fcd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x6c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.120+0000 7fe3fcd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x6c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54250/0 (socket says 172.21.15.46:54250) 2024-09-11T14:38:27.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.120+0000 7fe3fcd9b640 1 -- 172.21.15.46:0/248462106 learned_addr learned my addr 172.21.15.46:0/248462106 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.120+0000 7fe3fcd9b640 1 -- 172.21.15.46:0/248462106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x54ae10 con 0x641810 2024-09-11T14:38:27.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.120+0000 7fe3fcd9b640 1 --2- 172.21.15.46:0/248462106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x6c6d70 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798633854d29f9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.120+0000 7fe3f67fc640 1 -- 172.21.15.46:0/248462106 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe3e802dc90 con 0x641810 2024-09-11T14:38:27.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.120+0000 7fe3f67fc640 1 -- 172.21.15.46:0/248462106 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe3e802de90 con 0x641810 2024-09-11T14:38:27.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.120+0000 7fe3f67fc640 1 -- 172.21.15.46:0/248462106 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe3e800a170 con 0x641810 2024-09-11T14:38:27.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.121+0000 7fe404c30ec0 1 -- 172.21.15.46:0/248462106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 msgr2=0x6c6d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.121+0000 7fe404c30ec0 1 --2- 172.21.15.46:0/248462106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x6c6d70 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.121+0000 7fe404c30ec0 1 -- 172.21.15.46:0/248462106 shutdown_connections 2024-09-11T14:38:27.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.121+0000 7fe404c30ec0 1 --2- 172.21.15.46:0/248462106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x6c6d70 unknown :-1 s=CLOSED pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.121+0000 7fe404c30ec0 1 -- 172.21.15.46:0/248462106 >> 172.21.15.46:0/248462106 conn(0x56e770 msgr2=0x642fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.121+0000 7fe404c30ec0 1 -- 172.21.15.46:0/248462106 shutdown_connections 2024-09-11T14:38:27.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.121+0000 7fe404c30ec0 1 -- 172.21.15.46:0/248462106 wait complete. 2024-09-11T14:38:27.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.122+0000 7fe404c30ec0 1 Processor -- start 2024-09-11T14:38:27.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.122+0000 7fe404c30ec0 1 -- start start 2024-09-11T14:38:27.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe404c30ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x76f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe404c30ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5ac280 con 0x641810 2024-09-11T14:38:27.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe3fcd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x76f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe3fcd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x76f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54256/0 (socket says 172.21.15.46:54256) 2024-09-11T14:38:27.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe3fcd9b640 1 -- 172.21.15.46:0/2365095212 learned_addr learned my addr 172.21.15.46:0/2365095212 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe3fcd9b640 1 -- 172.21.15.46:0/2365095212 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x53c920 con 0x641810 2024-09-11T14:38:27.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe3fcd9b640 1 --2- 172.21.15.46:0/2365095212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x76f0e0 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe3f57fa640 1 -- 172.21.15.46:0/2365095212 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe3e803e040 con 0x641810 2024-09-11T14:38:27.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe3f57fa640 1 -- 172.21.15.46:0/2365095212 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe3e8039660 con 0x641810 2024-09-11T14:38:27.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.124+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x53c380 con 0x641810 2024-09-11T14:38:27.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.125+0000 7fe3f57fa640 1 -- 172.21.15.46:0/2365095212 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe3e8039900 con 0x641810 2024-09-11T14:38:27.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.125+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x6caa40 con 0x641810 2024-09-11T14:38:27.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.126+0000 7fe3f57fa640 1 -- 172.21.15.46:0/2365095212 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe3e8039ab0 con 0x641810 2024-09-11T14:38:27.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.126+0000 7fe3f57fa640 1 --2- 172.21.15.46:0/2365095212 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe3e403f3d0 0x7fe3e40418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.126+0000 7fe3f57fa640 1 -- 172.21.15.46:0/2365095212 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7fe3e8032040 con 0x641810 2024-09-11T14:38:27.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.126+0000 7fe404c30ec0 1 --2- 172.21.15.46:0/2365095212 >> v2:172.21.15.47:6805/1666238977 conn(0x64a660 0x6c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.126+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0x6cce60 con 0x64a660 2024-09-11T14:38:27.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.126+0000 7fe3f77fe640 1 --2- 172.21.15.46:0/2365095212 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe3e403f3d0 0x7fe3e40418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.127+0000 7fe3f77fe640 1 --2- 172.21.15.46:0/2365095212 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe3e403f3d0 0x7fe3e40418e0 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.127+0000 7fe3fd59c640 1 --2- 172.21.15.46:0/2365095212 >> v2:172.21.15.47:6805/1666238977 conn(0x64a660 0x6c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.130+0000 7fe3fd59c640 1 --2- 172.21.15.46:0/2365095212 >> v2:172.21.15.47:6805/1666238977 conn(0x64a660 0x6c9610 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe3fd59c640 1 -- 172.21.15.46:0/2365095212 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 obj1 [writefull 0~12777] v721'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3f000a430 con 0x64a660 2024-09-11T14:38:27.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 >> v2:172.21.15.47:6805/1666238977 conn(0x64a660 msgr2=0x6c9610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 --2- 172.21.15.46:0/2365095212 >> v2:172.21.15.47:6805/1666238977 conn(0x64a660 0x6c9610 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe3e403f3d0 msgr2=0x7fe3e40418e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 --2- 172.21.15.46:0/2365095212 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe3e403f3d0 0x7fe3e40418e0 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 msgr2=0x76f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 --2- 172.21.15.46:0/2365095212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x76f0e0 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 shutdown_connections 2024-09-11T14:38:27.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 --2- 172.21.15.46:0/2365095212 >> v2:172.21.15.47:6805/1666238977 conn(0x64a660 0x6c9610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 --2- 172.21.15.46:0/2365095212 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe3e403f3d0 0x7fe3e40418e0 unknown :-1 s=CLOSED pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 --2- 172.21.15.46:0/2365095212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x641810 0x76f0e0 unknown :-1 s=CLOSED pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 >> 172.21.15.46:0/2365095212 conn(0x56e770 msgr2=0x6469c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 shutdown_connections 2024-09-11T14:38:27.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.159+0000 7fe404c30ec0 1 -- 172.21.15.46:0/2365095212 wait complete. 2024-09-11T14:38:27.162 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.162 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj2 /etc/passwd 2024-09-11T14:38:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.201+0000 7f0138922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.207+0000 7f0138922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.207+0000 7f0138922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.208+0000 7f0138922ec0 1 Processor -- start 2024-09-11T14:38:27.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.208+0000 7f0138922ec0 1 -- start start 2024-09-11T14:38:27.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.209+0000 7f0138922ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xc606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.209+0000 7f0138922ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xbdf520 con 0xc72810 2024-09-11T14:38:27.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.210+0000 7f0130d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xc606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.210+0000 7f0130d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xc606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54264/0 (socket says 172.21.15.46:54264) 2024-09-11T14:38:27.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.210+0000 7f0130d9b640 1 -- 172.21.15.46:0/2433661206 learned_addr learned my addr 172.21.15.46:0/2433661206 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.210+0000 7f0130d9b640 1 -- 172.21.15.46:0/2433661206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb7be10 con 0xc72810 2024-09-11T14:38:27.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.210+0000 7f0130d9b640 1 --2- 172.21.15.46:0/2433661206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xc606f0 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40579b596e078ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.210+0000 7f012affd640 1 -- 172.21.15.46:0/2433661206 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f011c02dc90 con 0xc72810 2024-09-11T14:38:27.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.210+0000 7f012affd640 1 -- 172.21.15.46:0/2433661206 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f011c02de90 con 0xc72810 2024-09-11T14:38:27.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.210+0000 7f012affd640 1 -- 172.21.15.46:0/2433661206 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f011c00a170 con 0xc72810 2024-09-11T14:38:27.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.211+0000 7f0138922ec0 1 -- 172.21.15.46:0/2433661206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 msgr2=0xc606f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.211+0000 7f0138922ec0 1 --2- 172.21.15.46:0/2433661206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xc606f0 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.211+0000 7f0138922ec0 1 -- 172.21.15.46:0/2433661206 shutdown_connections 2024-09-11T14:38:27.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.211+0000 7f0138922ec0 1 --2- 172.21.15.46:0/2433661206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xc606f0 unknown :-1 s=CLOSED pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.211+0000 7f0138922ec0 1 -- 172.21.15.46:0/2433661206 >> 172.21.15.46:0/2433661206 conn(0xb9f770 msgr2=0xc73fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.211+0000 7f0138922ec0 1 -- 172.21.15.46:0/2433661206 shutdown_connections 2024-09-11T14:38:27.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.211+0000 7f0138922ec0 1 -- 172.21.15.46:0/2433661206 wait complete. 2024-09-11T14:38:27.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.212+0000 7f0138922ec0 1 Processor -- start 2024-09-11T14:38:27.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.212+0000 7f0138922ec0 1 -- start start 2024-09-11T14:38:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.213+0000 7f0138922ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xda4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.213+0000 7f0138922ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xbdd280 con 0xc72810 2024-09-11T14:38:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0130d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xda4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0130d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xda4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54270/0 (socket says 172.21.15.46:54270) 2024-09-11T14:38:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0130d9b640 1 -- 172.21.15.46:0/3708026134 learned_addr learned my addr 172.21.15.46:0/3708026134 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0130d9b640 1 -- 172.21.15.46:0/3708026134 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb6d920 con 0xc72810 2024-09-11T14:38:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0130d9b640 1 --2- 172.21.15.46:0/3708026134 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xda4120 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0129ffb640 1 -- 172.21.15.46:0/3708026134 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f011c03e040 con 0xc72810 2024-09-11T14:38:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0129ffb640 1 -- 172.21.15.46:0/3708026134 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f011c039660 con 0xc72810 2024-09-11T14:38:27.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xb6d380 con 0xc72810 2024-09-11T14:38:27.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0129ffb640 1 -- 172.21.15.46:0/3708026134 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f011c039900 con 0xc72810 2024-09-11T14:38:27.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.214+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xcf91f0 con 0xc72810 2024-09-11T14:38:27.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.215+0000 7f0129ffb640 1 -- 172.21.15.46:0/3708026134 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f011c039ab0 con 0xc72810 2024-09-11T14:38:27.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.216+0000 7f0129ffb640 1 --2- 172.21.15.46:0/3708026134 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f011803d1c0 0x7f011803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.216+0000 7f0129ffb640 1 -- 172.21.15.46:0/3708026134 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7f011c032040 con 0xc72810 2024-09-11T14:38:27.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.216+0000 7f0138922ec0 1 --2- 172.21.15.46:0/3708026134 >> v2:172.21.15.47:6805/1666238977 conn(0xc7b660 0xcf7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.216+0000 7f012bfff640 1 --2- 172.21.15.46:0/3708026134 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f011803d1c0 0x7f011803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.216+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0xd019b0 con 0xc7b660 2024-09-11T14:38:27.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.216+0000 7f012bfff640 1 --2- 172.21.15.46:0/3708026134 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f011803d1c0 0x7f011803f6d0 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.217+0000 7f013159c640 1 --2- 172.21.15.46:0/3708026134 >> v2:172.21.15.47:6805/1666238977 conn(0xc7b660 0xcf7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.221+0000 7f013159c640 1 --2- 172.21.15.46:0/3708026134 >> v2:172.21.15.47:6805/1666238977 conn(0xc7b660 0xcf7d70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.242+0000 7f013159c640 1 -- 172.21.15.46:0/3708026134 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 obj2 [writefull 0~12777] v721'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f012400a430 con 0xc7b660 2024-09-11T14:38:27.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.242+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 >> v2:172.21.15.47:6805/1666238977 conn(0xc7b660 msgr2=0xcf7d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.242+0000 7f0138922ec0 1 --2- 172.21.15.46:0/3708026134 >> v2:172.21.15.47:6805/1666238977 conn(0xc7b660 0xcf7d70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.242+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f011803d1c0 msgr2=0x7f011803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.242+0000 7f0138922ec0 1 --2- 172.21.15.46:0/3708026134 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f011803d1c0 0x7f011803f6d0 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.242+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 msgr2=0xda4120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.242+0000 7f0138922ec0 1 --2- 172.21.15.46:0/3708026134 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xda4120 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.242+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 shutdown_connections 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.243+0000 7f0138922ec0 1 --2- 172.21.15.46:0/3708026134 >> v2:172.21.15.47:6805/1666238977 conn(0xc7b660 0xcf7d70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.243+0000 7f0138922ec0 1 --2- 172.21.15.46:0/3708026134 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f011803d1c0 0x7f011803f6d0 unknown :-1 s=CLOSED pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.243+0000 7f0138922ec0 1 --2- 172.21.15.46:0/3708026134 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xc72810 0xda4120 unknown :-1 s=CLOSED pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.243+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 >> 172.21.15.46:0/3708026134 conn(0xb9f770 msgr2=0xc73fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.243+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 shutdown_connections 2024-09-11T14:38:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.243+0000 7f0138922ec0 1 -- 172.21.15.46:0/3708026134 wait complete. 2024-09-11T14:38:27.246 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.246 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj3 /etc/passwd 2024-09-11T14:38:27.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.283+0000 7f224163bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.289+0000 7f224163bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.289+0000 7f224163bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.290+0000 7f224163bec0 1 Processor -- start 2024-09-11T14:38:27.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.290+0000 7f224163bec0 1 -- start start 2024-09-11T14:38:27.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f224163bec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x9c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f224163bec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x812520 con 0x893650 2024-09-11T14:38:27.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f223979b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x9c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f223979b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x9c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54294/0 (socket says 172.21.15.46:54294) 2024-09-11T14:38:27.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f223979b640 1 -- 172.21.15.46:0/1376681269 learned_addr learned my addr 172.21.15.46:0/1376681269 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f223979b640 1 -- 172.21.15.46:0/1376681269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7aee10 con 0x893650 2024-09-11T14:38:27.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f223979b640 1 --2- 172.21.15.46:0/1376681269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x9c8130 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35496836f78cfedb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f2232ffd640 1 -- 172.21.15.46:0/1376681269 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f222402db90 con 0x893650 2024-09-11T14:38:27.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f2232ffd640 1 -- 172.21.15.46:0/1376681269 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2224037370 con 0x893650 2024-09-11T14:38:27.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.292+0000 7f2232ffd640 1 -- 172.21.15.46:0/1376681269 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f22240374e0 con 0x893650 2024-09-11T14:38:27.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.293+0000 7f224163bec0 1 -- 172.21.15.46:0/1376681269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 msgr2=0x9c8130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.293+0000 7f224163bec0 1 --2- 172.21.15.46:0/1376681269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x9c8130 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.293+0000 7f224163bec0 1 -- 172.21.15.46:0/1376681269 shutdown_connections 2024-09-11T14:38:27.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.293+0000 7f224163bec0 1 --2- 172.21.15.46:0/1376681269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x9c8130 unknown :-1 s=CLOSED pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.293+0000 7f224163bec0 1 -- 172.21.15.46:0/1376681269 >> 172.21.15.46:0/1376681269 conn(0x7d2770 msgr2=0x8a8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.293+0000 7f224163bec0 1 -- 172.21.15.46:0/1376681269 shutdown_connections 2024-09-11T14:38:27.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.293+0000 7f224163bec0 1 -- 172.21.15.46:0/1376681269 wait complete. 2024-09-11T14:38:27.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.294+0000 7f224163bec0 1 Processor -- start 2024-09-11T14:38:27.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.294+0000 7f224163bec0 1 -- start start 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f224163bec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x93f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f224163bec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x810280 con 0x893650 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f223979b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x93f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f223979b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x93f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54300/0 (socket says 172.21.15.46:54300) 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f223979b640 1 -- 172.21.15.46:0/2768064070 learned_addr learned my addr 172.21.15.46:0/2768064070 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f223979b640 1 -- 172.21.15.46:0/2768064070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7a0920 con 0x893650 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f223979b640 1 --2- 172.21.15.46:0/2768064070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x93f980 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f2231ffb640 1 -- 172.21.15.46:0/2768064070 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f222403e040 con 0x893650 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f2231ffb640 1 -- 172.21.15.46:0/2768064070 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f22240057c0 con 0x893650 2024-09-11T14:38:27.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7a0380 con 0x893650 2024-09-11T14:38:27.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f2231ffb640 1 -- 172.21.15.46:0/2768064070 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f222402db90 con 0x893650 2024-09-11T14:38:27.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.296+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x9304d0 con 0x893650 2024-09-11T14:38:27.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.297+0000 7f2231ffb640 1 -- 172.21.15.46:0/2768064070 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f2224039450 con 0x893650 2024-09-11T14:38:27.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.297+0000 7f2231ffb640 1 --2- 172.21.15.46:0/2768064070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f222003d170 0x7f222003f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.298+0000 7f2231ffb640 1 -- 172.21.15.46:0/2768064070 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7f2224032040 con 0x893650 2024-09-11T14:38:27.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.298+0000 7f224163bec0 1 --2- 172.21.15.46:0/2768064070 >> v2:172.21.15.46:6805/1751227380 conn(0x8af780 0x92c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.298+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0x92ff80 con 0x8af780 2024-09-11T14:38:27.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.298+0000 7f2238f9a640 1 --2- 172.21.15.46:0/2768064070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f222003d170 0x7f222003f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.298+0000 7f2238f9a640 1 --2- 172.21.15.46:0/2768064070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f222003d170 0x7f222003f680 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.299+0000 7f2239f9c640 1 --2- 172.21.15.46:0/2768064070 >> v2:172.21.15.46:6805/1751227380 conn(0x8af780 0x92c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.302+0000 7f2239f9c640 1 --2- 172.21.15.46:0/2768064070 >> v2:172.21.15.46:6805/1751227380 conn(0x8af780 0x92c4f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f2239f9c640 1 -- 172.21.15.46:0/2768064070 <== osd.1 v2:172.21.15.46:6805/1751227380 1 ==== osd_op_reply(1 obj3 [writefull 0~12777] v721'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f222c00a430 con 0x8af780 2024-09-11T14:38:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 >> v2:172.21.15.46:6805/1751227380 conn(0x8af780 msgr2=0x92c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 --2- 172.21.15.46:0/2768064070 >> v2:172.21.15.46:6805/1751227380 conn(0x8af780 0x92c4f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f222003d170 msgr2=0x7f222003f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 --2- 172.21.15.46:0/2768064070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f222003d170 0x7f222003f680 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 msgr2=0x93f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 --2- 172.21.15.46:0/2768064070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x93f980 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 shutdown_connections 2024-09-11T14:38:27.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 --2- 172.21.15.46:0/2768064070 >> v2:172.21.15.46:6805/1751227380 conn(0x8af780 0x92c4f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 --2- 172.21.15.46:0/2768064070 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f222003d170 0x7f222003f680 unknown :-1 s=CLOSED pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 --2- 172.21.15.46:0/2768064070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x893650 0x93f980 unknown :-1 s=CLOSED pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 >> 172.21.15.46:0/2768064070 conn(0x7d2770 msgr2=0x8a8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 shutdown_connections 2024-09-11T14:38:27.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.323+0000 7f224163bec0 1 -- 172.21.15.46:0/2768064070 wait complete. 2024-09-11T14:38:27.327 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.327 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj4 /etc/passwd 2024-09-11T14:38:27.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.364+0000 7f50c0231ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.370+0000 7f50c0231ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.370+0000 7f50c0231ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.371+0000 7f50c0231ec0 1 Processor -- start 2024-09-11T14:38:27.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.371+0000 7f50c0231ec0 1 -- start start 2024-09-11T14:38:27.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.372+0000 7f50c0231ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x18c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.372+0000 7f50c0231ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1846520 con 0x18d9810 2024-09-11T14:38:27.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.372+0000 7f50b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x18c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.372+0000 7f50b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x18c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54320/0 (socket says 172.21.15.46:54320) 2024-09-11T14:38:27.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.372+0000 7f50b37fe640 1 -- 172.21.15.46:0/919936166 learned_addr learned my addr 172.21.15.46:0/919936166 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.373+0000 7f50b37fe640 1 -- 172.21.15.46:0/919936166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17e2e10 con 0x18d9810 2024-09-11T14:38:27.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.373+0000 7f50b37fe640 1 --2- 172.21.15.46:0/919936166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x18c76f0 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add223a246fcf250 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.373+0000 7f50b1ffb640 1 -- 172.21.15.46:0/919936166 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50a40061e0 con 0x18d9810 2024-09-11T14:38:27.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.373+0000 7f50b1ffb640 1 -- 172.21.15.46:0/919936166 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f50a4006340 con 0x18d9810 2024-09-11T14:38:27.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.373+0000 7f50b1ffb640 1 -- 172.21.15.46:0/919936166 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50a4004880 con 0x18d9810 2024-09-11T14:38:27.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.373+0000 7f50c0231ec0 1 -- 172.21.15.46:0/919936166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 msgr2=0x18c76f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.374+0000 7f50c0231ec0 1 --2- 172.21.15.46:0/919936166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x18c76f0 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.374+0000 7f50c0231ec0 1 -- 172.21.15.46:0/919936166 shutdown_connections 2024-09-11T14:38:27.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.374+0000 7f50c0231ec0 1 --2- 172.21.15.46:0/919936166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x18c76f0 unknown :-1 s=CLOSED pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.374+0000 7f50c0231ec0 1 -- 172.21.15.46:0/919936166 >> 172.21.15.46:0/919936166 conn(0x1806770 msgr2=0x18dd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.374+0000 7f50c0231ec0 1 -- 172.21.15.46:0/919936166 shutdown_connections 2024-09-11T14:38:27.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.374+0000 7f50c0231ec0 1 -- 172.21.15.46:0/919936166 wait complete. 2024-09-11T14:38:27.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.375+0000 7f50c0231ec0 1 Processor -- start 2024-09-11T14:38:27.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.375+0000 7f50c0231ec0 1 -- start start 2024-09-11T14:38:27.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.376+0000 7f50c0231ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x1960760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.376+0000 7f50c0231ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1844280 con 0x18d9810 2024-09-11T14:38:27.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.376+0000 7f50b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x1960760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.376+0000 7f50b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x1960760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50096/0 (socket says 172.21.15.46:50096) 2024-09-11T14:38:27.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.376+0000 7f50b37fe640 1 -- 172.21.15.46:0/615091691 learned_addr learned my addr 172.21.15.46:0/615091691 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.376+0000 7f50b37fe640 1 -- 172.21.15.46:0/615091691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17d4920 con 0x18d9810 2024-09-11T14:38:27.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.377+0000 7f50b37fe640 1 --2- 172.21.15.46:0/615091691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x1960760 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.377+0000 7f50b0ff9640 1 -- 172.21.15.46:0/615091691 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50a4001ba0 con 0x18d9810 2024-09-11T14:38:27.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.377+0000 7f50b0ff9640 1 -- 172.21.15.46:0/615091691 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f50a4001d00 con 0x18d9810 2024-09-11T14:38:27.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.377+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x17d4380 con 0x18d9810 2024-09-11T14:38:27.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.377+0000 7f50b0ff9640 1 -- 172.21.15.46:0/615091691 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f50a4001fa0 con 0x18d9810 2024-09-11T14:38:27.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.377+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1961f60 con 0x18d9810 2024-09-11T14:38:27.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.378+0000 7f50b0ff9640 1 -- 172.21.15.46:0/615091691 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f50a4014410 con 0x18d9810 2024-09-11T14:38:27.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.378+0000 7f50b0ff9640 1 --2- 172.21.15.46:0/615091691 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f509403d1c0 0x7f509403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.378+0000 7f50b0ff9640 1 -- 172.21.15.46:0/615091691 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7f50a404fdc0 con 0x18d9810 2024-09-11T14:38:27.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.378+0000 7f50c0231ec0 1 --2- 172.21.15.46:0/615091691 >> v2:172.21.15.47:6805/1666238977 conn(0x18e2830 0x19611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.378+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0x1973c90 con 0x18e2830 2024-09-11T14:38:27.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.378+0000 7f50b2ffd640 1 --2- 172.21.15.46:0/615091691 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f509403d1c0 0x7f509403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.379+0000 7f50b2ffd640 1 --2- 172.21.15.46:0/615091691 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f509403d1c0 0x7f509403f6d0 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.379+0000 7f50b8a40640 1 --2- 172.21.15.46:0/615091691 >> v2:172.21.15.47:6805/1666238977 conn(0x18e2830 0x19611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.384+0000 7f50b8a40640 1 --2- 172.21.15.46:0/615091691 >> v2:172.21.15.47:6805/1666238977 conn(0x18e2830 0x19611b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50b8a40640 1 -- 172.21.15.46:0/615091691 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 obj4 [writefull 0~12777] v721'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f50ac00c430 con 0x18e2830 2024-09-11T14:38:27.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 >> v2:172.21.15.47:6805/1666238977 conn(0x18e2830 msgr2=0x19611b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 --2- 172.21.15.46:0/615091691 >> v2:172.21.15.47:6805/1666238977 conn(0x18e2830 0x19611b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f509403d1c0 msgr2=0x7f509403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 --2- 172.21.15.46:0/615091691 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f509403d1c0 0x7f509403f6d0 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 msgr2=0x1960760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 --2- 172.21.15.46:0/615091691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x1960760 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 shutdown_connections 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 --2- 172.21.15.46:0/615091691 >> v2:172.21.15.47:6805/1666238977 conn(0x18e2830 0x19611b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 --2- 172.21.15.46:0/615091691 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f509403d1c0 0x7f509403f6d0 unknown :-1 s=CLOSED pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 --2- 172.21.15.46:0/615091691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18d9810 0x1960760 unknown :-1 s=CLOSED pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 >> 172.21.15.46:0/615091691 conn(0x1806770 msgr2=0x18dd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 shutdown_connections 2024-09-11T14:38:27.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.409+0000 7f50c0231ec0 1 -- 172.21.15.46:0/615091691 wait complete. 2024-09-11T14:38:27.412 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.412 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj5 /etc/passwd 2024-09-11T14:38:27.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.450+0000 7fa844b37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.456+0000 7fa844b37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.456+0000 7fa844b37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.457+0000 7fa844b37ec0 1 Processor -- start 2024-09-11T14:38:27.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.457+0000 7fa844b37ec0 1 -- start start 2024-09-11T14:38:27.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.458+0000 7fa844b37ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x25ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.458+0000 7fa844b37ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x23f5520 con 0x2491120 2024-09-11T14:38:27.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.459+0000 7fa83d43f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x25ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.459+0000 7fa83d43f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x25ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50118/0 (socket says 172.21.15.46:50118) 2024-09-11T14:38:27.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.459+0000 7fa83d43f640 1 -- 172.21.15.46:0/1428457782 learned_addr learned my addr 172.21.15.46:0/1428457782 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.459+0000 7fa83d43f640 1 -- 172.21.15.46:0/1428457782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2391e10 con 0x2491120 2024-09-11T14:38:27.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.459+0000 7fa83d43f640 1 --2- 172.21.15.46:0/1428457782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x25ab090 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bb067f7263d8be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.459+0000 7fa836ffd640 1 -- 172.21.15.46:0/1428457782 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa83002db60 con 0x2491120 2024-09-11T14:38:27.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.459+0000 7fa836ffd640 1 -- 172.21.15.46:0/1428457782 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa830037370 con 0x2491120 2024-09-11T14:38:27.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.459+0000 7fa836ffd640 1 -- 172.21.15.46:0/1428457782 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa830037610 con 0x2491120 2024-09-11T14:38:27.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.460+0000 7fa844b37ec0 1 -- 172.21.15.46:0/1428457782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 msgr2=0x25ab090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.460+0000 7fa844b37ec0 1 --2- 172.21.15.46:0/1428457782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x25ab090 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.460+0000 7fa844b37ec0 1 -- 172.21.15.46:0/1428457782 shutdown_connections 2024-09-11T14:38:27.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.460+0000 7fa844b37ec0 1 --2- 172.21.15.46:0/1428457782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x25ab090 unknown :-1 s=CLOSED pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.460+0000 7fa844b37ec0 1 -- 172.21.15.46:0/1428457782 >> 172.21.15.46:0/1428457782 conn(0x23b5770 msgr2=0x248b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.460+0000 7fa844b37ec0 1 -- 172.21.15.46:0/1428457782 shutdown_connections 2024-09-11T14:38:27.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.460+0000 7fa844b37ec0 1 -- 172.21.15.46:0/1428457782 wait complete. 2024-09-11T14:38:27.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.461+0000 7fa844b37ec0 1 Processor -- start 2024-09-11T14:38:27.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.461+0000 7fa844b37ec0 1 -- start start 2024-09-11T14:38:27.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.462+0000 7fa844b37ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x250e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.462+0000 7fa844b37ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x23f3280 con 0x2491120 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa83d43f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x250e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa83d43f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x250e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50126/0 (socket says 172.21.15.46:50126) 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa83d43f640 1 -- 172.21.15.46:0/212390204 learned_addr learned my addr 172.21.15.46:0/212390204 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa83d43f640 1 -- 172.21.15.46:0/212390204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2383920 con 0x2491120 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa83d43f640 1 --2- 172.21.15.46:0/212390204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x250e480 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa835ffb640 1 -- 172.21.15.46:0/212390204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa83002db60 con 0x2491120 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa835ffb640 1 -- 172.21.15.46:0/212390204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa8300374e0 con 0x2491120 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2383380 con 0x2491120 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa835ffb640 1 -- 172.21.15.46:0/212390204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa830039450 con 0x2491120 2024-09-11T14:38:27.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.463+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2522940 con 0x2491120 2024-09-11T14:38:27.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.464+0000 7fa835ffb640 1 -- 172.21.15.46:0/212390204 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa8300395b0 con 0x2491120 2024-09-11T14:38:27.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.465+0000 7fa835ffb640 1 --2- 172.21.15.46:0/212390204 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa81803d1c0 0x7fa81803f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.465+0000 7fa835ffb640 1 -- 172.21.15.46:0/212390204 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7fa830032040 con 0x2491120 2024-09-11T14:38:27.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.465+0000 7fa844b37ec0 1 --2- 172.21.15.46:0/212390204 >> v2:172.21.15.47:6805/1666238977 conn(0x2491a70 0x25218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.465+0000 7fa83cc3e640 1 --2- 172.21.15.46:0/212390204 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa81803d1c0 0x7fa81803f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.465+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0x2511f10 con 0x2491a70 2024-09-11T14:38:27.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.466+0000 7fa83cc3e640 1 --2- 172.21.15.46:0/212390204 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa81803d1c0 0x7fa81803f6d0 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.466+0000 7fa83dc40640 1 --2- 172.21.15.46:0/212390204 >> v2:172.21.15.47:6805/1666238977 conn(0x2491a70 0x25218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.470+0000 7fa83dc40640 1 --2- 172.21.15.46:0/212390204 >> v2:172.21.15.47:6805/1666238977 conn(0x2491a70 0x25218a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa83dc40640 1 -- 172.21.15.46:0/212390204 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 obj5 [writefull 0~12777] v721'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa82800a430 con 0x2491a70 2024-09-11T14:38:27.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 >> v2:172.21.15.47:6805/1666238977 conn(0x2491a70 msgr2=0x25218a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 --2- 172.21.15.46:0/212390204 >> v2:172.21.15.47:6805/1666238977 conn(0x2491a70 0x25218a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa81803d1c0 msgr2=0x7fa81803f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 --2- 172.21.15.46:0/212390204 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa81803d1c0 0x7fa81803f6d0 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 msgr2=0x250e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 --2- 172.21.15.46:0/212390204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x250e480 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 shutdown_connections 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 --2- 172.21.15.46:0/212390204 >> v2:172.21.15.47:6805/1666238977 conn(0x2491a70 0x25218a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 --2- 172.21.15.46:0/212390204 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa81803d1c0 0x7fa81803f6d0 unknown :-1 s=CLOSED pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 --2- 172.21.15.46:0/212390204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x2491120 0x250e480 unknown :-1 s=CLOSED pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 >> 172.21.15.46:0/212390204 conn(0x23b5770 msgr2=0x248cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 shutdown_connections 2024-09-11T14:38:27.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.489+0000 7fa844b37ec0 1 -- 172.21.15.46:0/212390204 wait complete. 2024-09-11T14:38:27.493 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.493 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj6 /etc/passwd 2024-09-11T14:38:27.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.531+0000 7fa79183aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.539+0000 7fa79183aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.539+0000 7fa79183aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.540+0000 7fa79183aec0 1 Processor -- start 2024-09-11T14:38:27.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.540+0000 7fa79183aec0 1 -- start start 2024-09-11T14:38:27.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.541+0000 7fa79183aec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xe416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.541+0000 7fa79183aec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xdc0520 con 0xe53810 2024-09-11T14:38:27.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.542+0000 7fa78999b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xe416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.542+0000 7fa78999b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xe416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50148/0 (socket says 172.21.15.46:50148) 2024-09-11T14:38:27.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.542+0000 7fa78999b640 1 -- 172.21.15.46:0/3269662256 learned_addr learned my addr 172.21.15.46:0/3269662256 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.542+0000 7fa78999b640 1 -- 172.21.15.46:0/3269662256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd5ce10 con 0xe53810 2024-09-11T14:38:27.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.542+0000 7fa78999b640 1 --2- 172.21.15.46:0/3269662256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xe416f0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72210393e2a5fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.542+0000 7fa7837fe640 1 -- 172.21.15.46:0/3269662256 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa77400b580 con 0xe53810 2024-09-11T14:38:27.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.542+0000 7fa7837fe640 1 -- 172.21.15.46:0/3269662256 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa77400b6e0 con 0xe53810 2024-09-11T14:38:27.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.543+0000 7fa7837fe640 1 -- 172.21.15.46:0/3269662256 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa77400b980 con 0xe53810 2024-09-11T14:38:27.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.544+0000 7fa79183aec0 1 -- 172.21.15.46:0/3269662256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 msgr2=0xe416f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.544+0000 7fa79183aec0 1 --2- 172.21.15.46:0/3269662256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xe416f0 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.544+0000 7fa79183aec0 1 -- 172.21.15.46:0/3269662256 shutdown_connections 2024-09-11T14:38:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.544+0000 7fa79183aec0 1 --2- 172.21.15.46:0/3269662256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xe416f0 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.544+0000 7fa79183aec0 1 -- 172.21.15.46:0/3269662256 >> 172.21.15.46:0/3269662256 conn(0xd80770 msgr2=0xe576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.544+0000 7fa79183aec0 1 -- 172.21.15.46:0/3269662256 shutdown_connections 2024-09-11T14:38:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.544+0000 7fa79183aec0 1 -- 172.21.15.46:0/3269662256 wait complete. 2024-09-11T14:38:27.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.545+0000 7fa79183aec0 1 Processor -- start 2024-09-11T14:38:27.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.545+0000 7fa79183aec0 1 -- start start 2024-09-11T14:38:27.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.546+0000 7fa79183aec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xedd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.546+0000 7fa79183aec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xdbe280 con 0xe53810 2024-09-11T14:38:27.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa78999b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xedd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa78999b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xedd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50164/0 (socket says 172.21.15.46:50164) 2024-09-11T14:38:27.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa78999b640 1 -- 172.21.15.46:0/2843556244 learned_addr learned my addr 172.21.15.46:0/2843556244 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa78999b640 1 -- 172.21.15.46:0/2843556244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd4e920 con 0xe53810 2024-09-11T14:38:27.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa78999b640 1 --2- 172.21.15.46:0/2843556244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xedd7e0 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa7827fc640 1 -- 172.21.15.46:0/2843556244 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa774012a40 con 0xe53810 2024-09-11T14:38:27.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa7827fc640 1 -- 172.21.15.46:0/2843556244 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa774005040 con 0xe53810 2024-09-11T14:38:27.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd4e380 con 0xe53810 2024-09-11T14:38:27.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa7827fc640 1 -- 172.21.15.46:0/2843556244 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa774012cd0 con 0xe53810 2024-09-11T14:38:27.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.547+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xedf0d0 con 0xe53810 2024-09-11T14:38:27.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.549+0000 7fa7827fc640 1 -- 172.21.15.46:0/2843556244 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fa77400d040 con 0xe53810 2024-09-11T14:38:27.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.549+0000 7fa7827fc640 1 --2- 172.21.15.46:0/2843556244 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa77003d170 0x7fa77003f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.549+0000 7fa7827fc640 1 -- 172.21.15.46:0/2843556244 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7fa77400a040 con 0xe53810 2024-09-11T14:38:27.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.549+0000 7fa79183aec0 1 --2- 172.21.15.46:0/2843556244 >> v2:172.21.15.46:6805/1751227380 conn(0xe5c830 0xf83100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.549+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 --> v2:172.21.15.46:6805/1751227380 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0xee1100 con 0xe5c830 2024-09-11T14:38:27.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.549+0000 7fa78919a640 1 --2- 172.21.15.46:0/2843556244 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa77003d170 0x7fa77003f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.550+0000 7fa78a19c640 1 --2- 172.21.15.46:0/2843556244 >> v2:172.21.15.46:6805/1751227380 conn(0xe5c830 0xf83100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.550+0000 7fa78919a640 1 --2- 172.21.15.46:0/2843556244 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa77003d170 0x7fa77003f680 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.552+0000 7fa78a19c640 1 --2- 172.21.15.46:0/2843556244 >> v2:172.21.15.46:6805/1751227380 conn(0xe5c830 0xf83100 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa78a19c640 1 -- 172.21.15.46:0/2843556244 <== osd.1 v2:172.21.15.46:6805/1751227380 1 ==== osd_op_reply(1 obj6 [writefull 0~12777] v721'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa77c00a430 con 0xe5c830 2024-09-11T14:38:27.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 >> v2:172.21.15.46:6805/1751227380 conn(0xe5c830 msgr2=0xf83100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 --2- 172.21.15.46:0/2843556244 >> v2:172.21.15.46:6805/1751227380 conn(0xe5c830 0xf83100 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa77003d170 msgr2=0x7fa77003f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 --2- 172.21.15.46:0/2843556244 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa77003d170 0x7fa77003f680 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 msgr2=0xedd7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 --2- 172.21.15.46:0/2843556244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xedd7e0 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 shutdown_connections 2024-09-11T14:38:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 --2- 172.21.15.46:0/2843556244 >> v2:172.21.15.46:6805/1751227380 conn(0xe5c830 0xf83100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 --2- 172.21.15.46:0/2843556244 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fa77003d170 0x7fa77003f680 unknown :-1 s=CLOSED pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 --2- 172.21.15.46:0/2843556244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe53810 0xedd7e0 unknown :-1 s=CLOSED pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 >> 172.21.15.46:0/2843556244 conn(0xd80770 msgr2=0xe5f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 shutdown_connections 2024-09-11T14:38:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.574+0000 7fa79183aec0 1 -- 172.21.15.46:0/2843556244 wait complete. 2024-09-11T14:38:27.578 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.578 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj7 /etc/passwd 2024-09-11T14:38:27.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.613+0000 7f0f41084ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.619+0000 7f0f41084ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.619+0000 7f0f41084ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.620+0000 7f0f41084ec0 1 Processor -- start 2024-09-11T14:38:27.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.620+0000 7f0f41084ec0 1 -- start start 2024-09-11T14:38:27.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f41084ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f41084ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1cf2520 con 0x1d8e830 2024-09-11T14:38:27.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f3919b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f3919b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50188/0 (socket says 172.21.15.46:50188) 2024-09-11T14:38:27.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f3919b640 1 -- 172.21.15.46:0/3551556314 learned_addr learned my addr 172.21.15.46:0/3551556314 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f3919b640 1 -- 172.21.15.46:0/3551556314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c8ee10 con 0x1d8e830 2024-09-11T14:38:27.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f3919b640 1 --2- 172.21.15.46:0/3551556314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0ad70 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8079e4a2833d8dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f337fe640 1 -- 172.21.15.46:0/3551556314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f2400b500 con 0x1d8e830 2024-09-11T14:38:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f337fe640 1 -- 172.21.15.46:0/3551556314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f2400b660 con 0x1d8e830 2024-09-11T14:38:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.622+0000 7f0f337fe640 1 -- 172.21.15.46:0/3551556314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f2400b900 con 0x1d8e830 2024-09-11T14:38:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.623+0000 7f0f41084ec0 1 -- 172.21.15.46:0/3551556314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 msgr2=0x1e0ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.623+0000 7f0f41084ec0 1 --2- 172.21.15.46:0/3551556314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0ad70 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.623+0000 7f0f41084ec0 1 -- 172.21.15.46:0/3551556314 shutdown_connections 2024-09-11T14:38:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.623+0000 7f0f41084ec0 1 --2- 172.21.15.46:0/3551556314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0ad70 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.623+0000 7f0f41084ec0 1 -- 172.21.15.46:0/3551556314 >> 172.21.15.46:0/3551556314 conn(0x1cb2770 msgr2=0x1d90510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.623+0000 7f0f41084ec0 1 -- 172.21.15.46:0/3551556314 shutdown_connections 2024-09-11T14:38:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.623+0000 7f0f41084ec0 1 -- 172.21.15.46:0/3551556314 wait complete. 2024-09-11T14:38:27.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.624+0000 7f0f41084ec0 1 Processor -- start 2024-09-11T14:38:27.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.624+0000 7f0f41084ec0 1 -- start start 2024-09-11T14:38:27.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f41084ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f41084ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1cf0280 con 0x1d8e830 2024-09-11T14:38:27.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f3919b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f3919b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50194/0 (socket says 172.21.15.46:50194) 2024-09-11T14:38:27.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f3919b640 1 -- 172.21.15.46:0/763001132 learned_addr learned my addr 172.21.15.46:0/763001132 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f3919b640 1 -- 172.21.15.46:0/763001132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c80920 con 0x1d8e830 2024-09-11T14:38:27.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f3919b640 1 --2- 172.21.15.46:0/763001132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0e550 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f327fc640 1 -- 172.21.15.46:0/763001132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f240110b0 con 0x1d8e830 2024-09-11T14:38:27.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f327fc640 1 -- 172.21.15.46:0/763001132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f24011210 con 0x1d8e830 2024-09-11T14:38:27.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c80380 con 0x1d8e830 2024-09-11T14:38:27.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f327fc640 1 -- 172.21.15.46:0/763001132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f24011b30 con 0x1d8e830 2024-09-11T14:38:27.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.626+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1e114a0 con 0x1d8e830 2024-09-11T14:38:27.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.628+0000 7f0f327fc640 1 -- 172.21.15.46:0/763001132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f0f24011ce0 con 0x1d8e830 2024-09-11T14:38:27.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.628+0000 7f0f327fc640 1 --2- 172.21.15.46:0/763001132 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0f2003d1c0 0x7f0f2003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.628+0000 7f0f327fc640 1 -- 172.21.15.46:0/763001132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7f0f240503a0 con 0x1d8e830 2024-09-11T14:38:27.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.628+0000 7f0f41084ec0 1 --2- 172.21.15.46:0/763001132 >> v2:172.21.15.46:6801/1724049974 conn(0x1d8f920 0x22bb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.628+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0x1e11ce0 con 0x1d8f920 2024-09-11T14:38:27.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.628+0000 7f0f3899a640 1 --2- 172.21.15.46:0/763001132 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0f2003d1c0 0x7f0f2003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.629+0000 7f0f3899a640 1 --2- 172.21.15.46:0/763001132 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0f2003d1c0 0x7f0f2003f6d0 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.629+0000 7f0f3999c640 1 --2- 172.21.15.46:0/763001132 >> v2:172.21.15.46:6801/1724049974 conn(0x1d8f920 0x22bb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.633+0000 7f0f3999c640 1 --2- 172.21.15.46:0/763001132 >> v2:172.21.15.46:6801/1724049974 conn(0x1d8f920 0x22bb410 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f3999c640 1 -- 172.21.15.46:0/763001132 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== osd_op_reply(1 obj7 [writefull 0~12777] v721'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0f2c00a430 con 0x1d8f920 2024-09-11T14:38:27.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 >> v2:172.21.15.46:6801/1724049974 conn(0x1d8f920 msgr2=0x22bb410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 --2- 172.21.15.46:0/763001132 >> v2:172.21.15.46:6801/1724049974 conn(0x1d8f920 0x22bb410 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0f2003d1c0 msgr2=0x7f0f2003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 --2- 172.21.15.46:0/763001132 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0f2003d1c0 0x7f0f2003f6d0 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 msgr2=0x1e0e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 --2- 172.21.15.46:0/763001132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0e550 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 shutdown_connections 2024-09-11T14:38:27.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 --2- 172.21.15.46:0/763001132 >> v2:172.21.15.46:6801/1724049974 conn(0x1d8f920 0x22bb410 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 --2- 172.21.15.46:0/763001132 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f0f2003d1c0 0x7f0f2003f6d0 unknown :-1 s=CLOSED pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 --2- 172.21.15.46:0/763001132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d8e830 0x1e0e550 unknown :-1 s=CLOSED pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 >> 172.21.15.46:0/763001132 conn(0x1cb2770 msgr2=0x1d90510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 shutdown_connections 2024-09-11T14:38:27.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.654+0000 7f0f41084ec0 1 -- 172.21.15.46:0/763001132 wait complete. 2024-09-11T14:38:27.658 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.658 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj8 /etc/passwd 2024-09-11T14:38:27.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.694+0000 7f1a53237ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.700+0000 7f1a53237ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.700+0000 7f1a53237ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.701+0000 7f1a53237ec0 1 Processor -- start 2024-09-11T14:38:27.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.701+0000 7f1a53237ec0 1 -- start start 2024-09-11T14:38:27.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.702+0000 7f1a53237ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x2140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.702+0000 7f1a53237ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x2012520 con 0x20ae120 2024-09-11T14:38:27.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.703+0000 7f1a4b39b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x2140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.703+0000 7f1a4b39b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x2140ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50204/0 (socket says 172.21.15.46:50204) 2024-09-11T14:38:27.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.703+0000 7f1a4b39b640 1 -- 172.21.15.46:0/3377730292 learned_addr learned my addr 172.21.15.46:0/3377730292 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.703+0000 7f1a4b39b640 1 -- 172.21.15.46:0/3377730292 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1faee10 con 0x20ae120 2024-09-11T14:38:27.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.703+0000 7f1a4b39b640 1 --2- 172.21.15.46:0/3377730292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x2140ad0 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaa8ee984723079 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.703+0000 7f1a49b98640 1 -- 172.21.15.46:0/3377730292 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a340061f0 con 0x20ae120 2024-09-11T14:38:27.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.703+0000 7f1a49b98640 1 -- 172.21.15.46:0/3377730292 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a34001980 con 0x20ae120 2024-09-11T14:38:27.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.703+0000 7f1a49b98640 1 -- 172.21.15.46:0/3377730292 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a34001af0 con 0x20ae120 2024-09-11T14:38:27.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.704+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3377730292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 msgr2=0x2140ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.704+0000 7f1a53237ec0 1 --2- 172.21.15.46:0/3377730292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x2140ad0 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.704+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3377730292 shutdown_connections 2024-09-11T14:38:27.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.704+0000 7f1a53237ec0 1 --2- 172.21.15.46:0/3377730292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x2140ad0 unknown :-1 s=CLOSED pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.704+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3377730292 >> 172.21.15.46:0/3377730292 conn(0x1fd2770 msgr2=0x20a8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.704+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3377730292 shutdown_connections 2024-09-11T14:38:27.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.704+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3377730292 wait complete. 2024-09-11T14:38:27.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.705+0000 7f1a53237ec0 1 Processor -- start 2024-09-11T14:38:27.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.705+0000 7f1a53237ec0 1 -- start start 2024-09-11T14:38:27.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.706+0000 7f1a53237ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x212f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.706+0000 7f1a53237ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x2010280 con 0x20ae120 2024-09-11T14:38:27.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.706+0000 7f1a4b39b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x212f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.707+0000 7f1a4b39b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x212f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50216/0 (socket says 172.21.15.46:50216) 2024-09-11T14:38:27.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.707+0000 7f1a4b39b640 1 -- 172.21.15.46:0/3748847998 learned_addr learned my addr 172.21.15.46:0/3748847998 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.707+0000 7f1a4b39b640 1 -- 172.21.15.46:0/3748847998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1fa0920 con 0x20ae120 2024-09-11T14:38:27.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.707+0000 7f1a4b39b640 1 --2- 172.21.15.46:0/3748847998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x212f220 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.707+0000 7f1a48b96640 1 -- 172.21.15.46:0/3748847998 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a34011c10 con 0x20ae120 2024-09-11T14:38:27.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.707+0000 7f1a48b96640 1 -- 172.21.15.46:0/3748847998 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a34011d70 con 0x20ae120 2024-09-11T14:38:27.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.707+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1fa0380 con 0x20ae120 2024-09-11T14:38:27.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.707+0000 7f1a48b96640 1 -- 172.21.15.46:0/3748847998 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a34012460 con 0x20ae120 2024-09-11T14:38:27.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.707+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2132580 con 0x20ae120 2024-09-11T14:38:27.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.708+0000 7f1a48b96640 1 -- 172.21.15.46:0/3748847998 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1a340125c0 con 0x20ae120 2024-09-11T14:38:27.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.708+0000 7f1a48b96640 1 --2- 172.21.15.46:0/3748847998 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a3003d210 0x7f1a3003f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.708+0000 7f1a48b96640 1 -- 172.21.15.46:0/3748847998 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7f1a3404fb50 con 0x20ae120 2024-09-11T14:38:27.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.709+0000 7f1a53237ec0 1 --2- 172.21.15.46:0/3748847998 >> v2:172.21.15.46:6801/1724049974 conn(0x20aec40 0x212fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.709+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0x21d5170 con 0x20aec40 2024-09-11T14:38:27.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.709+0000 7f1a4ab9a640 1 --2- 172.21.15.46:0/3748847998 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a3003d210 0x7f1a3003f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.709+0000 7f1a4bb9c640 1 --2- 172.21.15.46:0/3748847998 >> v2:172.21.15.46:6801/1724049974 conn(0x20aec40 0x212fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.709+0000 7f1a4ab9a640 1 --2- 172.21.15.46:0/3748847998 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a3003d210 0x7f1a3003f720 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.713 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.712+0000 7f1a4bb9c640 1 --2- 172.21.15.46:0/3748847998 >> v2:172.21.15.46:6801/1724049974 conn(0x20aec40 0x212fc70 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a4bb9c640 1 -- 172.21.15.46:0/3748847998 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== osd_op_reply(1 obj8 [writefull 0~12777] v721'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1a3c00c430 con 0x20aec40 2024-09-11T14:38:27.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 >> v2:172.21.15.46:6801/1724049974 conn(0x20aec40 msgr2=0x212fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 --2- 172.21.15.46:0/3748847998 >> v2:172.21.15.46:6801/1724049974 conn(0x20aec40 0x212fc70 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a3003d210 msgr2=0x7f1a3003f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 --2- 172.21.15.46:0/3748847998 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a3003d210 0x7f1a3003f720 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 msgr2=0x212f220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 --2- 172.21.15.46:0/3748847998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x212f220 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 shutdown_connections 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 --2- 172.21.15.46:0/3748847998 >> v2:172.21.15.46:6801/1724049974 conn(0x20aec40 0x212fc70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 --2- 172.21.15.46:0/3748847998 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a3003d210 0x7f1a3003f720 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.731+0000 7f1a53237ec0 1 --2- 172.21.15.46:0/3748847998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x20ae120 0x212f220 unknown :-1 s=CLOSED pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.732+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 >> 172.21.15.46:0/3748847998 conn(0x1fd2770 msgr2=0x20a8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.732+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 shutdown_connections 2024-09-11T14:38:27.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.732+0000 7f1a53237ec0 1 -- 172.21.15.46:0/3748847998 wait complete. 2024-09-11T14:38:27.735 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.735 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj9 /etc/passwd 2024-09-11T14:38:27.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.772+0000 7fb5e14fdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.778+0000 7fb5e14fdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.778+0000 7fb5e14fdec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.779+0000 7fb5e14fdec0 1 Processor -- start 2024-09-11T14:38:27.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.779+0000 7fb5e14fdec0 1 -- start start 2024-09-11T14:38:27.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.780+0000 7fb5e14fdec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.780+0000 7fb5e14fdec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x181c520 con 0x18b8120 2024-09-11T14:38:27.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.780+0000 7fb5d983f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19d30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.781+0000 7fb5d983f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19d30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50240/0 (socket says 172.21.15.46:50240) 2024-09-11T14:38:27.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.781+0000 7fb5d983f640 1 -- 172.21.15.46:0/1981665056 learned_addr learned my addr 172.21.15.46:0/1981665056 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.781+0000 7fb5d983f640 1 -- 172.21.15.46:0/1981665056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17b8e10 con 0x18b8120 2024-09-11T14:38:27.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.781+0000 7fb5d983f640 1 --2- 172.21.15.46:0/1981665056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19d30a0 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e501ef382ffc8b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.781+0000 7fb5d37fe640 1 -- 172.21.15.46:0/1981665056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb5c400c490 con 0x18b8120 2024-09-11T14:38:27.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.781+0000 7fb5d37fe640 1 -- 172.21.15.46:0/1981665056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb5c400c5f0 con 0x18b8120 2024-09-11T14:38:27.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.781+0000 7fb5d37fe640 1 -- 172.21.15.46:0/1981665056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb5c400c890 con 0x18b8120 2024-09-11T14:38:27.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.782+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1981665056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 msgr2=0x19d30a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.782+0000 7fb5e14fdec0 1 --2- 172.21.15.46:0/1981665056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19d30a0 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.782+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1981665056 shutdown_connections 2024-09-11T14:38:27.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.782+0000 7fb5e14fdec0 1 --2- 172.21.15.46:0/1981665056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19d30a0 unknown :-1 s=CLOSED pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.782+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1981665056 >> 172.21.15.46:0/1981665056 conn(0x17dc770 msgr2=0x18b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.782+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1981665056 shutdown_connections 2024-09-11T14:38:27.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.782+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1981665056 wait complete. 2024-09-11T14:38:27.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.783+0000 7fb5e14fdec0 1 Processor -- start 2024-09-11T14:38:27.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.783+0000 7fb5e14fdec0 1 -- start start 2024-09-11T14:38:27.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.784+0000 7fb5e14fdec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19e1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.784+0000 7fb5e14fdec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x181a280 con 0x18b8120 2024-09-11T14:38:27.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.784+0000 7fb5d983f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.784+0000 7fb5d983f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19e1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50250/0 (socket says 172.21.15.46:50250) 2024-09-11T14:38:27.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.784+0000 7fb5d983f640 1 -- 172.21.15.46:0/1214327574 learned_addr learned my addr 172.21.15.46:0/1214327574 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.785+0000 7fb5d983f640 1 -- 172.21.15.46:0/1214327574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17aa920 con 0x18b8120 2024-09-11T14:38:27.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.785+0000 7fb5d983f640 1 --2- 172.21.15.46:0/1214327574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19e1190 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.785+0000 7fb5d27fc640 1 -- 172.21.15.46:0/1214327574 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb5c40110b0 con 0x18b8120 2024-09-11T14:38:27.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.785+0000 7fb5d27fc640 1 -- 172.21.15.46:0/1214327574 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb5c4011210 con 0x18b8120 2024-09-11T14:38:27.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.785+0000 7fb5d27fc640 1 -- 172.21.15.46:0/1214327574 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb5c4011b00 con 0x18b8120 2024-09-11T14:38:27.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.785+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x17aa380 con 0x18b8120 2024-09-11T14:38:27.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.785+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x193caf0 con 0x18b8120 2024-09-11T14:38:27.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.786+0000 7fb5d27fc640 1 -- 172.21.15.46:0/1214327574 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fb5c4011cb0 con 0x18b8120 2024-09-11T14:38:27.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.786+0000 7fb5d27fc640 1 --2- 172.21.15.46:0/1214327574 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb5c003d1c0 0x7fb5c003f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.786+0000 7fb5d27fc640 1 -- 172.21.15.46:0/1214327574 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7fb5c40503e0 con 0x18b8120 2024-09-11T14:38:27.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.787+0000 7fb5e14fdec0 1 --2- 172.21.15.46:0/1214327574 >> v2:172.21.15.47:6805/1666238977 conn(0x18b8c40 0x193b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.787+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 --> v2:172.21.15.47:6805/1666238977 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0x194a140 con 0x18b8c40 2024-09-11T14:38:27.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.787+0000 7fb5d903e640 1 --2- 172.21.15.46:0/1214327574 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb5c003d1c0 0x7fb5c003f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.787+0000 7fb5d903e640 1 --2- 172.21.15.46:0/1214327574 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb5c003d1c0 0x7fb5c003f6d0 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.788+0000 7fb5da040640 1 --2- 172.21.15.46:0/1214327574 >> v2:172.21.15.47:6805/1666238977 conn(0x18b8c40 0x193b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.792+0000 7fb5da040640 1 --2- 172.21.15.46:0/1214327574 >> v2:172.21.15.47:6805/1666238977 conn(0x18b8c40 0x193b9d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5da040640 1 -- 172.21.15.46:0/1214327574 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== osd_op_reply(1 obj9 [writefull 0~12777] v721'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb5cc00a430 con 0x18b8c40 2024-09-11T14:38:27.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 >> v2:172.21.15.47:6805/1666238977 conn(0x18b8c40 msgr2=0x193b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 --2- 172.21.15.46:0/1214327574 >> v2:172.21.15.47:6805/1666238977 conn(0x18b8c40 0x193b9d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb5c003d1c0 msgr2=0x7fb5c003f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 --2- 172.21.15.46:0/1214327574 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb5c003d1c0 0x7fb5c003f6d0 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 msgr2=0x19e1190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 --2- 172.21.15.46:0/1214327574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19e1190 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 shutdown_connections 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 --2- 172.21.15.46:0/1214327574 >> v2:172.21.15.47:6805/1666238977 conn(0x18b8c40 0x193b9d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 --2- 172.21.15.46:0/1214327574 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fb5c003d1c0 0x7fb5c003f6d0 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 --2- 172.21.15.46:0/1214327574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x18b8120 0x19e1190 unknown :-1 s=CLOSED pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 >> 172.21.15.46:0/1214327574 conn(0x17dc770 msgr2=0x18b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 shutdown_connections 2024-09-11T14:38:27.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.831+0000 7fb5e14fdec0 1 -- 172.21.15.46:0/1214327574 wait complete. 2024-09-11T14:38:27.834 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-09-11T14:38:27.834 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 48ced627-17b4-4855-926a-7d45bdad78a6 put obj10 /etc/passwd 2024-09-11T14:38:27.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.871+0000 7f369962dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.876+0000 7f369962dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.876+0000 7f369962dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.877+0000 7f369962dec0 1 Processor -- start 2024-09-11T14:38:27.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.877+0000 7f369962dec0 1 -- start start 2024-09-11T14:38:27.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.879+0000 7f369962dec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa19b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.879+0000 7f369962dec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x8ec520 con 0x988660 2024-09-11T14:38:27.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.879+0000 7f369179b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa19b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.879+0000 7f369179b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa19b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50278/0 (socket says 172.21.15.46:50278) 2024-09-11T14:38:27.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.879+0000 7f369179b640 1 -- 172.21.15.46:0/2516173132 learned_addr learned my addr 172.21.15.46:0/2516173132 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.879+0000 7f369179b640 1 -- 172.21.15.46:0/2516173132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x888e10 con 0x988660 2024-09-11T14:38:27.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.879+0000 7f369179b640 1 --2- 172.21.15.46:0/2516173132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa19b90 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bb8ecd844c1d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f368b7fe640 1 -- 172.21.15.46:0/2516173132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f368402dc20 con 0x988660 2024-09-11T14:38:27.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f368b7fe640 1 -- 172.21.15.46:0/2516173132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3684037370 con 0x988660 2024-09-11T14:38:27.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f368b7fe640 1 -- 172.21.15.46:0/2516173132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3684037610 con 0x988660 2024-09-11T14:38:27.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f369962dec0 1 -- 172.21.15.46:0/2516173132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 msgr2=0xa19b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f369962dec0 1 --2- 172.21.15.46:0/2516173132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa19b90 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f369962dec0 1 -- 172.21.15.46:0/2516173132 shutdown_connections 2024-09-11T14:38:27.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f369962dec0 1 --2- 172.21.15.46:0/2516173132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa19b90 unknown :-1 s=CLOSED pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f369962dec0 1 -- 172.21.15.46:0/2516173132 >> 172.21.15.46:0/2516173132 conn(0x8ac770 msgr2=0x98a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f369962dec0 1 -- 172.21.15.46:0/2516173132 shutdown_connections 2024-09-11T14:38:27.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.880+0000 7f369962dec0 1 -- 172.21.15.46:0/2516173132 wait complete. 2024-09-11T14:38:27.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.881+0000 7f369962dec0 1 Processor -- start 2024-09-11T14:38:27.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.881+0000 7f369962dec0 1 -- start start 2024-09-11T14:38:27.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.883+0000 7f369962dec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa08190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.883+0000 7f369962dec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x8ea280 con 0x988660 2024-09-11T14:38:27.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.883+0000 7f369179b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa08190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.883+0000 7f369179b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa08190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50284/0 (socket says 172.21.15.46:50284) 2024-09-11T14:38:27.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.883+0000 7f369179b640 1 -- 172.21.15.46:0/3847619245 learned_addr learned my addr 172.21.15.46:0/3847619245 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:27.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.883+0000 7f369179b640 1 -- 172.21.15.46:0/3847619245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x87a920 con 0x988660 2024-09-11T14:38:27.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.883+0000 7f369179b640 1 --2- 172.21.15.46:0/3847619245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa08190 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.884+0000 7f368a7fc640 1 -- 172.21.15.46:0/3847619245 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f368403f040 con 0x988660 2024-09-11T14:38:27.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.884+0000 7f368a7fc640 1 -- 172.21.15.46:0/3847619245 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f368402daf0 con 0x988660 2024-09-11T14:38:27.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.884+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x87a380 con 0x988660 2024-09-11T14:38:27.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.884+0000 7f368a7fc640 1 -- 172.21.15.46:0/3847619245 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3684039450 con 0x988660 2024-09-11T14:38:27.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.884+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xa0b4d0 con 0x988660 2024-09-11T14:38:27.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.885+0000 7f368a7fc640 1 -- 172.21.15.46:0/3847619245 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3684039600 con 0x988660 2024-09-11T14:38:27.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.885+0000 7f368a7fc640 1 --2- 172.21.15.46:0/3847619245 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f367803d210 0x7f367803f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.885+0000 7f368a7fc640 1 -- 172.21.15.46:0/3847619245 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(721..721 src has 593..721) ==== 4207+0+0 (crc 0 0 0) 0x7f3684032040 con 0x988660 2024-09-11T14:38:27.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.885+0000 7f369962dec0 1 --2- 172.21.15.46:0/3847619245 >> v2:172.21.15.46:6801/1724049974 conn(0x989920 0xeb5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:27.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.885+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 --> v2:172.21.15.46:6801/1724049974 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e721) -- 0xa0bbb0 con 0x989920 2024-09-11T14:38:27.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.885+0000 7f3690f9a640 1 --2- 172.21.15.46:0/3847619245 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f367803d210 0x7f367803f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:27.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.886+0000 7f3690f9a640 1 --2- 172.21.15.46:0/3847619245 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f367803d210 0x7f367803f720 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.886+0000 7f3691f9c640 1 --2- 172.21.15.46:0/3847619245 >> v2:172.21.15.46:6801/1724049974 conn(0x989920 0xeb5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:27.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.890+0000 7f3691f9c640 1 --2- 172.21.15.46:0/3847619245 >> v2:172.21.15.46:6801/1724049974 conn(0x989920 0xeb5410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:27.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.911+0000 7f3691f9c640 1 -- 172.21.15.46:0/3847619245 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== osd_op_reply(1 obj10 [writefull 0~12777] v721'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f367c00a430 con 0x989920 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.911+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 >> v2:172.21.15.46:6801/1724049974 conn(0x989920 msgr2=0xeb5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.911+0000 7f369962dec0 1 --2- 172.21.15.46:0/3847619245 >> v2:172.21.15.46:6801/1724049974 conn(0x989920 0xeb5410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f367803d210 msgr2=0x7f367803f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 --2- 172.21.15.46:0/3847619245 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f367803d210 0x7f367803f720 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 msgr2=0xa08190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 --2- 172.21.15.46:0/3847619245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa08190 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 shutdown_connections 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 --2- 172.21.15.46:0/3847619245 >> v2:172.21.15.46:6801/1724049974 conn(0x989920 0xeb5410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 --2- 172.21.15.46:0/3847619245 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f367803d210 0x7f367803f720 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 --2- 172.21.15.46:0/3847619245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x988660 0xa08190 unknown :-1 s=CLOSED pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 >> 172.21.15.46:0/3847619245 conn(0x8ac770 msgr2=0x987ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 shutdown_connections 2024-09-11T14:38:27.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:27.912+0000 7f369962dec0 1 -- 172.21.15.46:0/3847619245 wait complete. 2024-09-11T14:38:27.915 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-09-11T14:38:57.917 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p bcc42802-4a92-4251-a537-9d1c078ffecf put threemore /etc/passwd 2024-09-11T14:38:57.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.960+0000 7f1a94235ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:57.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.967+0000 7f1a94235ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:57.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.967+0000 7f1a94235ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:57.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.968+0000 7f1a94235ec0 1 Processor -- start 2024-09-11T14:38:57.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.968+0000 7f1a94235ec0 1 -- start start 2024-09-11T14:38:57.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.969+0000 7f1a94235ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x2364d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:57.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.969+0000 7f1a94235ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x224c520 con 0x22df810 2024-09-11T14:38:57.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.969+0000 7f1a87fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x2364d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:57.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.969+0000 7f1a87fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x2364d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46692/0 (socket says 172.21.15.46:46692) 2024-09-11T14:38:57.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.969+0000 7f1a87fff640 1 -- 172.21.15.46:0/218547409 learned_addr learned my addr 172.21.15.46:0/218547409 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:57.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.970+0000 7f1a87fff640 1 -- 172.21.15.46:0/218547409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x21e8e10 con 0x22df810 2024-09-11T14:38:57.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.970+0000 7f1a87fff640 1 --2- 172.21.15.46:0/218547409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x2364d70 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1621bd43a99ada03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:57.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.970+0000 7f1a867fc640 1 -- 172.21.15.46:0/218547409 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a7802dab0 con 0x22df810 2024-09-11T14:38:57.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.970+0000 7f1a867fc640 1 -- 172.21.15.46:0/218547409 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a78037370 con 0x22df810 2024-09-11T14:38:57.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.970+0000 7f1a867fc640 1 -- 172.21.15.46:0/218547409 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a78037610 con 0x22df810 2024-09-11T14:38:57.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.971+0000 7f1a94235ec0 1 -- 172.21.15.46:0/218547409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 msgr2=0x2364d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:57.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.971+0000 7f1a94235ec0 1 --2- 172.21.15.46:0/218547409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x2364d70 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:57.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.971+0000 7f1a94235ec0 1 -- 172.21.15.46:0/218547409 shutdown_connections 2024-09-11T14:38:57.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.971+0000 7f1a94235ec0 1 --2- 172.21.15.46:0/218547409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x2364d70 unknown :-1 s=CLOSED pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:57.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.971+0000 7f1a94235ec0 1 -- 172.21.15.46:0/218547409 >> 172.21.15.46:0/218547409 conn(0x220c770 msgr2=0x22e0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:57.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.971+0000 7f1a94235ec0 1 -- 172.21.15.46:0/218547409 shutdown_connections 2024-09-11T14:38:57.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.971+0000 7f1a94235ec0 1 -- 172.21.15.46:0/218547409 wait complete. 2024-09-11T14:38:57.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.972+0000 7f1a94235ec0 1 Processor -- start 2024-09-11T14:38:57.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.972+0000 7f1a94235ec0 1 -- start start 2024-09-11T14:38:57.975 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.973+0000 7f1a94235ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x240f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:57.975 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.973+0000 7f1a94235ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x224a280 con 0x22df810 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a87fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x240f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a87fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x240f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46704/0 (socket says 172.21.15.46:46704) 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a87fff640 1 -- 172.21.15.46:0/1222917890 learned_addr learned my addr 172.21.15.46:0/1222917890 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a87fff640 1 -- 172.21.15.46:0/1222917890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x21da920 con 0x22df810 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a87fff640 1 --2- 172.21.15.46:0/1222917890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x240f100 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a857fa640 1 -- 172.21.15.46:0/1222917890 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a7803e040 con 0x22df810 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a857fa640 1 -- 172.21.15.46:0/1222917890 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a7802d980 con 0x22df810 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x21da380 con 0x22df810 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a857fa640 1 -- 172.21.15.46:0/1222917890 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a78037610 con 0x22df810 2024-09-11T14:38:57.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.974+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x22cdfb0 con 0x22df810 2024-09-11T14:38:57.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.975+0000 7f1a857fa640 1 -- 172.21.15.46:0/1222917890 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f1a78041040 con 0x22df810 2024-09-11T14:38:57.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.976+0000 7f1a857fa640 1 --2- 172.21.15.46:0/1222917890 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a7403d1c0 0x7f1a7403f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:57.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.976+0000 7f1a857fa640 1 -- 172.21.15.46:0/1222917890 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(723..723 src has 593..723) ==== 4207+0+0 (crc 0 0 0) 0x7f1a78032040 con 0x22df810 2024-09-11T14:38:57.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.976+0000 7f1a857fa640 1 -- 172.21.15.46:0/1222917890 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=724}) -- 0x7f1a74043c50 con 0x22df810 2024-09-11T14:38:57.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.976+0000 7f1a94235ec0 1 --2- 172.21.15.46:0/1222917890 >> v2:172.21.15.47:6803/3757354244 conn(0x22e8660 0x236a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:57.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.976+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 --> v2:172.21.15.47:6803/3757354244 -- osd_op(unknown.0.0:1 199.2 199:47cad802:::threemore:head [writefull 0~12777 in=12777b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e723) -- 0x236cd40 con 0x22e8660 2024-09-11T14:38:57.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.976+0000 7f1a877fe640 1 --2- 172.21.15.46:0/1222917890 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a7403d1c0 0x7f1a7403f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:57.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.977+0000 7f1a877fe640 1 --2- 172.21.15.46:0/1222917890 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a7403d1c0 0x7f1a7403f6d0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:57.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.977+0000 7f1a8cb9c640 1 --2- 172.21.15.46:0/1222917890 >> v2:172.21.15.47:6803/3757354244 conn(0x22e8660 0x236a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:38:57.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:57.982+0000 7f1a8cb9c640 1 --2- 172.21.15.46:0/1222917890 >> v2:172.21.15.47:6803/3757354244 conn(0x22e8660 0x236a4d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:58.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.004+0000 7f1a8cb9c640 1 -- 172.21.15.46:0/1222917890 <== osd.2 v2:172.21.15.47:6803/3757354244 1 ==== osd_op_reply(1 threemore [writefull 0~12777] v723'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f1a8000a430 con 0x22e8660 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 >> v2:172.21.15.47:6803/3757354244 conn(0x22e8660 msgr2=0x236a4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 --2- 172.21.15.46:0/1222917890 >> v2:172.21.15.47:6803/3757354244 conn(0x22e8660 0x236a4d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a7403d1c0 msgr2=0x7f1a7403f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 --2- 172.21.15.46:0/1222917890 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a7403d1c0 0x7f1a7403f6d0 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 msgr2=0x240f100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 --2- 172.21.15.46:0/1222917890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x240f100 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 shutdown_connections 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 --2- 172.21.15.46:0/1222917890 >> v2:172.21.15.47:6803/3757354244 conn(0x22e8660 0x236a4d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 --2- 172.21.15.46:0/1222917890 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f1a7403d1c0 0x7f1a7403f6d0 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 --2- 172.21.15.46:0/1222917890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22df810 0x240f100 unknown :-1 s=CLOSED pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 >> 172.21.15.46:0/1222917890 conn(0x220c770 msgr2=0x22e0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:58.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 shutdown_connections 2024-09-11T14:38:58.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.005+0000 7f1a94235ec0 1 -- 172.21.15.46:0/1222917890 wait complete. 2024-09-11T14:38:58.009 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota bcc42802-4a92-4251-a537-9d1c078ffecf max_bytes 0 2024-09-11T14:38:58.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.099+0000 7f57bdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:58.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.109+0000 7f57bdd91640 1 Processor -- start 2024-09-11T14:38:58.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.109+0000 7f57bdd91640 1 -- start start 2024-09-11T14:38:58.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.111+0000 7f57bdd91640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57b8070300 0x7f57b809e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.111+0000 7f57bdd91640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b806eec0 con 0x7f57b809e7e0 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.111+0000 7f57bdd91640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f57b806fef0 con 0x7f57b8070300 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.111+0000 7f57b77fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57b8070300 0x7f57b809e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.111+0000 7f57b6ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f57b809e7e0 0x7f57b8131e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38780/0 (socket says 172.21.15.46:38780) 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.111+0000 7f57b6ffd640 1 -- 172.21.15.46:0/3760234415 learned_addr learned my addr 172.21.15.46:0/3760234415 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.111+0000 7f57b77fe640 1 -- 172.21.15.46:0/3760234415 >> v1:172.21.15.46:6789/0 conn(0x7f57b809e7e0 legacy=0x7f57b8131e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.112+0000 7f57b67fc640 1 -- 172.21.15.46:0/3760234415 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213892178 0 0) 0x7f57b806eec0 con 0x7f57b809e7e0 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.112+0000 7f57b77fe640 1 -- 172.21.15.46:0/3760234415 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b809fde0 con 0x7f57b8070300 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.112+0000 7f57b77fe640 1 --2- 172.21.15.46:0/3760234415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 0x7f57b809e2a0 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78c114b3b596bca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.112+0000 7f57b67fc640 1 -- 172.21.15.46:0/3760234415 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57a8009d80 con 0x7f57b8070300 2024-09-11T14:38:58.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.112+0000 7f57b67fc640 1 -- 172.21.15.46:0/3760234415 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57a800e230 con 0x7f57b8070300 2024-09-11T14:38:58.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.112+0000 7f57b67fc640 1 -- 172.21.15.46:0/3760234415 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57a800e4d0 con 0x7f57b8070300 2024-09-11T14:38:58.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.113+0000 7f57bdd91640 1 -- 172.21.15.46:0/3760234415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 msgr2=0x7f57b809e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:58.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.113+0000 7f57bdd91640 1 --2- 172.21.15.46:0/3760234415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 0x7f57b809e2a0 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:58.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.113+0000 7f57bdd91640 1 -- 172.21.15.46:0/3760234415 shutdown_connections 2024-09-11T14:38:58.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.113+0000 7f57bdd91640 1 --2- 172.21.15.46:0/3760234415 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 0x7f57b809e2a0 unknown :-1 s=CLOSED pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:58.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.113+0000 7f57bdd91640 1 -- 172.21.15.46:0/3760234415 >> 172.21.15.46:0/3760234415 conn(0x7f57b80a1530 msgr2=0x7f57b80a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:58.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.113+0000 7f57bdd91640 1 -- 172.21.15.46:0/3760234415 shutdown_connections 2024-09-11T14:38:58.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.113+0000 7f57bdd91640 1 -- 172.21.15.46:0/3760234415 wait complete. 2024-09-11T14:38:58.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.113+0000 7f57bdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:58.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.115+0000 7f57bdd91640 1 Processor -- start 2024-09-11T14:38:58.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.115+0000 7f57bdd91640 1 -- start start 2024-09-11T14:38:58.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.116+0000 7f57bdd91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 0x7f57b81213e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:58.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.116+0000 7f57bdd91640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f57b8124800 con 0x7f57b8070300 2024-09-11T14:38:58.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.117+0000 7f57b77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 0x7f57b81213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:58.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.117+0000 7f57b77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 0x7f57b81213e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46720/0 (socket says 172.21.15.46:46720) 2024-09-11T14:38:58.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.117+0000 7f57b77fe640 1 -- 172.21.15.46:0/1256797900 learned_addr learned my addr 172.21.15.46:0/1256797900 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:58.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.117+0000 7f57b77fe640 1 -- 172.21.15.46:0/1256797900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b8122e60 con 0x7f57b8070300 2024-09-11T14:38:58.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.117+0000 7f57b77fe640 1 --2- 172.21.15.46:0/1256797900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 0x7f57b81213e0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:58.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.117+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57a8013610 con 0x7f57b8070300 2024-09-11T14:38:58.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.117+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57a8013770 con 0x7f57b8070300 2024-09-11T14:38:58.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.117+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b8123710 con 0x7f57b8070300 2024-09-11T14:38:58.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.117+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57a8013a10 con 0x7f57b8070300 2024-09-11T14:38:58.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.118+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b8124f70 con 0x7f57b8070300 2024-09-11T14:38:58.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.119+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f57a8013bc0 con 0x7f57b8070300 2024-09-11T14:38:58.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.119+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b81254c0 con 0x7f57b8070300 2024-09-11T14:38:58.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.119+0000 7f579ffff640 1 --2- 172.21.15.46:0/1256797900 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57a403e930 0x7f57a4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:58.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.120+0000 7f57b6ffd640 1 --2- 172.21.15.46:0/1256797900 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57a403e930 0x7f57a4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:58.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.120+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(723..723 src has 593..723) ==== 4207+0+0 (crc 0 0 0) 0x7f57a8018040 con 0x7f57b8070300 2024-09-11T14:38:58.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.120+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=724}) -- 0x7f57a4045360 con 0x7f57b8070300 2024-09-11T14:38:58.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.120+0000 7f57b6ffd640 1 --2- 172.21.15.46:0/1256797900 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57a403e930 0x7f57a4040e40 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:58.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.125+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f57b81254c0 con 0x7f57b8070300 2024-09-11T14:38:58.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.322+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "0"} v 0) -- 0x7f57b81254c0 con 0x7f57b8070300 2024-09-11T14:38:58.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.676+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v724) ==== 217+0+0 (crc 0 0 0) 0x7f57b81254c0 con 0x7f57b8070300 2024-09-11T14:38:58.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.676+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(724..724 src has 593..724) ==== 628+0+0 (crc 0 0 0) 0x7f57a8017190 con 0x7f57b8070300 2024-09-11T14:38:58.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.676+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=725}) -- 0x7f57a4046120 con 0x7f57b8070300 2024-09-11T14:38:58.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:58.805+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "0"} v 0) -- 0x7f57b81254c0 con 0x7f57b8070300 2024-09-11T14:38:59.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.677+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v725) ==== 217+0+0 (crc 0 0 0) 0x7f57b81254c0 con 0x7f57b8070300 2024-09-11T14:38:59.679 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_bytes = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf 2024-09-11T14:38:59.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.677+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(725..725 src has 593..725) ==== 628+0+0 (crc 0 0 0) 0x7f57a8012e30 con 0x7f57b8070300 2024-09-11T14:38:59.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.677+0000 7f579ffff640 1 -- 172.21.15.46:0/1256797900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=726}) -- 0x7f57a4046520 con 0x7f57b8070300 2024-09-11T14:38:59.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.680+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57a403e930 msgr2=0x7f57a4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:59.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.680+0000 7f57bdd91640 1 --2- 172.21.15.46:0/1256797900 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57a403e930 0x7f57a4040e40 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:59.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.680+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 msgr2=0x7f57b81213e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:59.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.680+0000 7f57bdd91640 1 --2- 172.21.15.46:0/1256797900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 0x7f57b81213e0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:59.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.681+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 shutdown_connections 2024-09-11T14:38:59.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.681+0000 7f57bdd91640 1 --2- 172.21.15.46:0/1256797900 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57a403e930 0x7f57a4040e40 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:59.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.681+0000 7f57bdd91640 1 --2- 172.21.15.46:0/1256797900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57b8070300 0x7f57b81213e0 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:59.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.681+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 >> 172.21.15.46:0/1256797900 conn(0x7f57b80a1530 msgr2=0x7f57b809cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:59.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.681+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 shutdown_connections 2024-09-11T14:38:59.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.681+0000 7f57bdd91640 1 -- 172.21.15.46:0/1256797900 wait complete. 2024-09-11T14:38:59.700 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota bcc42802-4a92-4251-a537-9d1c078ffecf max_objects 0 2024-09-11T14:38:59.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.813+0000 7fd43547d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:59.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.824+0000 7fd43547d640 1 Processor -- start 2024-09-11T14:38:59.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.824+0000 7fd43547d640 1 -- start start 2024-09-11T14:38:59.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.825+0000 7fd43547d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd4300a2df0 0x7fd4300a3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:59.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.825+0000 7fd43547d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4300a2460 con 0x7fd430135510 2024-09-11T14:38:59.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.825+0000 7fd43547d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fd4300a3d40 con 0x7fd4300a2df0 2024-09-11T14:38:59.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.826+0000 7fd42effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd4300a2df0 0x7fd4300a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:59.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.826+0000 7fd4267fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd430135510 0x7fd430135920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38782/0 (socket says 172.21.15.46:38782) 2024-09-11T14:38:59.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.826+0000 7fd4267fc640 1 -- 172.21.15.46:0/2464938122 learned_addr learned my addr 172.21.15.46:0/2464938122 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:38:59.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.826+0000 7fd42effd640 1 -- 172.21.15.46:0/2464938122 >> v1:172.21.15.46:6789/0 conn(0x7fd430135510 legacy=0x7fd430135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:59.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.826+0000 7fd42effd640 1 -- 172.21.15.46:0/2464938122 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4300a29a0 con 0x7fd4300a2df0 2024-09-11T14:38:59.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.826+0000 7fd42effd640 1 --2- 172.21.15.46:0/2464938122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 0x7fd4300a3200 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569d6f429972902a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:59.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.826+0000 7fd42e7fc640 1 -- 172.21.15.46:0/2464938122 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd420009d90 con 0x7fd4300a2df0 2024-09-11T14:38:59.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.826+0000 7fd42e7fc640 1 -- 172.21.15.46:0/2464938122 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd42000e230 con 0x7fd4300a2df0 2024-09-11T14:38:59.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.826+0000 7fd42e7fc640 1 -- 172.21.15.46:0/2464938122 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd42000e4d0 con 0x7fd4300a2df0 2024-09-11T14:38:59.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.827+0000 7fd43547d640 1 -- 172.21.15.46:0/2464938122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 msgr2=0x7fd4300a3200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:38:59.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.827+0000 7fd43547d640 1 --2- 172.21.15.46:0/2464938122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 0x7fd4300a3200 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:59.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.827+0000 7fd43547d640 1 -- 172.21.15.46:0/2464938122 shutdown_connections 2024-09-11T14:38:59.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.827+0000 7fd43547d640 1 --2- 172.21.15.46:0/2464938122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 0x7fd4300a3200 unknown :-1 s=CLOSED pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:38:59.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.827+0000 7fd43547d640 1 -- 172.21.15.46:0/2464938122 >> 172.21.15.46:0/2464938122 conn(0x7fd4300a4ad0 msgr2=0x7fd4300a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:38:59.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.827+0000 7fd43547d640 1 -- 172.21.15.46:0/2464938122 shutdown_connections 2024-09-11T14:38:59.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.827+0000 7fd43547d640 1 -- 172.21.15.46:0/2464938122 wait complete. 2024-09-11T14:38:59.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.827+0000 7fd43547d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:38:59.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.829+0000 7fd43547d640 1 Processor -- start 2024-09-11T14:38:59.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.829+0000 7fd43547d640 1 -- start start 2024-09-11T14:38:59.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.831+0000 7fd43547d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 0x7fd4301206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:59.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.831+0000 7fd43547d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd430123110 con 0x7fd4300a2df0 2024-09-11T14:38:59.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.831+0000 7fd42effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 0x7fd4301206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:59.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.831+0000 7fd42effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 0x7fd4301206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46732/0 (socket says 172.21.15.46:46732) 2024-09-11T14:38:59.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.831+0000 7fd42effd640 1 -- 172.21.15.46:0/2810147498 learned_addr learned my addr 172.21.15.46:0/2810147498 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:38:59.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.831+0000 7fd42effd640 1 -- 172.21.15.46:0/2810147498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4301202e0 con 0x7fd4300a2df0 2024-09-11T14:38:59.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.831+0000 7fd42effd640 1 --2- 172.21.15.46:0/2810147498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 0x7fd4301206a0 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:59.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.831+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd420014620 con 0x7fd4300a2df0 2024-09-11T14:38:59.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.832+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd420014780 con 0x7fd4300a2df0 2024-09-11T14:38:59.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.832+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd430123b00 con 0x7fd4300a2df0 2024-09-11T14:38:59.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.832+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd420014a20 con 0x7fd4300a2df0 2024-09-11T14:38:59.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.832+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43011fc30 con 0x7fd4300a2df0 2024-09-11T14:38:59.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.833+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43009bc40 con 0x7fd4300a2df0 2024-09-11T14:38:59.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.833+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fd420014bd0 con 0x7fd4300a2df0 2024-09-11T14:38:59.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.833+0000 7fd427fff640 1 --2- 172.21.15.46:0/2810147498 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd41003e930 0x7fd410040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:38:59.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.833+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(725..725 src has 593..725) ==== 4207+0+0 (crc 0 0 0) 0x7fd420019040 con 0x7fd4300a2df0 2024-09-11T14:38:59.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.833+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=726}) -- 0x7fd4100453c0 con 0x7fd4300a2df0 2024-09-11T14:38:59.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.833+0000 7fd4267fc640 1 --2- 172.21.15.46:0/2810147498 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd41003e930 0x7fd410040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:38:59.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.834+0000 7fd4267fc640 1 --2- 172.21.15.46:0/2810147498 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd41003e930 0x7fd410040e40 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:38:59.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:38:59.838+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fd420012580 con 0x7fd4300a2df0 2024-09-11T14:39:00.025 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:00.023+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "0"} v 0) -- 0x7fd4300008d0 con 0x7fd4300a2df0 2024-09-11T14:39:00.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:00.685+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v726) ==== 221+0+0 (crc 0 0 0) 0x7fd420018190 con 0x7fd4300a2df0 2024-09-11T14:39:00.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:00.685+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(726..726 src has 593..726) ==== 628+0+0 (crc 0 0 0) 0x7fd420018710 con 0x7fd4300a2df0 2024-09-11T14:39:00.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:00.685+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=727}) -- 0x7fd4100463b0 con 0x7fd4300a2df0 2024-09-11T14:39:00.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:00.822+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "0"} v 0) -- 0x7fd430121ec0 con 0x7fd4300a2df0 2024-09-11T14:39:01.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.686+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf v727) ==== 221+0+0 (crc 0 0 0) 0x7fd420018370 con 0x7fd4300a2df0 2024-09-11T14:39:01.688 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 0 for pool bcc42802-4a92-4251-a537-9d1c078ffecf 2024-09-11T14:39:01.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.687+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(727..727 src has 593..727) ==== 628+0+0 (crc 0 0 0) 0x7fd420013e40 con 0x7fd4300a2df0 2024-09-11T14:39:01.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.687+0000 7fd427fff640 1 -- 172.21.15.46:0/2810147498 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=728}) -- 0x7fd4100464d0 con 0x7fd4300a2df0 2024-09-11T14:39:01.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.689+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd41003e930 msgr2=0x7fd410040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:01.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.689+0000 7fd43547d640 1 --2- 172.21.15.46:0/2810147498 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd41003e930 0x7fd410040e40 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:01.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.689+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 msgr2=0x7fd4301206a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:01.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.689+0000 7fd43547d640 1 --2- 172.21.15.46:0/2810147498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 0x7fd4301206a0 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:01.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.690+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 shutdown_connections 2024-09-11T14:39:01.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.690+0000 7fd43547d640 1 --2- 172.21.15.46:0/2810147498 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fd41003e930 0x7fd410040e40 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:01.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.690+0000 7fd43547d640 1 --2- 172.21.15.46:0/2810147498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd4300a2df0 0x7fd4301206a0 unknown :-1 s=CLOSED pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:01.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.690+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 >> 172.21.15.46:0/2810147498 conn(0x7fd4300a4ad0 msgr2=0x7fd4300a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:01.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.690+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 shutdown_connections 2024-09-11T14:39:01.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:01.690+0000 7fd43547d640 1 -- 172.21.15.46:0/2810147498 wait complete. 2024-09-11T14:39:01.706 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-09-11T14:39:31.708 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool delete bcc42802-4a92-4251-a537-9d1c078ffecf bcc42802-4a92-4251-a537-9d1c078ffecf --yes-i-really-really-mean-it 2024-09-11T14:39:31.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.804+0000 7f6afd191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:31.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.814+0000 7f6afd191640 1 Processor -- start 2024-09-11T14:39:31.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.814+0000 7f6afd191640 1 -- start start 2024-09-11T14:39:31.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.815+0000 7f6afd191640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6af80a2df0 0x7f6af80a3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.815+0000 7f6afd191640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af80a2460 con 0x7f6af8135510 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.815+0000 7f6afd191640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f6af80a3d40 con 0x7f6af80a2df0 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af6d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6af80a2df0 0x7f6af80a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6af8135510 0x7f6af8135920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41004/0 (socket says 172.21.15.46:41004) 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af659c640 1 -- 172.21.15.46:0/988951722 learned_addr learned my addr 172.21.15.46:0/988951722 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af6d9d640 1 -- 172.21.15.46:0/988951722 >> v1:172.21.15.46:6789/0 conn(0x7f6af8135510 legacy=0x7f6af8135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af5d9b640 1 -- 172.21.15.46:0/988951722 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007819219 0 0) 0x7f6af80a2460 con 0x7f6af8135510 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af6d9d640 1 -- 172.21.15.46:0/988951722 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af80a29a0 con 0x7f6af80a2df0 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af6d9d640 1 --2- 172.21.15.46:0/988951722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 0x7f6af80a3200 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb6639d5fb4c2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af5d9b640 1 -- 172.21.15.46:0/988951722 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ae8009d90 con 0x7f6af80a2df0 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af5d9b640 1 -- 172.21.15.46:0/988951722 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ae800e230 con 0x7f6af80a2df0 2024-09-11T14:39:31.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.816+0000 7f6af5d9b640 1 -- 172.21.15.46:0/988951722 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ae800e4d0 con 0x7f6af80a2df0 2024-09-11T14:39:31.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.817+0000 7f6afd191640 1 -- 172.21.15.46:0/988951722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 msgr2=0x7f6af80a3200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:31.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.817+0000 7f6afd191640 1 --2- 172.21.15.46:0/988951722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 0x7f6af80a3200 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:31.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.817+0000 7f6afd191640 1 -- 172.21.15.46:0/988951722 shutdown_connections 2024-09-11T14:39:31.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.817+0000 7f6afd191640 1 --2- 172.21.15.46:0/988951722 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 0x7f6af80a3200 unknown :-1 s=CLOSED pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:31.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.817+0000 7f6afd191640 1 -- 172.21.15.46:0/988951722 >> 172.21.15.46:0/988951722 conn(0x7f6af80a4ad0 msgr2=0x7f6af80a4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:31.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.817+0000 7f6afd191640 1 -- 172.21.15.46:0/988951722 shutdown_connections 2024-09-11T14:39:31.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.817+0000 7f6afd191640 1 -- 172.21.15.46:0/988951722 wait complete. 2024-09-11T14:39:31.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.817+0000 7f6afd191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:31.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.820+0000 7f6afd191640 1 Processor -- start 2024-09-11T14:39:31.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.820+0000 7f6afd191640 1 -- start start 2024-09-11T14:39:31.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.821+0000 7f6afd191640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 0x7f6af8120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:31.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.821+0000 7f6afd191640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6af811fcb0 con 0x7f6af80a2df0 2024-09-11T14:39:31.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.821+0000 7f6af6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 0x7f6af8120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:31.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.821+0000 7f6af6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 0x7f6af8120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55142/0 (socket says 172.21.15.46:55142) 2024-09-11T14:39:31.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.821+0000 7f6af6d9d640 1 -- 172.21.15.46:0/3017657460 learned_addr learned my addr 172.21.15.46:0/3017657460 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:31.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.822+0000 7f6af6d9d640 1 -- 172.21.15.46:0/3017657460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af8120240 con 0x7f6af80a2df0 2024-09-11T14:39:31.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.822+0000 7f6af6d9d640 1 --2- 172.21.15.46:0/3017657460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 0x7f6af8120690 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:31.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.822+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ae8013610 con 0x7f6af80a2df0 2024-09-11T14:39:31.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.822+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ae8013770 con 0x7f6af80a2df0 2024-09-11T14:39:31.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.822+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af81216f0 con 0x7f6af80a2df0 2024-09-11T14:39:31.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.822+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ae8013a10 con 0x7f6af80a2df0 2024-09-11T14:39:31.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.822+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af8123be0 con 0x7f6af80a2df0 2024-09-11T14:39:31.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.823+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af809d430 con 0x7f6af80a2df0 2024-09-11T14:39:31.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.823+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f6ae8013c10 con 0x7f6af80a2df0 2024-09-11T14:39:31.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.823+0000 7f6adf7fe640 1 --2- 172.21.15.46:0/3017657460 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6ae403e8e0 0x7f6ae4040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:31.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.823+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(727..727 src has 593..727) ==== 4207+0+0 (crc 0 0 0) 0x7f6ae8018040 con 0x7f6af80a2df0 2024-09-11T14:39:31.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.824+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=728}) -- 0x7f6ae4045310 con 0x7f6af80a2df0 2024-09-11T14:39:31.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.824+0000 7f6af659c640 1 --2- 172.21.15.46:0/3017657460 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6ae403e8e0 0x7f6ae4040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:31.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.824+0000 7f6af659c640 1 --2- 172.21.15.46:0/3017657460 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6ae403e8e0 0x7f6ae4040df0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:31.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:31.829+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f6ae8011570 con 0x7f6af80a2df0 2024-09-11T14:39:32.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.014+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "pool2": "bcc42802-4a92-4251-a537-9d1c078ffecf", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6af8121ed0 con 0x7f6af80a2df0 2024-09-11T14:39:32.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.679+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "pool2": "bcc42802-4a92-4251-a537-9d1c078ffecf", "yes_i_really_really_mean_it": true}]=0 pool 'bcc42802-4a92-4251-a537-9d1c078ffecf' removed v728) ==== 248+0+0 (crc 0 0 0) 0x7f6ae8018bf0 con 0x7f6af80a2df0 2024-09-11T14:39:32.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.680+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(728..728 src has 593..728) ==== 296+0+0 (crc 0 0 0) 0x7f6ae8012e30 con 0x7f6af80a2df0 2024-09-11T14:39:32.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.680+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=729}) -- 0x7f6ae4045dd0 con 0x7f6af80a2df0 2024-09-11T14:39:32.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.849+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "pool2": "bcc42802-4a92-4251-a537-9d1c078ffecf", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6af80698c0 con 0x7f6af80a2df0 2024-09-11T14:39:32.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.850+0000 7f6adf7fe640 1 -- 172.21.15.46:0/3017657460 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "bcc42802-4a92-4251-a537-9d1c078ffecf", "pool2": "bcc42802-4a92-4251-a537-9d1c078ffecf", "yes_i_really_really_mean_it": true}]=0 pool 'bcc42802-4a92-4251-a537-9d1c078ffecf' does not exist v728) ==== 255+0+0 (crc 0 0 0) 0x7f6ae8018db0 con 0x7f6af80a2df0 2024-09-11T14:39:32.851 INFO:tasks.workunit.client.0.smithi046.stderr:pool 'bcc42802-4a92-4251-a537-9d1c078ffecf' does not exist 2024-09-11T14:39:32.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6ae403e8e0 msgr2=0x7f6ae4040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:32.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 --2- 172.21.15.46:0/3017657460 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6ae403e8e0 0x7f6ae4040df0 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:32.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 msgr2=0x7f6af8120690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:32.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 --2- 172.21.15.46:0/3017657460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 0x7f6af8120690 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:32.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 shutdown_connections 2024-09-11T14:39:32.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 --2- 172.21.15.46:0/3017657460 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f6ae403e8e0 0x7f6ae4040df0 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:32.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 --2- 172.21.15.46:0/3017657460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6af80a2df0 0x7f6af8120690 unknown :-1 s=CLOSED pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:32.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 >> 172.21.15.46:0/3017657460 conn(0x7f6af80a4ad0 msgr2=0x7f6af8133fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:32.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 shutdown_connections 2024-09-11T14:39:32.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.853+0000 7f6afd191640 1 -- 172.21.15.46:0/3017657460 wait complete. 2024-09-11T14:39:32.865 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool delete 48ced627-17b4-4855-926a-7d45bdad78a6 48ced627-17b4-4855-926a-7d45bdad78a6 --yes-i-really-really-mean-it 2024-09-11T14:39:32.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.967+0000 7f2837cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:32.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.977+0000 7f2837cc8640 1 Processor -- start 2024-09-11T14:39:32.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.977+0000 7f2837cc8640 1 -- start start 2024-09-11T14:39:32.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.978+0000 7f2837cc8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2830072fe0 0x7f28301304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.978+0000 7f2837cc8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283009fc50 con 0x7f2830130a10 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.978+0000 7f2837cc8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f28300a3380 con 0x7f2830072fe0 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2835a64640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2830072fe0 0x7f28301304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2835263640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2830130a10 0x7f2830071830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41016/0 (socket says 172.21.15.46:41016) 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2835263640 1 -- 172.21.15.46:0/3315148640 learned_addr learned my addr 172.21.15.46:0/3315148640 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2835a64640 1 -- 172.21.15.46:0/3315148640 >> v1:172.21.15.46:6789/0 conn(0x7f2830130a10 legacy=0x7f2830071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2834a62640 1 -- 172.21.15.46:0/3315148640 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024620706 0 0) 0x7f283009fc50 con 0x7f2830130a10 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2835a64640 1 -- 172.21.15.46:0/3315148640 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28300748d0 con 0x7f2830072fe0 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2835a64640 1 --2- 172.21.15.46:0/3315148640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 0x7f28301304d0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d1af096f313efd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2834a62640 1 -- 172.21.15.46:0/3315148640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f282c009d90 con 0x7f2830072fe0 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2834a62640 1 -- 172.21.15.46:0/3315148640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f282c00e230 con 0x7f2830072fe0 2024-09-11T14:39:32.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.979+0000 7f2834a62640 1 -- 172.21.15.46:0/3315148640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f282c00e4d0 con 0x7f2830072fe0 2024-09-11T14:39:32.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.980+0000 7f2837cc8640 1 -- 172.21.15.46:0/3315148640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 msgr2=0x7f28301304d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:32.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.980+0000 7f2837cc8640 1 --2- 172.21.15.46:0/3315148640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 0x7f28301304d0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:32.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.980+0000 7f2837cc8640 1 -- 172.21.15.46:0/3315148640 shutdown_connections 2024-09-11T14:39:32.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.980+0000 7f2837cc8640 1 --2- 172.21.15.46:0/3315148640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 0x7f28301304d0 unknown :-1 s=CLOSED pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:32.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.980+0000 7f2837cc8640 1 -- 172.21.15.46:0/3315148640 >> 172.21.15.46:0/3315148640 conn(0x7f28300a3b90 msgr2=0x7f28300a23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:32.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.980+0000 7f2837cc8640 1 -- 172.21.15.46:0/3315148640 shutdown_connections 2024-09-11T14:39:32.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.980+0000 7f2837cc8640 1 -- 172.21.15.46:0/3315148640 wait complete. 2024-09-11T14:39:32.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.980+0000 7f2837cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:32.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.982+0000 7f2837cc8640 1 Processor -- start 2024-09-11T14:39:32.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.982+0000 7f2837cc8640 1 -- start start 2024-09-11T14:39:32.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f2837cc8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 0x7f283011f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:32.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f2837cc8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f28300a22b0 con 0x7f2830072fe0 2024-09-11T14:39:32.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f2835a64640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 0x7f283011f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:32.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f2835a64640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 0x7f283011f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55158/0 (socket says 172.21.15.46:55158) 2024-09-11T14:39:32.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f2835a64640 1 -- 172.21.15.46:0/1493731640 learned_addr learned my addr 172.21.15.46:0/1493731640 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:32.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f2835a64640 1 -- 172.21.15.46:0/1493731640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28301232c0 con 0x7f2830072fe0 2024-09-11T14:39:32.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f2835a64640 1 --2- 172.21.15.46:0/1493731640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 0x7f283011f410 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:32.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f282c013610 con 0x7f2830072fe0 2024-09-11T14:39:32.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f282c013770 con 0x7f2830072fe0 2024-09-11T14:39:32.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28301223c0 con 0x7f2830072fe0 2024-09-11T14:39:32.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f282c013a10 con 0x7f2830072fe0 2024-09-11T14:39:32.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.984+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2830120d60 con 0x7f2830072fe0 2024-09-11T14:39:32.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.985+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28300a2d50 con 0x7f2830072fe0 2024-09-11T14:39:32.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.985+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f282c013bc0 con 0x7f2830072fe0 2024-09-11T14:39:32.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.986+0000 7f28267fc640 1 --2- 172.21.15.46:0/1493731640 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f281403e930 0x7f2814040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:32.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.986+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(728..728 src has 593..728) ==== 3819+0+0 (crc 0 0 0) 0x7f282c018040 con 0x7f2830072fe0 2024-09-11T14:39:32.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.986+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=729}) -- 0x7f2814044bc0 con 0x7f2830072fe0 2024-09-11T14:39:32.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.986+0000 7f2835263640 1 --2- 172.21.15.46:0/1493731640 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f281403e930 0x7f2814040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:32.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.986+0000 7f2835263640 1 --2- 172.21.15.46:0/1493731640 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f281403e930 0x7f2814040e40 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:32.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:32.991+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f282c011570 con 0x7f2830072fe0 2024-09-11T14:39:33.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.176+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "pool2": "48ced627-17b4-4855-926a-7d45bdad78a6", "yes_i_really_really_mean_it": true} v 0) -- 0x7f283009fe80 con 0x7f2830072fe0 2024-09-11T14:39:33.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.681+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "pool2": "48ced627-17b4-4855-926a-7d45bdad78a6", "yes_i_really_really_mean_it": true}]=0 pool '48ced627-17b4-4855-926a-7d45bdad78a6' removed v729) ==== 248+0+0 (crc 0 0 0) 0x7f282c018a50 con 0x7f2830072fe0 2024-09-11T14:39:33.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.681+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(729..729 src has 593..729) ==== 296+0+0 (crc 0 0 0) 0x7f282c017190 con 0x7f2830072fe0 2024-09-11T14:39:33.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.681+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=730}) -- 0x7f28140457f0 con 0x7f2830072fe0 2024-09-11T14:39:33.859 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.857+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "pool2": "48ced627-17b4-4855-926a-7d45bdad78a6", "yes_i_really_really_mean_it": true} v 0) -- 0x7f28300a26c0 con 0x7f2830072fe0 2024-09-11T14:39:33.859 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.858+0000 7f28267fc640 1 -- 172.21.15.46:0/1493731640 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "48ced627-17b4-4855-926a-7d45bdad78a6", "pool2": "48ced627-17b4-4855-926a-7d45bdad78a6", "yes_i_really_really_mean_it": true}]=0 pool '48ced627-17b4-4855-926a-7d45bdad78a6' does not exist v729) ==== 255+0+0 (crc 0 0 0) 0x7f282c011380 con 0x7f2830072fe0 2024-09-11T14:39:33.859 INFO:tasks.workunit.client.0.smithi046.stderr:pool '48ced627-17b4-4855-926a-7d45bdad78a6' does not exist 2024-09-11T14:39:33.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.860+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f281403e930 msgr2=0x7f2814040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:33.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.860+0000 7f2837cc8640 1 --2- 172.21.15.46:0/1493731640 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f281403e930 0x7f2814040e40 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:33.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.860+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 msgr2=0x7f283011f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:33.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.860+0000 7f2837cc8640 1 --2- 172.21.15.46:0/1493731640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 0x7f283011f410 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:33.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.861+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 shutdown_connections 2024-09-11T14:39:33.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.861+0000 7f2837cc8640 1 --2- 172.21.15.46:0/1493731640 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f281403e930 0x7f2814040e40 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:33.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.861+0000 7f2837cc8640 1 --2- 172.21.15.46:0/1493731640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2830072fe0 0x7f283011f410 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:33.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.861+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 >> 172.21.15.46:0/1493731640 conn(0x7f28300a3b90 msgr2=0x7f28301302a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:33.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.861+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 shutdown_connections 2024-09-11T14:39:33.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-09-11T14:39:33.861+0000 7f2837cc8640 1 -- 172.21.15.46:0/1493731640 wait complete. 2024-09-11T14:39:33.873 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo OK 2024-09-11T14:39:33.875 INFO:tasks.workunit.client.0.smithi046.stdout:OK 2024-09-11T14:39:33.875 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T14:39:33.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T14:39:33.941 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-09-11T14:39:33.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T14:39:34.309 DEBUG:teuthology.parallel:result is None 2024-09-11T14:39:34.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:39:34.336 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:39:34.336 DEBUG:teuthology.orchestra.run.smithi046:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-11T14:39:34.401 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T14:39:34.401 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T14:39:34.411 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T14:39:34.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:34.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.549+0000 7fc832ce3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.554+0000 7fc832ce3640 1 Processor -- start 2024-09-11T14:39:34.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.554+0000 7fc832ce3640 1 -- start start 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.555+0000 7fc832ce3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc82c1355c0 0x7fc82c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.555+0000 7fc832ce3640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc82c1331e0 con 0x7fc82c1326c0 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.555+0000 7fc832ce3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc82c1322b0 con 0x7fc82c1355c0 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.556+0000 7fc82bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc82c1355c0 0x7fc82c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.556+0000 7fc830a7f640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc82c1326c0 0x7fc82c132ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41032/0 (socket says 172.21.15.46:41032) 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.556+0000 7fc830a7f640 1 -- 172.21.15.46:0/3915621184 learned_addr learned my addr 172.21.15.46:0/3915621184 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.556+0000 7fc82bfff640 1 -- 172.21.15.46:0/3915621184 >> v1:172.21.15.46:6789/0 conn(0x7fc82c1326c0 legacy=0x7fc82c132ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.556+0000 7fc82bfff640 1 -- 172.21.15.46:0/3915621184 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c06fda0 con 0x7fc82c1355c0 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.556+0000 7fc82bfff640 1 --2- 172.21.15.46:0/3915621184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1355c0 0x7fc82c1379e0 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f947681318e9a053 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.556+0000 7fc82b7fe640 1 -- 172.21.15.46:0/3915621184 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc81c00e040 con 0x7fc82c1355c0 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.556+0000 7fc82b7fe640 1 -- 172.21.15.46:0/3915621184 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc81c007670 con 0x7fc82c1355c0 2024-09-11T14:39:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.556+0000 7fc82b7fe640 1 -- 172.21.15.46:0/3915621184 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc81c007910 con 0x7fc82c1355c0 2024-09-11T14:39:34.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.557+0000 7fc832ce3640 1 -- 172.21.15.46:0/3915621184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1355c0 msgr2=0x7fc82c1379e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:34.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.557+0000 7fc832ce3640 1 --2- 172.21.15.46:0/3915621184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1355c0 0x7fc82c1379e0 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.557+0000 7fc832ce3640 1 -- 172.21.15.46:0/3915621184 shutdown_connections 2024-09-11T14:39:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.557+0000 7fc832ce3640 1 --2- 172.21.15.46:0/3915621184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1355c0 0x7fc82c1379e0 unknown :-1 s=CLOSED pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.557+0000 7fc832ce3640 1 -- 172.21.15.46:0/3915621184 >> 172.21.15.46:0/3915621184 conn(0x7fc82c0690e0 msgr2=0x7fc82c0694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.557+0000 7fc832ce3640 1 -- 172.21.15.46:0/3915621184 shutdown_connections 2024-09-11T14:39:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.557+0000 7fc832ce3640 1 -- 172.21.15.46:0/3915621184 wait complete. 2024-09-11T14:39:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.557+0000 7fc832ce3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.559+0000 7fc832ce3640 1 Processor -- start 2024-09-11T14:39:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.559+0000 7fc832ce3640 1 -- start start 2024-09-11T14:39:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.561+0000 7fc832ce3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1326c0 0x7fc82c070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.561+0000 7fc832ce3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c125570 con 0x7fc82c1326c0 2024-09-11T14:39:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.561+0000 7fc830a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1326c0 0x7fc82c070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.561+0000 7fc830a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1326c0 0x7fc82c070fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55190/0 (socket says 172.21.15.46:55190) 2024-09-11T14:39:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.561+0000 7fc830a7f640 1 -- 172.21.15.46:0/612408459 learned_addr learned my addr 172.21.15.46:0/612408459 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.561+0000 7fc830a7f640 1 -- 172.21.15.46:0/612408459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c0729b0 con 0x7fc82c1326c0 2024-09-11T14:39:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.562+0000 7fc830a7f640 1 --2- 172.21.15.46:0/612408459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1326c0 0x7fc82c070fb0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:34.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.562+0000 7fc8297fa640 1 -- 172.21.15.46:0/612408459 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc824005a60 con 0x7fc82c1326c0 2024-09-11T14:39:34.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.562+0000 7fc8297fa640 1 -- 172.21.15.46:0/612408459 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc824005bc0 con 0x7fc82c1326c0 2024-09-11T14:39:34.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.562+0000 7fc8297fa640 1 -- 172.21.15.46:0/612408459 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc824005e60 con 0x7fc82c1326c0 2024-09-11T14:39:34.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.562+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82c124650 con 0x7fc82c1326c0 2024-09-11T14:39:34.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.562+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82c124d50 con 0x7fc82c1326c0 2024-09-11T14:39:34.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.563+0000 7fc8297fa640 1 -- 172.21.15.46:0/612408459 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc8240070b0 con 0x7fc82c1326c0 2024-09-11T14:39:34.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.563+0000 7fc8297fa640 1 --2- 172.21.15.46:0/612408459 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc80c03e930 0x7fc80c040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:34.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.563+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82c070770 con 0x7fc82c1326c0 2024-09-11T14:39:34.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.563+0000 7fc8297fa640 1 -- 172.21.15.46:0/612408459 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7fc82404f930 con 0x7fc82c1326c0 2024-09-11T14:39:34.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.563+0000 7fc82bfff640 1 --2- 172.21.15.46:0/612408459 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc80c03e930 0x7fc80c040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:34.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.564+0000 7fc82bfff640 1 --2- 172.21.15.46:0/612408459 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc80c03e930 0x7fc80c040e40 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.569+0000 7fc8297fa640 1 -- 172.21.15.46:0/612408459 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc82400f230 con 0x7fc82c1326c0 2024-09-11T14:39:34.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.749+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc82c070bf0 con 0x7fc80c03e930 2024-09-11T14:39:34.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.751+0000 7fc8297fa640 1 -- 172.21.15.46:0/612408459 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7fc81c007b10 con 0x7fc80c03e930 2024-09-11T14:39:34.754 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:39:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-11T14:39:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc80c03e930 msgr2=0x7fc80c040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 --2- 172.21.15.46:0/612408459 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc80c03e930 0x7fc80c040e40 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1326c0 msgr2=0x7fc82c070fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 --2- 172.21.15.46:0/612408459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1326c0 0x7fc82c070fb0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 shutdown_connections 2024-09-11T14:39:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 --2- 172.21.15.46:0/612408459 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc80c03e930 0x7fc80c040e40 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 --2- 172.21.15.46:0/612408459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c1326c0 0x7fc82c070fb0 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 >> 172.21.15.46:0/612408459 conn(0x7fc82c0690e0 msgr2=0x7fc82c073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 shutdown_connections 2024-09-11T14:39:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.754+0000 7fc832ce3640 1 -- 172.21.15.46:0/612408459 wait complete. 2024-09-11T14:39:34.767 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1309,"stamp":"2024-09-11T14:39:34.622256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":23336,"kb_used_data":23336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209167576,"statfs":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002236"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.710571+0000","last_change":"2024-09-11T14:25:17.967604+0000","last_active":"2024-09-11T14:39:01.710571+0000","last_peered":"2024-09-11T14:39:01.710571+0000","last_clean":"2024-09-11T14:39:01.710571+0000","last_became_active":"2024-09-11T14:25:17.959003+0000","last_became_peered":"2024-09-11T14:25:17.959003+0000","last_unstale":"2024-09-11T14:39:01.710571+0000","last_undegraded":"2024-09-11T14:39:01.710571+0000","last_fullsized":"2024-09-11T14:39:01.710571+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729888+0000","last_change":"2024-09-11T14:25:18.071413+0000","last_active":"2024-09-11T14:39:01.729888+0000","last_peered":"2024-09-11T14:39:01.729888+0000","last_clean":"2024-09-11T14:39:01.729888+0000","last_became_active":"2024-09-11T14:25:18.057804+0000","last_became_peered":"2024-09-11T14:25:18.057804+0000","last_unstale":"2024-09-11T14:39:01.729888+0000","last_undegraded":"2024-09-11T14:39:01.729888+0000","last_fullsized":"2024-09-11T14:39:01.729888+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722357+0000","last_change":"2024-09-11T14:25:18.010778+0000","last_active":"2024-09-11T14:39:01.722357+0000","last_peered":"2024-09-11T14:39:01.722357+0000","last_clean":"2024-09-11T14:39:01.722357+0000","last_became_active":"2024-09-11T14:25:17.997485+0000","last_became_peered":"2024-09-11T14:25:17.997485+0000","last_unstale":"2024-09-11T14:39:01.722357+0000","last_undegraded":"2024-09-11T14:39:01.722357+0000","last_fullsized":"2024-09-11T14:39:01.722357+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.723217+0000","last_change":"2024-09-11T14:25:18.022706+0000","last_active":"2024-09-11T14:39:01.723217+0000","last_peered":"2024-09-11T14:39:01.723217+0000","last_clean":"2024-09-11T14:39:01.723217+0000","last_became_active":"2024-09-11T14:25:17.988591+0000","last_became_peered":"2024-09-11T14:25:17.988591+0000","last_unstale":"2024-09-11T14:39:01.723217+0000","last_undegraded":"2024-09-11T14:39:01.723217+0000","last_fullsized":"2024-09-11T14:39:01.723217+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720683+0000","last_change":"2024-09-11T14:25:18.016706+0000","last_active":"2024-09-11T14:39:01.720683+0000","last_peered":"2024-09-11T14:39:01.720683+0000","last_clean":"2024-09-11T14:39:01.720683+0000","last_became_active":"2024-09-11T14:25:18.001149+0000","last_became_peered":"2024-09-11T14:25:18.001149+0000","last_unstale":"2024-09-11T14:39:01.720683+0000","last_undegraded":"2024-09-11T14:39:01.720683+0000","last_fullsized":"2024-09-11T14:39:01.720683+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.723213+0000","last_change":"2024-09-11T14:25:18.040831+0000","last_active":"2024-09-11T14:39:01.723213+0000","last_peered":"2024-09-11T14:39:01.723213+0000","last_clean":"2024-09-11T14:39:01.723213+0000","last_became_active":"2024-09-11T14:25:17.962220+0000","last_became_peered":"2024-09-11T14:25:17.962220+0000","last_unstale":"2024-09-11T14:39:01.723213+0000","last_undegraded":"2024-09-11T14:39:01.723213+0000","last_fullsized":"2024-09-11T14:39:01.723213+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726176+0000","last_change":"2024-09-11T14:25:18.030832+0000","last_active":"2024-09-11T14:39:01.726176+0000","last_peered":"2024-09-11T14:39:01.726176+0000","last_clean":"2024-09-11T14:39:01.726176+0000","last_became_active":"2024-09-11T14:25:18.001816+0000","last_became_peered":"2024-09-11T14:25:18.001816+0000","last_unstale":"2024-09-11T14:39:01.726176+0000","last_undegraded":"2024-09-11T14:39:01.726176+0000","last_fullsized":"2024-09-11T14:39:01.726176+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.735137+0000","last_change":"2024-09-11T14:25:18.036731+0000","last_active":"2024-09-11T14:39:01.735137+0000","last_peered":"2024-09-11T14:39:01.735137+0000","last_clean":"2024-09-11T14:39:01.735137+0000","last_became_active":"2024-09-11T14:25:18.014278+0000","last_became_peered":"2024-09-11T14:25:18.014278+0000","last_unstale":"2024-09-11T14:39:01.735137+0000","last_undegraded":"2024-09-11T14:39:01.735137+0000","last_fullsized":"2024-09-11T14:39:01.735137+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.716999+0000","last_change":"2024-09-11T14:25:18.122293+0000","last_active":"2024-09-11T14:39:01.716999+0000","last_peered":"2024-09-11T14:39:01.716999+0000","last_clean":"2024-09-11T14:39:01.716999+0000","last_became_active":"2024-09-11T14:25:18.116721+0000","last_became_peered":"2024-09-11T14:25:18.116721+0000","last_unstale":"2024-09-11T14:39:01.716999+0000","last_undegraded":"2024-09-11T14:39:01.716999+0000","last_fullsized":"2024-09-11T14:39:01.716999+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721546+0000","last_change":"2024-09-11T14:25:17.963491+0000","last_active":"2024-09-11T14:39:01.721546+0000","last_peered":"2024-09-11T14:39:01.721546+0000","last_clean":"2024-09-11T14:39:01.721546+0000","last_became_active":"2024-09-11T14:25:17.956766+0000","last_became_peered":"2024-09-11T14:25:17.956766+0000","last_unstale":"2024-09-11T14:39:01.721546+0000","last_undegraded":"2024-09-11T14:39:01.721546+0000","last_fullsized":"2024-09-11T14:39:01.721546+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729097+0000","last_change":"2024-09-11T14:25:18.053878+0000","last_active":"2024-09-11T14:39:01.729097+0000","last_peered":"2024-09-11T14:39:01.729097+0000","last_clean":"2024-09-11T14:39:01.729097+0000","last_became_active":"2024-09-11T14:25:18.047823+0000","last_became_peered":"2024-09-11T14:25:18.047823+0000","last_unstale":"2024-09-11T14:39:01.729097+0000","last_undegraded":"2024-09-11T14:39:01.729097+0000","last_fullsized":"2024-09-11T14:39:01.729097+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.718601+0000","last_change":"2024-09-11T14:25:18.140132+0000","last_active":"2024-09-11T14:39:01.718601+0000","last_peered":"2024-09-11T14:39:01.718601+0000","last_clean":"2024-09-11T14:39:01.718601+0000","last_became_active":"2024-09-11T14:25:18.071958+0000","last_became_peered":"2024-09-11T14:25:18.071958+0000","last_unstale":"2024-09-11T14:39:01.718601+0000","last_undegraded":"2024-09-11T14:39:01.718601+0000","last_fullsized":"2024-09-11T14:39:01.718601+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.715774+0000","last_change":"2024-09-11T14:25:18.118269+0000","last_active":"2024-09-11T14:39:01.715774+0000","last_peered":"2024-09-11T14:39:01.715774+0000","last_clean":"2024-09-11T14:39:01.715774+0000","last_became_active":"2024-09-11T14:25:18.097464+0000","last_became_peered":"2024-09-11T14:25:18.097464+0000","last_unstale":"2024-09-11T14:39:01.715774+0000","last_undegraded":"2024-09-11T14:39:01.715774+0000","last_fullsized":"2024-09-11T14:39:01.715774+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726258+0000","last_change":"2024-09-11T14:25:18.235222+0000","last_active":"2024-09-11T14:39:01.726258+0000","last_peered":"2024-09-11T14:39:01.726258+0000","last_clean":"2024-09-11T14:39:01.726258+0000","last_became_active":"2024-09-11T14:25:18.228702+0000","last_became_peered":"2024-09-11T14:25:18.228702+0000","last_unstale":"2024-09-11T14:39:01.726258+0000","last_undegraded":"2024-09-11T14:39:01.726258+0000","last_fullsized":"2024-09-11T14:39:01.726258+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.730436+0000","last_change":"2024-09-11T14:25:18.105924+0000","last_active":"2024-09-11T14:39:01.730436+0000","last_peered":"2024-09-11T14:39:01.730436+0000","last_clean":"2024-09-11T14:39:01.730436+0000","last_became_active":"2024-09-11T14:25:18.076782+0000","last_became_peered":"2024-09-11T14:25:18.076782+0000","last_unstale":"2024-09-11T14:39:01.730436+0000","last_undegraded":"2024-09-11T14:39:01.730436+0000","last_fullsized":"2024-09-11T14:39:01.730436+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.724673+0000","last_change":"2024-09-11T14:25:18.108880+0000","last_active":"2024-09-11T14:39:01.724673+0000","last_peered":"2024-09-11T14:39:01.724673+0000","last_clean":"2024-09-11T14:39:01.724673+0000","last_became_active":"2024-09-11T14:25:18.090898+0000","last_became_peered":"2024-09-11T14:25:18.090898+0000","last_unstale":"2024-09-11T14:39:01.724673+0000","last_undegraded":"2024-09-11T14:39:01.724673+0000","last_fullsized":"2024-09-11T14:39:01.724673+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729038+0000","last_change":"2024-09-11T14:25:18.041164+0000","last_active":"2024-09-11T14:39:01.729038+0000","last_peered":"2024-09-11T14:39:01.729038+0000","last_clean":"2024-09-11T14:39:01.729038+0000","last_became_active":"2024-09-11T14:25:18.021680+0000","last_became_peered":"2024-09-11T14:25:18.021680+0000","last_unstale":"2024-09-11T14:39:01.729038+0000","last_undegraded":"2024-09-11T14:39:01.729038+0000","last_fullsized":"2024-09-11T14:39:01.729038+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727878+0000","last_change":"2024-09-11T14:25:18.005865+0000","last_active":"2024-09-11T14:39:01.727878+0000","last_peered":"2024-09-11T14:39:01.727878+0000","last_clean":"2024-09-11T14:39:01.727878+0000","last_became_active":"2024-09-11T14:25:17.997072+0000","last_became_peered":"2024-09-11T14:25:17.997072+0000","last_unstale":"2024-09-11T14:39:01.727878+0000","last_undegraded":"2024-09-11T14:39:01.727878+0000","last_fullsized":"2024-09-11T14:39:01.727878+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.708846+0000","last_change":"2024-09-11T14:25:18.065279+0000","last_active":"2024-09-11T14:39:01.708846+0000","last_peered":"2024-09-11T14:39:01.708846+0000","last_clean":"2024-09-11T14:39:01.708846+0000","last_became_active":"2024-09-11T14:25:18.024131+0000","last_became_peered":"2024-09-11T14:25:18.024131+0000","last_unstale":"2024-09-11T14:39:01.708846+0000","last_undegraded":"2024-09-11T14:39:01.708846+0000","last_fullsized":"2024-09-11T14:39:01.708846+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722562+0000","last_change":"2024-09-11T14:25:18.024308+0000","last_active":"2024-09-11T14:39:01.722562+0000","last_peered":"2024-09-11T14:39:01.722562+0000","last_clean":"2024-09-11T14:39:01.722562+0000","last_became_active":"2024-09-11T14:25:18.002727+0000","last_became_peered":"2024-09-11T14:25:18.002727+0000","last_unstale":"2024-09-11T14:39:01.722562+0000","last_undegraded":"2024-09-11T14:39:01.722562+0000","last_fullsized":"2024-09-11T14:39:01.722562+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713328+0000","last_change":"2024-09-11T14:25:18.184581+0000","last_active":"2024-09-11T14:39:01.713328+0000","last_peered":"2024-09-11T14:39:01.713328+0000","last_clean":"2024-09-11T14:39:01.713328+0000","last_became_active":"2024-09-11T14:25:18.176059+0000","last_became_peered":"2024-09-11T14:25:18.176059+0000","last_unstale":"2024-09-11T14:39:01.713328+0000","last_undegraded":"2024-09-11T14:39:01.713328+0000","last_fullsized":"2024-09-11T14:39:01.713328+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726404+0000","last_change":"2024-09-11T14:25:18.085645+0000","last_active":"2024-09-11T14:39:01.726404+0000","last_peered":"2024-09-11T14:39:01.726404+0000","last_clean":"2024-09-11T14:39:01.726404+0000","last_became_active":"2024-09-11T14:25:18.032463+0000","last_became_peered":"2024-09-11T14:25:18.032463+0000","last_unstale":"2024-09-11T14:39:01.726404+0000","last_undegraded":"2024-09-11T14:39:01.726404+0000","last_fullsized":"2024-09-11T14:39:01.726404+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720622+0000","last_change":"2024-09-11T14:25:18.104584+0000","last_active":"2024-09-11T14:39:01.720622+0000","last_peered":"2024-09-11T14:39:01.720622+0000","last_clean":"2024-09-11T14:39:01.720622+0000","last_became_active":"2024-09-11T14:25:18.095787+0000","last_became_peered":"2024-09-11T14:25:18.095787+0000","last_unstale":"2024-09-11T14:39:01.720622+0000","last_undegraded":"2024-09-11T14:39:01.720622+0000","last_fullsized":"2024-09-11T14:39:01.720622+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.710903+0000","last_change":"2024-09-11T14:25:18.032561+0000","last_active":"2024-09-11T14:39:01.710903+0000","last_peered":"2024-09-11T14:39:01.710903+0000","last_clean":"2024-09-11T14:39:01.710903+0000","last_became_active":"2024-09-11T14:25:18.008366+0000","last_became_peered":"2024-09-11T14:25:18.008366+0000","last_unstale":"2024-09-11T14:39:01.710903+0000","last_undegraded":"2024-09-11T14:39:01.710903+0000","last_fullsized":"2024-09-11T14:39:01.710903+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720656+0000","last_change":"2024-09-11T14:25:18.036132+0000","last_active":"2024-09-11T14:39:01.720656+0000","last_peered":"2024-09-11T14:39:01.720656+0000","last_clean":"2024-09-11T14:39:01.720656+0000","last_became_active":"2024-09-11T14:25:17.998831+0000","last_became_peered":"2024-09-11T14:25:17.998831+0000","last_unstale":"2024-09-11T14:39:01.720656+0000","last_undegraded":"2024-09-11T14:39:01.720656+0000","last_fullsized":"2024-09-11T14:39:01.720656+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726698+0000","last_change":"2024-09-11T14:25:18.024958+0000","last_active":"2024-09-11T14:39:01.726698+0000","last_peered":"2024-09-11T14:39:01.726698+0000","last_clean":"2024-09-11T14:39:01.726698+0000","last_became_active":"2024-09-11T14:25:17.997086+0000","last_became_peered":"2024-09-11T14:25:17.997086+0000","last_unstale":"2024-09-11T14:39:01.726698+0000","last_undegraded":"2024-09-11T14:39:01.726698+0000","last_fullsized":"2024-09-11T14:39:01.726698+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.719520+0000","last_change":"2024-09-11T14:25:17.998094+0000","last_active":"2024-09-11T14:39:01.719520+0000","last_peered":"2024-09-11T14:39:01.719520+0000","last_clean":"2024-09-11T14:39:01.719520+0000","last_became_active":"2024-09-11T14:25:17.975159+0000","last_became_peered":"2024-09-11T14:25:17.975159+0000","last_unstale":"2024-09-11T14:39:01.719520+0000","last_undegraded":"2024-09-11T14:39:01.719520+0000","last_fullsized":"2024-09-11T14:39:01.719520+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.714922+0000","last_change":"2024-09-11T14:25:18.052250+0000","last_active":"2024-09-11T14:39:01.714922+0000","last_peered":"2024-09-11T14:39:01.714922+0000","last_clean":"2024-09-11T14:39:01.714922+0000","last_became_active":"2024-09-11T14:25:17.980204+0000","last_became_peered":"2024-09-11T14:25:17.980204+0000","last_unstale":"2024-09-11T14:39:01.714922+0000","last_undegraded":"2024-09-11T14:39:01.714922+0000","last_fullsized":"2024-09-11T14:39:01.714922+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727283+0000","last_change":"2024-09-11T14:25:18.067709+0000","last_active":"2024-09-11T14:39:01.727283+0000","last_peered":"2024-09-11T14:39:01.727283+0000","last_clean":"2024-09-11T14:39:01.727283+0000","last_became_active":"2024-09-11T14:25:18.045624+0000","last_became_peered":"2024-09-11T14:25:18.045624+0000","last_unstale":"2024-09-11T14:39:01.727283+0000","last_undegraded":"2024-09-11T14:39:01.727283+0000","last_fullsized":"2024-09-11T14:39:01.727283+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727546+0000","last_change":"2024-09-11T14:25:18.149907+0000","last_active":"2024-09-11T14:39:01.727546+0000","last_peered":"2024-09-11T14:39:01.727546+0000","last_clean":"2024-09-11T14:39:01.727546+0000","last_became_active":"2024-09-11T14:25:18.059476+0000","last_became_peered":"2024-09-11T14:25:18.059476+0000","last_unstale":"2024-09-11T14:39:01.727546+0000","last_undegraded":"2024-09-11T14:39:01.727546+0000","last_fullsized":"2024-09-11T14:39:01.727546+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1479,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722147+0000","last_change":"2024-09-11T14:25:17.995302+0000","last_active":"2024-09-11T14:39:01.722147+0000","last_peered":"2024-09-11T14:39:01.722147+0000","last_clean":"2024-09-11T14:39:01.722147+0000","last_became_active":"2024-09-11T14:25:17.965924+0000","last_became_peered":"2024-09-11T14:25:17.965924+0000","last_unstale":"2024-09-11T14:39:01.722147+0000","last_undegraded":"2024-09-11T14:39:01.722147+0000","last_fullsized":"2024-09-11T14:39:01.722147+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721971+0000","last_change":"2024-09-11T14:25:18.017389+0000","last_active":"2024-09-11T14:39:01.721971+0000","last_peered":"2024-09-11T14:39:01.721971+0000","last_clean":"2024-09-11T14:39:01.721971+0000","last_became_active":"2024-09-11T14:25:18.009130+0000","last_became_peered":"2024-09-11T14:25:18.009130+0000","last_unstale":"2024-09-11T14:39:01.721971+0000","last_undegraded":"2024-09-11T14:39:01.721971+0000","last_fullsized":"2024-09-11T14:39:01.721971+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.725196+0000","last_change":"2024-09-11T14:20:05.441963+0000","last_active":"2024-09-11T14:39:01.725196+0000","last_peered":"2024-09-11T14:39:01.725196+0000","last_clean":"2024-09-11T14:39:01.725196+0000","last_became_active":"2024-09-11T14:20:03.484694+0000","last_became_peered":"2024-09-11T14:20:03.484694+0000","last_unstale":"2024-09-11T14:39:01.725196+0000","last_undegraded":"2024-09-11T14:39:01.725196+0000","last_fullsized":"2024-09-11T14:39:01.725196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.716804+0000","last_change":"2024-09-11T14:20:05.440901+0000","last_active":"2024-09-11T14:39:01.716804+0000","last_peered":"2024-09-11T14:39:01.716804+0000","last_clean":"2024-09-11T14:39:01.716804+0000","last_became_active":"2024-09-11T14:20:03.517121+0000","last_became_peered":"2024-09-11T14:20:03.517121+0000","last_unstale":"2024-09-11T14:39:01.716804+0000","last_undegraded":"2024-09-11T14:39:01.716804+0000","last_fullsized":"2024-09-11T14:39:01.716804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729794+0000","last_change":"2024-09-11T14:20:05.436801+0000","last_active":"2024-09-11T14:39:01.729794+0000","last_peered":"2024-09-11T14:39:01.729794+0000","last_clean":"2024-09-11T14:39:01.729794+0000","last_became_active":"2024-09-11T14:20:03.488911+0000","last_became_peered":"2024-09-11T14:20:03.488911+0000","last_unstale":"2024-09-11T14:39:01.729794+0000","last_undegraded":"2024-09-11T14:39:01.729794+0000","last_fullsized":"2024-09-11T14:39:01.729794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713302+0000","last_change":"2024-09-11T14:20:05.435707+0000","last_active":"2024-09-11T14:39:01.713302+0000","last_peered":"2024-09-11T14:39:01.713302+0000","last_clean":"2024-09-11T14:39:01.713302+0000","last_became_active":"2024-09-11T14:20:03.480359+0000","last_became_peered":"2024-09-11T14:20:03.480359+0000","last_unstale":"2024-09-11T14:39:01.713302+0000","last_undegraded":"2024-09-11T14:39:01.713302+0000","last_fullsized":"2024-09-11T14:39:01.713302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2147,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.731932+0000","last_change":"2024-09-11T14:20:05.443617+0000","last_active":"2024-09-11T14:39:01.731932+0000","last_peered":"2024-09-11T14:39:01.731932+0000","last_clean":"2024-09-11T14:39:01.731932+0000","last_became_active":"2024-09-11T14:20:03.479775+0000","last_became_peered":"2024-09-11T14:20:03.479775+0000","last_unstale":"2024-09-11T14:39:01.731932+0000","last_undegraded":"2024-09-11T14:39:01.731932+0000","last_fullsized":"2024-09-11T14:39:01.731932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713868+0000","last_change":"2024-09-11T14:20:05.435614+0000","last_active":"2024-09-11T14:39:01.713868+0000","last_peered":"2024-09-11T14:39:01.713868+0000","last_clean":"2024-09-11T14:39:01.713868+0000","last_became_active":"2024-09-11T14:20:03.469827+0000","last_became_peered":"2024-09-11T14:20:03.469827+0000","last_unstale":"2024-09-11T14:39:01.713868+0000","last_undegraded":"2024-09-11T14:39:01.713868+0000","last_fullsized":"2024-09-11T14:39:01.713868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2145,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721904+0000","last_change":"2024-09-11T14:20:05.442983+0000","last_active":"2024-09-11T14:39:01.721904+0000","last_peered":"2024-09-11T14:39:01.721904+0000","last_clean":"2024-09-11T14:39:01.721904+0000","last_became_active":"2024-09-11T14:20:03.491981+0000","last_became_peered":"2024-09-11T14:20:03.491981+0000","last_unstale":"2024-09-11T14:39:01.721904+0000","last_undegraded":"2024-09-11T14:39:01.721904+0000","last_fullsized":"2024-09-11T14:39:01.721904+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2152,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.730323+0000","last_change":"2024-09-11T14:20:05.440350+0000","last_active":"2024-09-11T14:39:01.730323+0000","last_peered":"2024-09-11T14:39:01.730323+0000","last_clean":"2024-09-11T14:39:01.730323+0000","last_became_active":"2024-09-11T14:20:03.498001+0000","last_became_peered":"2024-09-11T14:20:03.498001+0000","last_unstale":"2024-09-11T14:39:01.730323+0000","last_undegraded":"2024-09-11T14:39:01.730323+0000","last_fullsized":"2024-09-11T14:39:01.730323+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2223,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.714639+0000","last_change":"2024-09-11T14:20:01.465936+0000","last_active":"2024-09-11T14:39:01.714639+0000","last_peered":"2024-09-11T14:39:01.714639+0000","last_clean":"2024-09-11T14:39:01.714639+0000","last_became_active":"2024-09-11T14:20:01.446610+0000","last_became_peered":"2024-09-11T14:20:01.446610+0000","last_unstale":"2024-09-11T14:39:01.714639+0000","last_undegraded":"2024-09-11T14:39:01.714639+0000","last_fullsized":"2024-09-11T14:39:01.714639+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_clean_scrub_stamp":"2024-09-11T14:20:00.391487+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6212,"kb_used_data":6212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291516,"statfs":{"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5264,"kb_used_data":5264,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292464,"statfs":{"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5100,"kb_used_data":5100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292628,"statfs":{"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6760,"kb_used_data":6760,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290968,"statfs":{"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:34.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:34.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.876+0000 7fe86c64f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.881+0000 7fe86c64f640 1 Processor -- start 2024-09-11T14:39:34.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.881+0000 7fe86c64f640 1 -- start start 2024-09-11T14:39:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.883+0000 7fe86c64f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe86406d550 0x7fe8641386d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.883+0000 7fe86c64f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8640a0d00 con 0x7fe86409ec50 2024-09-11T14:39:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.883+0000 7fe86c64f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fe8640a0a30 con 0x7fe86406d550 2024-09-11T14:39:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.883+0000 7fe869bea640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe86406d550 0x7fe8641386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.883+0000 7fe86a3eb640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe86409ec50 0x7fe86406ce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41046/0 (socket says 172.21.15.46:41046) 2024-09-11T14:39:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.883+0000 7fe86a3eb640 1 -- 172.21.15.46:0/2548046728 learned_addr learned my addr 172.21.15.46:0/2548046728 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.883+0000 7fe869bea640 1 -- 172.21.15.46:0/2548046728 >> v1:172.21.15.46:6789/0 conn(0x7fe86409ec50 legacy=0x7fe86406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.883+0000 7fe869bea640 1 -- 172.21.15.46:0/2548046728 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8640710b0 con 0x7fe86406d550 2024-09-11T14:39:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.883+0000 7fe8693e9640 1 -- 172.21.15.46:0/2548046728 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301319249 0 0) 0x7fe8640a0d00 con 0x7fe86409ec50 2024-09-11T14:39:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.884+0000 7fe869bea640 1 --2- 172.21.15.46:0/2548046728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 0x7fe8641386d0 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd86f35c178e21f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.884+0000 7fe8693e9640 1 -- 172.21.15.46:0/2548046728 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe854009d90 con 0x7fe86406d550 2024-09-11T14:39:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.884+0000 7fe8693e9640 1 -- 172.21.15.46:0/2548046728 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe85400e230 con 0x7fe86406d550 2024-09-11T14:39:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.884+0000 7fe8693e9640 1 -- 172.21.15.46:0/2548046728 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe85400e4d0 con 0x7fe86406d550 2024-09-11T14:39:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.885+0000 7fe86c64f640 1 -- 172.21.15.46:0/2548046728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 msgr2=0x7fe8641386d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.885+0000 7fe86c64f640 1 --2- 172.21.15.46:0/2548046728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 0x7fe8641386d0 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.885+0000 7fe86c64f640 1 -- 172.21.15.46:0/2548046728 shutdown_connections 2024-09-11T14:39:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.885+0000 7fe86c64f640 1 --2- 172.21.15.46:0/2548046728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 0x7fe8641386d0 unknown :-1 s=CLOSED pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.885+0000 7fe86c64f640 1 -- 172.21.15.46:0/2548046728 >> 172.21.15.46:0/2548046728 conn(0x7fe864069d10 msgr2=0x7fe86409f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.885+0000 7fe86c64f640 1 -- 172.21.15.46:0/2548046728 shutdown_connections 2024-09-11T14:39:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.885+0000 7fe86c64f640 1 -- 172.21.15.46:0/2548046728 wait complete. 2024-09-11T14:39:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.885+0000 7fe86c64f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.887+0000 7fe86c64f640 1 Processor -- start 2024-09-11T14:39:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.887+0000 7fe86c64f640 1 -- start start 2024-09-11T14:39:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.888+0000 7fe86c64f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 0x7fe8641212b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.888+0000 7fe86c64f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe864123200 con 0x7fe86406d550 2024-09-11T14:39:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.888+0000 7fe86a3eb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 0x7fe8641212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.888+0000 7fe86a3eb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 0x7fe8641212b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55212/0 (socket says 172.21.15.46:55212) 2024-09-11T14:39:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.888+0000 7fe86a3eb640 1 -- 172.21.15.46:0/740470111 learned_addr learned my addr 172.21.15.46:0/740470111 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.889+0000 7fe86a3eb640 1 -- 172.21.15.46:0/740470111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe864121090 con 0x7fe86406d550 2024-09-11T14:39:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.889+0000 7fe86a3eb640 1 --2- 172.21.15.46:0/740470111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 0x7fe8641212b0 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.889+0000 7fe85affd640 1 -- 172.21.15.46:0/740470111 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8600070b0 con 0x7fe86406d550 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.889+0000 7fe85affd640 1 -- 172.21.15.46:0/740470111 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe860007210 con 0x7fe86406d550 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.889+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe864124820 con 0x7fe86406d550 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.889+0000 7fe85affd640 1 -- 172.21.15.46:0/740470111 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8600074b0 con 0x7fe86406d550 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.889+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe864122be0 con 0x7fe86406d550 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.890+0000 7fe85affd640 1 -- 172.21.15.46:0/740470111 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fe8600076b0 con 0x7fe86406d550 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.890+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86406ce40 con 0x7fe86406d550 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.890+0000 7fe85affd640 1 --2- 172.21.15.46:0/740470111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe84803e8e0 0x7fe848040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.890+0000 7fe85affd640 1 -- 172.21.15.46:0/740470111 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7fe8600503f0 con 0x7fe86406d550 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.891+0000 7fe869bea640 1 --2- 172.21.15.46:0/740470111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe84803e8e0 0x7fe848040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.891+0000 7fe869bea640 1 --2- 172.21.15.46:0/740470111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe84803e8e0 0x7fe848040df0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:34.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:34.895+0000 7fe85affd640 1 -- 172.21.15.46:0/740470111 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fe860009830 con 0x7fe86406d550 2024-09-11T14:39:35.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.075+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe86406e0b0 con 0x7fe84803e8e0 2024-09-11T14:39:35.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.078+0000 7fe85affd640 1 -- 172.21.15.46:0/740470111 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7fe86406e0b0 con 0x7fe84803e8e0 2024-09-11T14:39:35.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:39:35.081 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-11T14:39:35.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe84803e8e0 msgr2=0x7fe848040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 --2- 172.21.15.46:0/740470111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe84803e8e0 0x7fe848040df0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 msgr2=0x7fe8641212b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 --2- 172.21.15.46:0/740470111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 0x7fe8641212b0 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 shutdown_connections 2024-09-11T14:39:35.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 --2- 172.21.15.46:0/740470111 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fe84803e8e0 0x7fe848040df0 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 --2- 172.21.15.46:0/740470111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe86406d550 0x7fe8641212b0 unknown :-1 s=CLOSED pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 >> 172.21.15.46:0/740470111 conn(0x7fe864069d10 msgr2=0x7fe8640a2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:35.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 shutdown_connections 2024-09-11T14:39:35.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.081+0000 7fe86c64f640 1 -- 172.21.15.46:0/740470111 wait complete. 2024-09-11T14:39:35.093 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1309,"stamp":"2024-09-11T14:39:34.622256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":23336,"kb_used_data":23336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209167576,"statfs":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002236"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.710571+0000","last_change":"2024-09-11T14:25:17.967604+0000","last_active":"2024-09-11T14:39:01.710571+0000","last_peered":"2024-09-11T14:39:01.710571+0000","last_clean":"2024-09-11T14:39:01.710571+0000","last_became_active":"2024-09-11T14:25:17.959003+0000","last_became_peered":"2024-09-11T14:25:17.959003+0000","last_unstale":"2024-09-11T14:39:01.710571+0000","last_undegraded":"2024-09-11T14:39:01.710571+0000","last_fullsized":"2024-09-11T14:39:01.710571+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729888+0000","last_change":"2024-09-11T14:25:18.071413+0000","last_active":"2024-09-11T14:39:01.729888+0000","last_peered":"2024-09-11T14:39:01.729888+0000","last_clean":"2024-09-11T14:39:01.729888+0000","last_became_active":"2024-09-11T14:25:18.057804+0000","last_became_peered":"2024-09-11T14:25:18.057804+0000","last_unstale":"2024-09-11T14:39:01.729888+0000","last_undegraded":"2024-09-11T14:39:01.729888+0000","last_fullsized":"2024-09-11T14:39:01.729888+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722357+0000","last_change":"2024-09-11T14:25:18.010778+0000","last_active":"2024-09-11T14:39:01.722357+0000","last_peered":"2024-09-11T14:39:01.722357+0000","last_clean":"2024-09-11T14:39:01.722357+0000","last_became_active":"2024-09-11T14:25:17.997485+0000","last_became_peered":"2024-09-11T14:25:17.997485+0000","last_unstale":"2024-09-11T14:39:01.722357+0000","last_undegraded":"2024-09-11T14:39:01.722357+0000","last_fullsized":"2024-09-11T14:39:01.722357+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.723217+0000","last_change":"2024-09-11T14:25:18.022706+0000","last_active":"2024-09-11T14:39:01.723217+0000","last_peered":"2024-09-11T14:39:01.723217+0000","last_clean":"2024-09-11T14:39:01.723217+0000","last_became_active":"2024-09-11T14:25:17.988591+0000","last_became_peered":"2024-09-11T14:25:17.988591+0000","last_unstale":"2024-09-11T14:39:01.723217+0000","last_undegraded":"2024-09-11T14:39:01.723217+0000","last_fullsized":"2024-09-11T14:39:01.723217+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720683+0000","last_change":"2024-09-11T14:25:18.016706+0000","last_active":"2024-09-11T14:39:01.720683+0000","last_peered":"2024-09-11T14:39:01.720683+0000","last_clean":"2024-09-11T14:39:01.720683+0000","last_became_active":"2024-09-11T14:25:18.001149+0000","last_became_peered":"2024-09-11T14:25:18.001149+0000","last_unstale":"2024-09-11T14:39:01.720683+0000","last_undegraded":"2024-09-11T14:39:01.720683+0000","last_fullsized":"2024-09-11T14:39:01.720683+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.723213+0000","last_change":"2024-09-11T14:25:18.040831+0000","last_active":"2024-09-11T14:39:01.723213+0000","last_peered":"2024-09-11T14:39:01.723213+0000","last_clean":"2024-09-11T14:39:01.723213+0000","last_became_active":"2024-09-11T14:25:17.962220+0000","last_became_peered":"2024-09-11T14:25:17.962220+0000","last_unstale":"2024-09-11T14:39:01.723213+0000","last_undegraded":"2024-09-11T14:39:01.723213+0000","last_fullsized":"2024-09-11T14:39:01.723213+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726176+0000","last_change":"2024-09-11T14:25:18.030832+0000","last_active":"2024-09-11T14:39:01.726176+0000","last_peered":"2024-09-11T14:39:01.726176+0000","last_clean":"2024-09-11T14:39:01.726176+0000","last_became_active":"2024-09-11T14:25:18.001816+0000","last_became_peered":"2024-09-11T14:25:18.001816+0000","last_unstale":"2024-09-11T14:39:01.726176+0000","last_undegraded":"2024-09-11T14:39:01.726176+0000","last_fullsized":"2024-09-11T14:39:01.726176+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.735137+0000","last_change":"2024-09-11T14:25:18.036731+0000","last_active":"2024-09-11T14:39:01.735137+0000","last_peered":"2024-09-11T14:39:01.735137+0000","last_clean":"2024-09-11T14:39:01.735137+0000","last_became_active":"2024-09-11T14:25:18.014278+0000","last_became_peered":"2024-09-11T14:25:18.014278+0000","last_unstale":"2024-09-11T14:39:01.735137+0000","last_undegraded":"2024-09-11T14:39:01.735137+0000","last_fullsized":"2024-09-11T14:39:01.735137+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.716999+0000","last_change":"2024-09-11T14:25:18.122293+0000","last_active":"2024-09-11T14:39:01.716999+0000","last_peered":"2024-09-11T14:39:01.716999+0000","last_clean":"2024-09-11T14:39:01.716999+0000","last_became_active":"2024-09-11T14:25:18.116721+0000","last_became_peered":"2024-09-11T14:25:18.116721+0000","last_unstale":"2024-09-11T14:39:01.716999+0000","last_undegraded":"2024-09-11T14:39:01.716999+0000","last_fullsized":"2024-09-11T14:39:01.716999+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721546+0000","last_change":"2024-09-11T14:25:17.963491+0000","last_active":"2024-09-11T14:39:01.721546+0000","last_peered":"2024-09-11T14:39:01.721546+0000","last_clean":"2024-09-11T14:39:01.721546+0000","last_became_active":"2024-09-11T14:25:17.956766+0000","last_became_peered":"2024-09-11T14:25:17.956766+0000","last_unstale":"2024-09-11T14:39:01.721546+0000","last_undegraded":"2024-09-11T14:39:01.721546+0000","last_fullsized":"2024-09-11T14:39:01.721546+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729097+0000","last_change":"2024-09-11T14:25:18.053878+0000","last_active":"2024-09-11T14:39:01.729097+0000","last_peered":"2024-09-11T14:39:01.729097+0000","last_clean":"2024-09-11T14:39:01.729097+0000","last_became_active":"2024-09-11T14:25:18.047823+0000","last_became_peered":"2024-09-11T14:25:18.047823+0000","last_unstale":"2024-09-11T14:39:01.729097+0000","last_undegraded":"2024-09-11T14:39:01.729097+0000","last_fullsized":"2024-09-11T14:39:01.729097+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.718601+0000","last_change":"2024-09-11T14:25:18.140132+0000","last_active":"2024-09-11T14:39:01.718601+0000","last_peered":"2024-09-11T14:39:01.718601+0000","last_clean":"2024-09-11T14:39:01.718601+0000","last_became_active":"2024-09-11T14:25:18.071958+0000","last_became_peered":"2024-09-11T14:25:18.071958+0000","last_unstale":"2024-09-11T14:39:01.718601+0000","last_undegraded":"2024-09-11T14:39:01.718601+0000","last_fullsized":"2024-09-11T14:39:01.718601+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.715774+0000","last_change":"2024-09-11T14:25:18.118269+0000","last_active":"2024-09-11T14:39:01.715774+0000","last_peered":"2024-09-11T14:39:01.715774+0000","last_clean":"2024-09-11T14:39:01.715774+0000","last_became_active":"2024-09-11T14:25:18.097464+0000","last_became_peered":"2024-09-11T14:25:18.097464+0000","last_unstale":"2024-09-11T14:39:01.715774+0000","last_undegraded":"2024-09-11T14:39:01.715774+0000","last_fullsized":"2024-09-11T14:39:01.715774+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726258+0000","last_change":"2024-09-11T14:25:18.235222+0000","last_active":"2024-09-11T14:39:01.726258+0000","last_peered":"2024-09-11T14:39:01.726258+0000","last_clean":"2024-09-11T14:39:01.726258+0000","last_became_active":"2024-09-11T14:25:18.228702+0000","last_became_peered":"2024-09-11T14:25:18.228702+0000","last_unstale":"2024-09-11T14:39:01.726258+0000","last_undegraded":"2024-09-11T14:39:01.726258+0000","last_fullsized":"2024-09-11T14:39:01.726258+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.730436+0000","last_change":"2024-09-11T14:25:18.105924+0000","last_active":"2024-09-11T14:39:01.730436+0000","last_peered":"2024-09-11T14:39:01.730436+0000","last_clean":"2024-09-11T14:39:01.730436+0000","last_became_active":"2024-09-11T14:25:18.076782+0000","last_became_peered":"2024-09-11T14:25:18.076782+0000","last_unstale":"2024-09-11T14:39:01.730436+0000","last_undegraded":"2024-09-11T14:39:01.730436+0000","last_fullsized":"2024-09-11T14:39:01.730436+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.724673+0000","last_change":"2024-09-11T14:25:18.108880+0000","last_active":"2024-09-11T14:39:01.724673+0000","last_peered":"2024-09-11T14:39:01.724673+0000","last_clean":"2024-09-11T14:39:01.724673+0000","last_became_active":"2024-09-11T14:25:18.090898+0000","last_became_peered":"2024-09-11T14:25:18.090898+0000","last_unstale":"2024-09-11T14:39:01.724673+0000","last_undegraded":"2024-09-11T14:39:01.724673+0000","last_fullsized":"2024-09-11T14:39:01.724673+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729038+0000","last_change":"2024-09-11T14:25:18.041164+0000","last_active":"2024-09-11T14:39:01.729038+0000","last_peered":"2024-09-11T14:39:01.729038+0000","last_clean":"2024-09-11T14:39:01.729038+0000","last_became_active":"2024-09-11T14:25:18.021680+0000","last_became_peered":"2024-09-11T14:25:18.021680+0000","last_unstale":"2024-09-11T14:39:01.729038+0000","last_undegraded":"2024-09-11T14:39:01.729038+0000","last_fullsized":"2024-09-11T14:39:01.729038+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727878+0000","last_change":"2024-09-11T14:25:18.005865+0000","last_active":"2024-09-11T14:39:01.727878+0000","last_peered":"2024-09-11T14:39:01.727878+0000","last_clean":"2024-09-11T14:39:01.727878+0000","last_became_active":"2024-09-11T14:25:17.997072+0000","last_became_peered":"2024-09-11T14:25:17.997072+0000","last_unstale":"2024-09-11T14:39:01.727878+0000","last_undegraded":"2024-09-11T14:39:01.727878+0000","last_fullsized":"2024-09-11T14:39:01.727878+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.708846+0000","last_change":"2024-09-11T14:25:18.065279+0000","last_active":"2024-09-11T14:39:01.708846+0000","last_peered":"2024-09-11T14:39:01.708846+0000","last_clean":"2024-09-11T14:39:01.708846+0000","last_became_active":"2024-09-11T14:25:18.024131+0000","last_became_peered":"2024-09-11T14:25:18.024131+0000","last_unstale":"2024-09-11T14:39:01.708846+0000","last_undegraded":"2024-09-11T14:39:01.708846+0000","last_fullsized":"2024-09-11T14:39:01.708846+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722562+0000","last_change":"2024-09-11T14:25:18.024308+0000","last_active":"2024-09-11T14:39:01.722562+0000","last_peered":"2024-09-11T14:39:01.722562+0000","last_clean":"2024-09-11T14:39:01.722562+0000","last_became_active":"2024-09-11T14:25:18.002727+0000","last_became_peered":"2024-09-11T14:25:18.002727+0000","last_unstale":"2024-09-11T14:39:01.722562+0000","last_undegraded":"2024-09-11T14:39:01.722562+0000","last_fullsized":"2024-09-11T14:39:01.722562+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713328+0000","last_change":"2024-09-11T14:25:18.184581+0000","last_active":"2024-09-11T14:39:01.713328+0000","last_peered":"2024-09-11T14:39:01.713328+0000","last_clean":"2024-09-11T14:39:01.713328+0000","last_became_active":"2024-09-11T14:25:18.176059+0000","last_became_peered":"2024-09-11T14:25:18.176059+0000","last_unstale":"2024-09-11T14:39:01.713328+0000","last_undegraded":"2024-09-11T14:39:01.713328+0000","last_fullsized":"2024-09-11T14:39:01.713328+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726404+0000","last_change":"2024-09-11T14:25:18.085645+0000","last_active":"2024-09-11T14:39:01.726404+0000","last_peered":"2024-09-11T14:39:01.726404+0000","last_clean":"2024-09-11T14:39:01.726404+0000","last_became_active":"2024-09-11T14:25:18.032463+0000","last_became_peered":"2024-09-11T14:25:18.032463+0000","last_unstale":"2024-09-11T14:39:01.726404+0000","last_undegraded":"2024-09-11T14:39:01.726404+0000","last_fullsized":"2024-09-11T14:39:01.726404+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720622+0000","last_change":"2024-09-11T14:25:18.104584+0000","last_active":"2024-09-11T14:39:01.720622+0000","last_peered":"2024-09-11T14:39:01.720622+0000","last_clean":"2024-09-11T14:39:01.720622+0000","last_became_active":"2024-09-11T14:25:18.095787+0000","last_became_peered":"2024-09-11T14:25:18.095787+0000","last_unstale":"2024-09-11T14:39:01.720622+0000","last_undegraded":"2024-09-11T14:39:01.720622+0000","last_fullsized":"2024-09-11T14:39:01.720622+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.710903+0000","last_change":"2024-09-11T14:25:18.032561+0000","last_active":"2024-09-11T14:39:01.710903+0000","last_peered":"2024-09-11T14:39:01.710903+0000","last_clean":"2024-09-11T14:39:01.710903+0000","last_became_active":"2024-09-11T14:25:18.008366+0000","last_became_peered":"2024-09-11T14:25:18.008366+0000","last_unstale":"2024-09-11T14:39:01.710903+0000","last_undegraded":"2024-09-11T14:39:01.710903+0000","last_fullsized":"2024-09-11T14:39:01.710903+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720656+0000","last_change":"2024-09-11T14:25:18.036132+0000","last_active":"2024-09-11T14:39:01.720656+0000","last_peered":"2024-09-11T14:39:01.720656+0000","last_clean":"2024-09-11T14:39:01.720656+0000","last_became_active":"2024-09-11T14:25:17.998831+0000","last_became_peered":"2024-09-11T14:25:17.998831+0000","last_unstale":"2024-09-11T14:39:01.720656+0000","last_undegraded":"2024-09-11T14:39:01.720656+0000","last_fullsized":"2024-09-11T14:39:01.720656+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726698+0000","last_change":"2024-09-11T14:25:18.024958+0000","last_active":"2024-09-11T14:39:01.726698+0000","last_peered":"2024-09-11T14:39:01.726698+0000","last_clean":"2024-09-11T14:39:01.726698+0000","last_became_active":"2024-09-11T14:25:17.997086+0000","last_became_peered":"2024-09-11T14:25:17.997086+0000","last_unstale":"2024-09-11T14:39:01.726698+0000","last_undegraded":"2024-09-11T14:39:01.726698+0000","last_fullsized":"2024-09-11T14:39:01.726698+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.719520+0000","last_change":"2024-09-11T14:25:17.998094+0000","last_active":"2024-09-11T14:39:01.719520+0000","last_peered":"2024-09-11T14:39:01.719520+0000","last_clean":"2024-09-11T14:39:01.719520+0000","last_became_active":"2024-09-11T14:25:17.975159+0000","last_became_peered":"2024-09-11T14:25:17.975159+0000","last_unstale":"2024-09-11T14:39:01.719520+0000","last_undegraded":"2024-09-11T14:39:01.719520+0000","last_fullsized":"2024-09-11T14:39:01.719520+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.714922+0000","last_change":"2024-09-11T14:25:18.052250+0000","last_active":"2024-09-11T14:39:01.714922+0000","last_peered":"2024-09-11T14:39:01.714922+0000","last_clean":"2024-09-11T14:39:01.714922+0000","last_became_active":"2024-09-11T14:25:17.980204+0000","last_became_peered":"2024-09-11T14:25:17.980204+0000","last_unstale":"2024-09-11T14:39:01.714922+0000","last_undegraded":"2024-09-11T14:39:01.714922+0000","last_fullsized":"2024-09-11T14:39:01.714922+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727283+0000","last_change":"2024-09-11T14:25:18.067709+0000","last_active":"2024-09-11T14:39:01.727283+0000","last_peered":"2024-09-11T14:39:01.727283+0000","last_clean":"2024-09-11T14:39:01.727283+0000","last_became_active":"2024-09-11T14:25:18.045624+0000","last_became_peered":"2024-09-11T14:25:18.045624+0000","last_unstale":"2024-09-11T14:39:01.727283+0000","last_undegraded":"2024-09-11T14:39:01.727283+0000","last_fullsized":"2024-09-11T14:39:01.727283+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727546+0000","last_change":"2024-09-11T14:25:18.149907+0000","last_active":"2024-09-11T14:39:01.727546+0000","last_peered":"2024-09-11T14:39:01.727546+0000","last_clean":"2024-09-11T14:39:01.727546+0000","last_became_active":"2024-09-11T14:25:18.059476+0000","last_became_peered":"2024-09-11T14:25:18.059476+0000","last_unstale":"2024-09-11T14:39:01.727546+0000","last_undegraded":"2024-09-11T14:39:01.727546+0000","last_fullsized":"2024-09-11T14:39:01.727546+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1479,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722147+0000","last_change":"2024-09-11T14:25:17.995302+0000","last_active":"2024-09-11T14:39:01.722147+0000","last_peered":"2024-09-11T14:39:01.722147+0000","last_clean":"2024-09-11T14:39:01.722147+0000","last_became_active":"2024-09-11T14:25:17.965924+0000","last_became_peered":"2024-09-11T14:25:17.965924+0000","last_unstale":"2024-09-11T14:39:01.722147+0000","last_undegraded":"2024-09-11T14:39:01.722147+0000","last_fullsized":"2024-09-11T14:39:01.722147+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721971+0000","last_change":"2024-09-11T14:25:18.017389+0000","last_active":"2024-09-11T14:39:01.721971+0000","last_peered":"2024-09-11T14:39:01.721971+0000","last_clean":"2024-09-11T14:39:01.721971+0000","last_became_active":"2024-09-11T14:25:18.009130+0000","last_became_peered":"2024-09-11T14:25:18.009130+0000","last_unstale":"2024-09-11T14:39:01.721971+0000","last_undegraded":"2024-09-11T14:39:01.721971+0000","last_fullsized":"2024-09-11T14:39:01.721971+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.725196+0000","last_change":"2024-09-11T14:20:05.441963+0000","last_active":"2024-09-11T14:39:01.725196+0000","last_peered":"2024-09-11T14:39:01.725196+0000","last_clean":"2024-09-11T14:39:01.725196+0000","last_became_active":"2024-09-11T14:20:03.484694+0000","last_became_peered":"2024-09-11T14:20:03.484694+0000","last_unstale":"2024-09-11T14:39:01.725196+0000","last_undegraded":"2024-09-11T14:39:01.725196+0000","last_fullsized":"2024-09-11T14:39:01.725196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.716804+0000","last_change":"2024-09-11T14:20:05.440901+0000","last_active":"2024-09-11T14:39:01.716804+0000","last_peered":"2024-09-11T14:39:01.716804+0000","last_clean":"2024-09-11T14:39:01.716804+0000","last_became_active":"2024-09-11T14:20:03.517121+0000","last_became_peered":"2024-09-11T14:20:03.517121+0000","last_unstale":"2024-09-11T14:39:01.716804+0000","last_undegraded":"2024-09-11T14:39:01.716804+0000","last_fullsized":"2024-09-11T14:39:01.716804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729794+0000","last_change":"2024-09-11T14:20:05.436801+0000","last_active":"2024-09-11T14:39:01.729794+0000","last_peered":"2024-09-11T14:39:01.729794+0000","last_clean":"2024-09-11T14:39:01.729794+0000","last_became_active":"2024-09-11T14:20:03.488911+0000","last_became_peered":"2024-09-11T14:20:03.488911+0000","last_unstale":"2024-09-11T14:39:01.729794+0000","last_undegraded":"2024-09-11T14:39:01.729794+0000","last_fullsized":"2024-09-11T14:39:01.729794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713302+0000","last_change":"2024-09-11T14:20:05.435707+0000","last_active":"2024-09-11T14:39:01.713302+0000","last_peered":"2024-09-11T14:39:01.713302+0000","last_clean":"2024-09-11T14:39:01.713302+0000","last_became_active":"2024-09-11T14:20:03.480359+0000","last_became_peered":"2024-09-11T14:20:03.480359+0000","last_unstale":"2024-09-11T14:39:01.713302+0000","last_undegraded":"2024-09-11T14:39:01.713302+0000","last_fullsized":"2024-09-11T14:39:01.713302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2147,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.731932+0000","last_change":"2024-09-11T14:20:05.443617+0000","last_active":"2024-09-11T14:39:01.731932+0000","last_peered":"2024-09-11T14:39:01.731932+0000","last_clean":"2024-09-11T14:39:01.731932+0000","last_became_active":"2024-09-11T14:20:03.479775+0000","last_became_peered":"2024-09-11T14:20:03.479775+0000","last_unstale":"2024-09-11T14:39:01.731932+0000","last_undegraded":"2024-09-11T14:39:01.731932+0000","last_fullsized":"2024-09-11T14:39:01.731932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713868+0000","last_change":"2024-09-11T14:20:05.435614+0000","last_active":"2024-09-11T14:39:01.713868+0000","last_peered":"2024-09-11T14:39:01.713868+0000","last_clean":"2024-09-11T14:39:01.713868+0000","last_became_active":"2024-09-11T14:20:03.469827+0000","last_became_peered":"2024-09-11T14:20:03.469827+0000","last_unstale":"2024-09-11T14:39:01.713868+0000","last_undegraded":"2024-09-11T14:39:01.713868+0000","last_fullsized":"2024-09-11T14:39:01.713868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2145,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721904+0000","last_change":"2024-09-11T14:20:05.442983+0000","last_active":"2024-09-11T14:39:01.721904+0000","last_peered":"2024-09-11T14:39:01.721904+0000","last_clean":"2024-09-11T14:39:01.721904+0000","last_became_active":"2024-09-11T14:20:03.491981+0000","last_became_peered":"2024-09-11T14:20:03.491981+0000","last_unstale":"2024-09-11T14:39:01.721904+0000","last_undegraded":"2024-09-11T14:39:01.721904+0000","last_fullsized":"2024-09-11T14:39:01.721904+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2152,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.730323+0000","last_change":"2024-09-11T14:20:05.440350+0000","last_active":"2024-09-11T14:39:01.730323+0000","last_peered":"2024-09-11T14:39:01.730323+0000","last_clean":"2024-09-11T14:39:01.730323+0000","last_became_active":"2024-09-11T14:20:03.498001+0000","last_became_peered":"2024-09-11T14:20:03.498001+0000","last_unstale":"2024-09-11T14:39:01.730323+0000","last_undegraded":"2024-09-11T14:39:01.730323+0000","last_fullsized":"2024-09-11T14:39:01.730323+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2223,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.714639+0000","last_change":"2024-09-11T14:20:01.465936+0000","last_active":"2024-09-11T14:39:01.714639+0000","last_peered":"2024-09-11T14:39:01.714639+0000","last_clean":"2024-09-11T14:39:01.714639+0000","last_became_active":"2024-09-11T14:20:01.446610+0000","last_became_peered":"2024-09-11T14:20:01.446610+0000","last_unstale":"2024-09-11T14:39:01.714639+0000","last_undegraded":"2024-09-11T14:39:01.714639+0000","last_fullsized":"2024-09-11T14:39:01.714639+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_clean_scrub_stamp":"2024-09-11T14:20:00.391487+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6212,"kb_used_data":6212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291516,"statfs":{"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5264,"kb_used_data":5264,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292464,"statfs":{"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5100,"kb_used_data":5100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292628,"statfs":{"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6760,"kb_used_data":6760,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290968,"statfs":{"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:35.095 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T14:39:35.095 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:35.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.202+0000 7f9f8f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:35.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.207+0000 7f9f8f591640 1 Processor -- start 2024-09-11T14:39:35.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.208+0000 7f9f8f591640 1 -- start start 2024-09-11T14:39:35.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.209+0000 7f9f8f591640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9f88135360 0x7f9f88137780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:35.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.209+0000 7f9f8f591640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f88074ba0 con 0x7f9f881325b0 2024-09-11T14:39:35.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.209+0000 7f9f8f591640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f9f881320d0 con 0x7f9f88135360 2024-09-11T14:39:35.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.209+0000 7f9f8cb2c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9f88135360 0x7f9f88137780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:35.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.209+0000 7f9f8d32d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9f881325b0 0x7f9f881329c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41062/0 (socket says 172.21.15.46:41062) 2024-09-11T14:39:35.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.209+0000 7f9f8d32d640 1 -- 172.21.15.46:0/3247675594 learned_addr learned my addr 172.21.15.46:0/3247675594 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:35.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.210+0000 7f9f8cb2c640 1 -- 172.21.15.46:0/3247675594 >> v1:172.21.15.46:6789/0 conn(0x7f9f881325b0 legacy=0x7f9f881329c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.210+0000 7f9f8cb2c640 1 -- 172.21.15.46:0/3247675594 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f88074e20 con 0x7f9f88135360 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.210+0000 7f9f7ffff640 1 -- 172.21.15.46:0/3247675594 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2326058471 0 0) 0x7f9f88074ba0 con 0x7f9f881325b0 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.210+0000 7f9f8cb2c640 1 --2- 172.21.15.46:0/3247675594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88135360 0x7f9f88137780 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75181d6030029fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.210+0000 7f9f7ffff640 1 -- 172.21.15.46:0/3247675594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9f78009d90 con 0x7f9f88135360 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.210+0000 7f9f7ffff640 1 -- 172.21.15.46:0/3247675594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9f7800e230 con 0x7f9f88135360 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.210+0000 7f9f7ffff640 1 -- 172.21.15.46:0/3247675594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9f7800e4d0 con 0x7f9f88135360 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.211+0000 7f9f8f591640 1 -- 172.21.15.46:0/3247675594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88135360 msgr2=0x7f9f88137780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.211+0000 7f9f8f591640 1 --2- 172.21.15.46:0/3247675594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88135360 0x7f9f88137780 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.211+0000 7f9f8f591640 1 -- 172.21.15.46:0/3247675594 shutdown_connections 2024-09-11T14:39:35.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.211+0000 7f9f8f591640 1 --2- 172.21.15.46:0/3247675594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88135360 0x7f9f88137780 unknown :-1 s=CLOSED pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.211+0000 7f9f8f591640 1 -- 172.21.15.46:0/3247675594 >> 172.21.15.46:0/3247675594 conn(0x7f9f88069d60 msgr2=0x7f9f8809e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:35.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.211+0000 7f9f8f591640 1 -- 172.21.15.46:0/3247675594 shutdown_connections 2024-09-11T14:39:35.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.211+0000 7f9f8f591640 1 -- 172.21.15.46:0/3247675594 wait complete. 2024-09-11T14:39:35.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.211+0000 7f9f8f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:35.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.213+0000 7f9f8f591640 1 Processor -- start 2024-09-11T14:39:35.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.213+0000 7f9f8f591640 1 -- start start 2024-09-11T14:39:35.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f8f591640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f881325b0 0x7f9f8811cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:35.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f8f591640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8811e2f0 con 0x7f9f881325b0 2024-09-11T14:39:35.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f8d32d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f881325b0 0x7f9f8811cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:35.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f8d32d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f881325b0 0x7f9f8811cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55222/0 (socket says 172.21.15.46:55222) 2024-09-11T14:39:35.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f8d32d640 1 -- 172.21.15.46:0/2695598973 learned_addr learned my addr 172.21.15.46:0/2695598973 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:35.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f8d32d640 1 -- 172.21.15.46:0/2695598973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f88130e60 con 0x7f9f881325b0 2024-09-11T14:39:35.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f8d32d640 1 --2- 172.21.15.46:0/2695598973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f881325b0 0x7f9f8811cdd0 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:35.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f7dffb640 1 -- 172.21.15.46:0/2695598973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9f84004b80 con 0x7f9f881325b0 2024-09-11T14:39:35.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f7dffb640 1 -- 172.21.15.46:0/2695598973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9f84004ce0 con 0x7f9f881325b0 2024-09-11T14:39:35.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f88120db0 con 0x7f9f881325b0 2024-09-11T14:39:35.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.215+0000 7f9f7dffb640 1 -- 172.21.15.46:0/2695598973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9f84007120 con 0x7f9f881325b0 2024-09-11T14:39:35.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.216+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f8811e850 con 0x7f9f881325b0 2024-09-11T14:39:35.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.216+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f8811f0c0 con 0x7f9f881325b0 2024-09-11T14:39:35.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.217+0000 7f9f7dffb640 1 -- 172.21.15.46:0/2695598973 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f9f84007320 con 0x7f9f881325b0 2024-09-11T14:39:35.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.217+0000 7f9f7dffb640 1 --2- 172.21.15.46:0/2695598973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f9f6c03e8e0 0x7f9f6c040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:35.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.217+0000 7f9f7dffb640 1 -- 172.21.15.46:0/2695598973 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f9f8404fb00 con 0x7f9f881325b0 2024-09-11T14:39:35.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.217+0000 7f9f8cb2c640 1 --2- 172.21.15.46:0/2695598973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f9f6c03e8e0 0x7f9f6c040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:35.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.218+0000 7f9f8cb2c640 1 --2- 172.21.15.46:0/2695598973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f9f6c03e8e0 0x7f9f6c040df0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:35.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.222+0000 7f9f7dffb640 1 -- 172.21.15.46:0/2695598973 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f9f8400f230 con 0x7f9f881325b0 2024-09-11T14:39:35.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.405+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f88074aa0 con 0x7f9f6c03e8e0 2024-09-11T14:39:35.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.407+0000 7f9f7dffb640 1 -- 172.21.15.46:0/2695598973 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7f9f88074aa0 con 0x7f9f6c03e8e0 2024-09-11T14:39:35.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:39:35.410 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f9f6c03e8e0 msgr2=0x7f9f6c040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 --2- 172.21.15.46:0/2695598973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f9f6c03e8e0 0x7f9f6c040df0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f881325b0 msgr2=0x7f9f8811cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 --2- 172.21.15.46:0/2695598973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f881325b0 0x7f9f8811cdd0 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 shutdown_connections 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 --2- 172.21.15.46:0/2695598973 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f9f6c03e8e0 0x7f9f6c040df0 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 --2- 172.21.15.46:0/2695598973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f881325b0 0x7f9f8811cdd0 unknown :-1 s=CLOSED pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 >> 172.21.15.46:0/2695598973 conn(0x7f9f88069d60 msgr2=0x7f9f88133140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 shutdown_connections 2024-09-11T14:39:35.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.410+0000 7f9f8f591640 1 -- 172.21.15.46:0/2695598973 wait complete. 2024-09-11T14:39:35.423 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1309,"stamp":"2024-09-11T14:39:34.622256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":23336,"kb_used_data":23336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209167576,"statfs":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002236"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.710571+0000","last_change":"2024-09-11T14:25:17.967604+0000","last_active":"2024-09-11T14:39:01.710571+0000","last_peered":"2024-09-11T14:39:01.710571+0000","last_clean":"2024-09-11T14:39:01.710571+0000","last_became_active":"2024-09-11T14:25:17.959003+0000","last_became_peered":"2024-09-11T14:25:17.959003+0000","last_unstale":"2024-09-11T14:39:01.710571+0000","last_undegraded":"2024-09-11T14:39:01.710571+0000","last_fullsized":"2024-09-11T14:39:01.710571+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729888+0000","last_change":"2024-09-11T14:25:18.071413+0000","last_active":"2024-09-11T14:39:01.729888+0000","last_peered":"2024-09-11T14:39:01.729888+0000","last_clean":"2024-09-11T14:39:01.729888+0000","last_became_active":"2024-09-11T14:25:18.057804+0000","last_became_peered":"2024-09-11T14:25:18.057804+0000","last_unstale":"2024-09-11T14:39:01.729888+0000","last_undegraded":"2024-09-11T14:39:01.729888+0000","last_fullsized":"2024-09-11T14:39:01.729888+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722357+0000","last_change":"2024-09-11T14:25:18.010778+0000","last_active":"2024-09-11T14:39:01.722357+0000","last_peered":"2024-09-11T14:39:01.722357+0000","last_clean":"2024-09-11T14:39:01.722357+0000","last_became_active":"2024-09-11T14:25:17.997485+0000","last_became_peered":"2024-09-11T14:25:17.997485+0000","last_unstale":"2024-09-11T14:39:01.722357+0000","last_undegraded":"2024-09-11T14:39:01.722357+0000","last_fullsized":"2024-09-11T14:39:01.722357+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.723217+0000","last_change":"2024-09-11T14:25:18.022706+0000","last_active":"2024-09-11T14:39:01.723217+0000","last_peered":"2024-09-11T14:39:01.723217+0000","last_clean":"2024-09-11T14:39:01.723217+0000","last_became_active":"2024-09-11T14:25:17.988591+0000","last_became_peered":"2024-09-11T14:25:17.988591+0000","last_unstale":"2024-09-11T14:39:01.723217+0000","last_undegraded":"2024-09-11T14:39:01.723217+0000","last_fullsized":"2024-09-11T14:39:01.723217+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720683+0000","last_change":"2024-09-11T14:25:18.016706+0000","last_active":"2024-09-11T14:39:01.720683+0000","last_peered":"2024-09-11T14:39:01.720683+0000","last_clean":"2024-09-11T14:39:01.720683+0000","last_became_active":"2024-09-11T14:25:18.001149+0000","last_became_peered":"2024-09-11T14:25:18.001149+0000","last_unstale":"2024-09-11T14:39:01.720683+0000","last_undegraded":"2024-09-11T14:39:01.720683+0000","last_fullsized":"2024-09-11T14:39:01.720683+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.723213+0000","last_change":"2024-09-11T14:25:18.040831+0000","last_active":"2024-09-11T14:39:01.723213+0000","last_peered":"2024-09-11T14:39:01.723213+0000","last_clean":"2024-09-11T14:39:01.723213+0000","last_became_active":"2024-09-11T14:25:17.962220+0000","last_became_peered":"2024-09-11T14:25:17.962220+0000","last_unstale":"2024-09-11T14:39:01.723213+0000","last_undegraded":"2024-09-11T14:39:01.723213+0000","last_fullsized":"2024-09-11T14:39:01.723213+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726176+0000","last_change":"2024-09-11T14:25:18.030832+0000","last_active":"2024-09-11T14:39:01.726176+0000","last_peered":"2024-09-11T14:39:01.726176+0000","last_clean":"2024-09-11T14:39:01.726176+0000","last_became_active":"2024-09-11T14:25:18.001816+0000","last_became_peered":"2024-09-11T14:25:18.001816+0000","last_unstale":"2024-09-11T14:39:01.726176+0000","last_undegraded":"2024-09-11T14:39:01.726176+0000","last_fullsized":"2024-09-11T14:39:01.726176+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.735137+0000","last_change":"2024-09-11T14:25:18.036731+0000","last_active":"2024-09-11T14:39:01.735137+0000","last_peered":"2024-09-11T14:39:01.735137+0000","last_clean":"2024-09-11T14:39:01.735137+0000","last_became_active":"2024-09-11T14:25:18.014278+0000","last_became_peered":"2024-09-11T14:25:18.014278+0000","last_unstale":"2024-09-11T14:39:01.735137+0000","last_undegraded":"2024-09-11T14:39:01.735137+0000","last_fullsized":"2024-09-11T14:39:01.735137+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.716999+0000","last_change":"2024-09-11T14:25:18.122293+0000","last_active":"2024-09-11T14:39:01.716999+0000","last_peered":"2024-09-11T14:39:01.716999+0000","last_clean":"2024-09-11T14:39:01.716999+0000","last_became_active":"2024-09-11T14:25:18.116721+0000","last_became_peered":"2024-09-11T14:25:18.116721+0000","last_unstale":"2024-09-11T14:39:01.716999+0000","last_undegraded":"2024-09-11T14:39:01.716999+0000","last_fullsized":"2024-09-11T14:39:01.716999+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721546+0000","last_change":"2024-09-11T14:25:17.963491+0000","last_active":"2024-09-11T14:39:01.721546+0000","last_peered":"2024-09-11T14:39:01.721546+0000","last_clean":"2024-09-11T14:39:01.721546+0000","last_became_active":"2024-09-11T14:25:17.956766+0000","last_became_peered":"2024-09-11T14:25:17.956766+0000","last_unstale":"2024-09-11T14:39:01.721546+0000","last_undegraded":"2024-09-11T14:39:01.721546+0000","last_fullsized":"2024-09-11T14:39:01.721546+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729097+0000","last_change":"2024-09-11T14:25:18.053878+0000","last_active":"2024-09-11T14:39:01.729097+0000","last_peered":"2024-09-11T14:39:01.729097+0000","last_clean":"2024-09-11T14:39:01.729097+0000","last_became_active":"2024-09-11T14:25:18.047823+0000","last_became_peered":"2024-09-11T14:25:18.047823+0000","last_unstale":"2024-09-11T14:39:01.729097+0000","last_undegraded":"2024-09-11T14:39:01.729097+0000","last_fullsized":"2024-09-11T14:39:01.729097+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.718601+0000","last_change":"2024-09-11T14:25:18.140132+0000","last_active":"2024-09-11T14:39:01.718601+0000","last_peered":"2024-09-11T14:39:01.718601+0000","last_clean":"2024-09-11T14:39:01.718601+0000","last_became_active":"2024-09-11T14:25:18.071958+0000","last_became_peered":"2024-09-11T14:25:18.071958+0000","last_unstale":"2024-09-11T14:39:01.718601+0000","last_undegraded":"2024-09-11T14:39:01.718601+0000","last_fullsized":"2024-09-11T14:39:01.718601+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.715774+0000","last_change":"2024-09-11T14:25:18.118269+0000","last_active":"2024-09-11T14:39:01.715774+0000","last_peered":"2024-09-11T14:39:01.715774+0000","last_clean":"2024-09-11T14:39:01.715774+0000","last_became_active":"2024-09-11T14:25:18.097464+0000","last_became_peered":"2024-09-11T14:25:18.097464+0000","last_unstale":"2024-09-11T14:39:01.715774+0000","last_undegraded":"2024-09-11T14:39:01.715774+0000","last_fullsized":"2024-09-11T14:39:01.715774+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726258+0000","last_change":"2024-09-11T14:25:18.235222+0000","last_active":"2024-09-11T14:39:01.726258+0000","last_peered":"2024-09-11T14:39:01.726258+0000","last_clean":"2024-09-11T14:39:01.726258+0000","last_became_active":"2024-09-11T14:25:18.228702+0000","last_became_peered":"2024-09-11T14:25:18.228702+0000","last_unstale":"2024-09-11T14:39:01.726258+0000","last_undegraded":"2024-09-11T14:39:01.726258+0000","last_fullsized":"2024-09-11T14:39:01.726258+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.730436+0000","last_change":"2024-09-11T14:25:18.105924+0000","last_active":"2024-09-11T14:39:01.730436+0000","last_peered":"2024-09-11T14:39:01.730436+0000","last_clean":"2024-09-11T14:39:01.730436+0000","last_became_active":"2024-09-11T14:25:18.076782+0000","last_became_peered":"2024-09-11T14:25:18.076782+0000","last_unstale":"2024-09-11T14:39:01.730436+0000","last_undegraded":"2024-09-11T14:39:01.730436+0000","last_fullsized":"2024-09-11T14:39:01.730436+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.724673+0000","last_change":"2024-09-11T14:25:18.108880+0000","last_active":"2024-09-11T14:39:01.724673+0000","last_peered":"2024-09-11T14:39:01.724673+0000","last_clean":"2024-09-11T14:39:01.724673+0000","last_became_active":"2024-09-11T14:25:18.090898+0000","last_became_peered":"2024-09-11T14:25:18.090898+0000","last_unstale":"2024-09-11T14:39:01.724673+0000","last_undegraded":"2024-09-11T14:39:01.724673+0000","last_fullsized":"2024-09-11T14:39:01.724673+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729038+0000","last_change":"2024-09-11T14:25:18.041164+0000","last_active":"2024-09-11T14:39:01.729038+0000","last_peered":"2024-09-11T14:39:01.729038+0000","last_clean":"2024-09-11T14:39:01.729038+0000","last_became_active":"2024-09-11T14:25:18.021680+0000","last_became_peered":"2024-09-11T14:25:18.021680+0000","last_unstale":"2024-09-11T14:39:01.729038+0000","last_undegraded":"2024-09-11T14:39:01.729038+0000","last_fullsized":"2024-09-11T14:39:01.729038+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727878+0000","last_change":"2024-09-11T14:25:18.005865+0000","last_active":"2024-09-11T14:39:01.727878+0000","last_peered":"2024-09-11T14:39:01.727878+0000","last_clean":"2024-09-11T14:39:01.727878+0000","last_became_active":"2024-09-11T14:25:17.997072+0000","last_became_peered":"2024-09-11T14:25:17.997072+0000","last_unstale":"2024-09-11T14:39:01.727878+0000","last_undegraded":"2024-09-11T14:39:01.727878+0000","last_fullsized":"2024-09-11T14:39:01.727878+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.708846+0000","last_change":"2024-09-11T14:25:18.065279+0000","last_active":"2024-09-11T14:39:01.708846+0000","last_peered":"2024-09-11T14:39:01.708846+0000","last_clean":"2024-09-11T14:39:01.708846+0000","last_became_active":"2024-09-11T14:25:18.024131+0000","last_became_peered":"2024-09-11T14:25:18.024131+0000","last_unstale":"2024-09-11T14:39:01.708846+0000","last_undegraded":"2024-09-11T14:39:01.708846+0000","last_fullsized":"2024-09-11T14:39:01.708846+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722562+0000","last_change":"2024-09-11T14:25:18.024308+0000","last_active":"2024-09-11T14:39:01.722562+0000","last_peered":"2024-09-11T14:39:01.722562+0000","last_clean":"2024-09-11T14:39:01.722562+0000","last_became_active":"2024-09-11T14:25:18.002727+0000","last_became_peered":"2024-09-11T14:25:18.002727+0000","last_unstale":"2024-09-11T14:39:01.722562+0000","last_undegraded":"2024-09-11T14:39:01.722562+0000","last_fullsized":"2024-09-11T14:39:01.722562+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713328+0000","last_change":"2024-09-11T14:25:18.184581+0000","last_active":"2024-09-11T14:39:01.713328+0000","last_peered":"2024-09-11T14:39:01.713328+0000","last_clean":"2024-09-11T14:39:01.713328+0000","last_became_active":"2024-09-11T14:25:18.176059+0000","last_became_peered":"2024-09-11T14:25:18.176059+0000","last_unstale":"2024-09-11T14:39:01.713328+0000","last_undegraded":"2024-09-11T14:39:01.713328+0000","last_fullsized":"2024-09-11T14:39:01.713328+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726404+0000","last_change":"2024-09-11T14:25:18.085645+0000","last_active":"2024-09-11T14:39:01.726404+0000","last_peered":"2024-09-11T14:39:01.726404+0000","last_clean":"2024-09-11T14:39:01.726404+0000","last_became_active":"2024-09-11T14:25:18.032463+0000","last_became_peered":"2024-09-11T14:25:18.032463+0000","last_unstale":"2024-09-11T14:39:01.726404+0000","last_undegraded":"2024-09-11T14:39:01.726404+0000","last_fullsized":"2024-09-11T14:39:01.726404+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720622+0000","last_change":"2024-09-11T14:25:18.104584+0000","last_active":"2024-09-11T14:39:01.720622+0000","last_peered":"2024-09-11T14:39:01.720622+0000","last_clean":"2024-09-11T14:39:01.720622+0000","last_became_active":"2024-09-11T14:25:18.095787+0000","last_became_peered":"2024-09-11T14:25:18.095787+0000","last_unstale":"2024-09-11T14:39:01.720622+0000","last_undegraded":"2024-09-11T14:39:01.720622+0000","last_fullsized":"2024-09-11T14:39:01.720622+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.710903+0000","last_change":"2024-09-11T14:25:18.032561+0000","last_active":"2024-09-11T14:39:01.710903+0000","last_peered":"2024-09-11T14:39:01.710903+0000","last_clean":"2024-09-11T14:39:01.710903+0000","last_became_active":"2024-09-11T14:25:18.008366+0000","last_became_peered":"2024-09-11T14:25:18.008366+0000","last_unstale":"2024-09-11T14:39:01.710903+0000","last_undegraded":"2024-09-11T14:39:01.710903+0000","last_fullsized":"2024-09-11T14:39:01.710903+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720656+0000","last_change":"2024-09-11T14:25:18.036132+0000","last_active":"2024-09-11T14:39:01.720656+0000","last_peered":"2024-09-11T14:39:01.720656+0000","last_clean":"2024-09-11T14:39:01.720656+0000","last_became_active":"2024-09-11T14:25:17.998831+0000","last_became_peered":"2024-09-11T14:25:17.998831+0000","last_unstale":"2024-09-11T14:39:01.720656+0000","last_undegraded":"2024-09-11T14:39:01.720656+0000","last_fullsized":"2024-09-11T14:39:01.720656+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726698+0000","last_change":"2024-09-11T14:25:18.024958+0000","last_active":"2024-09-11T14:39:01.726698+0000","last_peered":"2024-09-11T14:39:01.726698+0000","last_clean":"2024-09-11T14:39:01.726698+0000","last_became_active":"2024-09-11T14:25:17.997086+0000","last_became_peered":"2024-09-11T14:25:17.997086+0000","last_unstale":"2024-09-11T14:39:01.726698+0000","last_undegraded":"2024-09-11T14:39:01.726698+0000","last_fullsized":"2024-09-11T14:39:01.726698+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.719520+0000","last_change":"2024-09-11T14:25:17.998094+0000","last_active":"2024-09-11T14:39:01.719520+0000","last_peered":"2024-09-11T14:39:01.719520+0000","last_clean":"2024-09-11T14:39:01.719520+0000","last_became_active":"2024-09-11T14:25:17.975159+0000","last_became_peered":"2024-09-11T14:25:17.975159+0000","last_unstale":"2024-09-11T14:39:01.719520+0000","last_undegraded":"2024-09-11T14:39:01.719520+0000","last_fullsized":"2024-09-11T14:39:01.719520+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.714922+0000","last_change":"2024-09-11T14:25:18.052250+0000","last_active":"2024-09-11T14:39:01.714922+0000","last_peered":"2024-09-11T14:39:01.714922+0000","last_clean":"2024-09-11T14:39:01.714922+0000","last_became_active":"2024-09-11T14:25:17.980204+0000","last_became_peered":"2024-09-11T14:25:17.980204+0000","last_unstale":"2024-09-11T14:39:01.714922+0000","last_undegraded":"2024-09-11T14:39:01.714922+0000","last_fullsized":"2024-09-11T14:39:01.714922+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727283+0000","last_change":"2024-09-11T14:25:18.067709+0000","last_active":"2024-09-11T14:39:01.727283+0000","last_peered":"2024-09-11T14:39:01.727283+0000","last_clean":"2024-09-11T14:39:01.727283+0000","last_became_active":"2024-09-11T14:25:18.045624+0000","last_became_peered":"2024-09-11T14:25:18.045624+0000","last_unstale":"2024-09-11T14:39:01.727283+0000","last_undegraded":"2024-09-11T14:39:01.727283+0000","last_fullsized":"2024-09-11T14:39:01.727283+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727546+0000","last_change":"2024-09-11T14:25:18.149907+0000","last_active":"2024-09-11T14:39:01.727546+0000","last_peered":"2024-09-11T14:39:01.727546+0000","last_clean":"2024-09-11T14:39:01.727546+0000","last_became_active":"2024-09-11T14:25:18.059476+0000","last_became_peered":"2024-09-11T14:25:18.059476+0000","last_unstale":"2024-09-11T14:39:01.727546+0000","last_undegraded":"2024-09-11T14:39:01.727546+0000","last_fullsized":"2024-09-11T14:39:01.727546+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1479,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722147+0000","last_change":"2024-09-11T14:25:17.995302+0000","last_active":"2024-09-11T14:39:01.722147+0000","last_peered":"2024-09-11T14:39:01.722147+0000","last_clean":"2024-09-11T14:39:01.722147+0000","last_became_active":"2024-09-11T14:25:17.965924+0000","last_became_peered":"2024-09-11T14:25:17.965924+0000","last_unstale":"2024-09-11T14:39:01.722147+0000","last_undegraded":"2024-09-11T14:39:01.722147+0000","last_fullsized":"2024-09-11T14:39:01.722147+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721971+0000","last_change":"2024-09-11T14:25:18.017389+0000","last_active":"2024-09-11T14:39:01.721971+0000","last_peered":"2024-09-11T14:39:01.721971+0000","last_clean":"2024-09-11T14:39:01.721971+0000","last_became_active":"2024-09-11T14:25:18.009130+0000","last_became_peered":"2024-09-11T14:25:18.009130+0000","last_unstale":"2024-09-11T14:39:01.721971+0000","last_undegraded":"2024-09-11T14:39:01.721971+0000","last_fullsized":"2024-09-11T14:39:01.721971+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.725196+0000","last_change":"2024-09-11T14:20:05.441963+0000","last_active":"2024-09-11T14:39:01.725196+0000","last_peered":"2024-09-11T14:39:01.725196+0000","last_clean":"2024-09-11T14:39:01.725196+0000","last_became_active":"2024-09-11T14:20:03.484694+0000","last_became_peered":"2024-09-11T14:20:03.484694+0000","last_unstale":"2024-09-11T14:39:01.725196+0000","last_undegraded":"2024-09-11T14:39:01.725196+0000","last_fullsized":"2024-09-11T14:39:01.725196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.716804+0000","last_change":"2024-09-11T14:20:05.440901+0000","last_active":"2024-09-11T14:39:01.716804+0000","last_peered":"2024-09-11T14:39:01.716804+0000","last_clean":"2024-09-11T14:39:01.716804+0000","last_became_active":"2024-09-11T14:20:03.517121+0000","last_became_peered":"2024-09-11T14:20:03.517121+0000","last_unstale":"2024-09-11T14:39:01.716804+0000","last_undegraded":"2024-09-11T14:39:01.716804+0000","last_fullsized":"2024-09-11T14:39:01.716804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729794+0000","last_change":"2024-09-11T14:20:05.436801+0000","last_active":"2024-09-11T14:39:01.729794+0000","last_peered":"2024-09-11T14:39:01.729794+0000","last_clean":"2024-09-11T14:39:01.729794+0000","last_became_active":"2024-09-11T14:20:03.488911+0000","last_became_peered":"2024-09-11T14:20:03.488911+0000","last_unstale":"2024-09-11T14:39:01.729794+0000","last_undegraded":"2024-09-11T14:39:01.729794+0000","last_fullsized":"2024-09-11T14:39:01.729794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713302+0000","last_change":"2024-09-11T14:20:05.435707+0000","last_active":"2024-09-11T14:39:01.713302+0000","last_peered":"2024-09-11T14:39:01.713302+0000","last_clean":"2024-09-11T14:39:01.713302+0000","last_became_active":"2024-09-11T14:20:03.480359+0000","last_became_peered":"2024-09-11T14:20:03.480359+0000","last_unstale":"2024-09-11T14:39:01.713302+0000","last_undegraded":"2024-09-11T14:39:01.713302+0000","last_fullsized":"2024-09-11T14:39:01.713302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2147,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.731932+0000","last_change":"2024-09-11T14:20:05.443617+0000","last_active":"2024-09-11T14:39:01.731932+0000","last_peered":"2024-09-11T14:39:01.731932+0000","last_clean":"2024-09-11T14:39:01.731932+0000","last_became_active":"2024-09-11T14:20:03.479775+0000","last_became_peered":"2024-09-11T14:20:03.479775+0000","last_unstale":"2024-09-11T14:39:01.731932+0000","last_undegraded":"2024-09-11T14:39:01.731932+0000","last_fullsized":"2024-09-11T14:39:01.731932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713868+0000","last_change":"2024-09-11T14:20:05.435614+0000","last_active":"2024-09-11T14:39:01.713868+0000","last_peered":"2024-09-11T14:39:01.713868+0000","last_clean":"2024-09-11T14:39:01.713868+0000","last_became_active":"2024-09-11T14:20:03.469827+0000","last_became_peered":"2024-09-11T14:20:03.469827+0000","last_unstale":"2024-09-11T14:39:01.713868+0000","last_undegraded":"2024-09-11T14:39:01.713868+0000","last_fullsized":"2024-09-11T14:39:01.713868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2145,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721904+0000","last_change":"2024-09-11T14:20:05.442983+0000","last_active":"2024-09-11T14:39:01.721904+0000","last_peered":"2024-09-11T14:39:01.721904+0000","last_clean":"2024-09-11T14:39:01.721904+0000","last_became_active":"2024-09-11T14:20:03.491981+0000","last_became_peered":"2024-09-11T14:20:03.491981+0000","last_unstale":"2024-09-11T14:39:01.721904+0000","last_undegraded":"2024-09-11T14:39:01.721904+0000","last_fullsized":"2024-09-11T14:39:01.721904+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2152,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.730323+0000","last_change":"2024-09-11T14:20:05.440350+0000","last_active":"2024-09-11T14:39:01.730323+0000","last_peered":"2024-09-11T14:39:01.730323+0000","last_clean":"2024-09-11T14:39:01.730323+0000","last_became_active":"2024-09-11T14:20:03.498001+0000","last_became_peered":"2024-09-11T14:20:03.498001+0000","last_unstale":"2024-09-11T14:39:01.730323+0000","last_undegraded":"2024-09-11T14:39:01.730323+0000","last_fullsized":"2024-09-11T14:39:01.730323+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2223,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.714639+0000","last_change":"2024-09-11T14:20:01.465936+0000","last_active":"2024-09-11T14:39:01.714639+0000","last_peered":"2024-09-11T14:39:01.714639+0000","last_clean":"2024-09-11T14:39:01.714639+0000","last_became_active":"2024-09-11T14:20:01.446610+0000","last_became_peered":"2024-09-11T14:20:01.446610+0000","last_unstale":"2024-09-11T14:39:01.714639+0000","last_undegraded":"2024-09-11T14:39:01.714639+0000","last_fullsized":"2024-09-11T14:39:01.714639+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_clean_scrub_stamp":"2024-09-11T14:20:00.391487+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6212,"kb_used_data":6212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291516,"statfs":{"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5264,"kb_used_data":5264,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292464,"statfs":{"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5100,"kb_used_data":5100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292628,"statfs":{"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6760,"kb_used_data":6760,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290968,"statfs":{"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:35.425 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T14:39:35.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.532+0000 7f316b0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:35.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.537+0000 7f316b0bd640 1 Processor -- start 2024-09-11T14:39:35.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.537+0000 7f316b0bd640 1 -- start start 2024-09-11T14:39:35.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.538+0000 7f316b0bd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3164132520 0x7f3164132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:35.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f316b0bd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316406f6d0 con 0x7f31640a3450 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f316b0bd640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f316406f3d0 con 0x7f3164132520 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f3168e59640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3164132520 0x7f3164132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f3163fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f31640a3450 0x7f31640a3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41076/0 (socket says 172.21.15.46:41076) 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f3168e59640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3164132520 0x7f3164132930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55226/0 (socket says 172.21.15.46:55226) 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f3163fff640 1 -- 172.21.15.46:0/78540749 learned_addr learned my addr 172.21.15.46:0/78540749 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f3168e59640 1 -- 172.21.15.46:0/78540749 >> v1:172.21.15.46:6789/0 conn(0x7f31640a3450 legacy=0x7f31640a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f3168e59640 1 -- 172.21.15.46:0/78540749 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316406f0c0 con 0x7f3164132520 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f31637fe640 1 -- 172.21.15.46:0/78540749 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540364738 0 0) 0x7f316406f6d0 con 0x7f31640a3450 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f3168e59640 1 --2- 172.21.15.46:0/78540749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3164132520 0x7f3164132930 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf422aafa4fb3840 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f31637fe640 1 -- 172.21.15.46:0/78540749 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3158009d90 con 0x7f3164132520 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f31637fe640 1 -- 172.21.15.46:0/78540749 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f315800e230 con 0x7f3164132520 2024-09-11T14:39:35.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.539+0000 7f31637fe640 1 -- 172.21.15.46:0/78540749 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f315800e4d0 con 0x7f3164132520 2024-09-11T14:39:35.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.540+0000 7f316b0bd640 1 -- 172.21.15.46:0/78540749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3164132520 msgr2=0x7f3164132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.540+0000 7f316b0bd640 1 --2- 172.21.15.46:0/78540749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3164132520 0x7f3164132930 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.540+0000 7f316b0bd640 1 -- 172.21.15.46:0/78540749 shutdown_connections 2024-09-11T14:39:35.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.540+0000 7f316b0bd640 1 --2- 172.21.15.46:0/78540749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3164132520 0x7f3164132930 unknown :-1 s=CLOSED pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.540+0000 7f316b0bd640 1 -- 172.21.15.46:0/78540749 >> 172.21.15.46:0/78540749 conn(0x7f316406e490 msgr2=0x7f316406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:35.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.540+0000 7f316b0bd640 1 -- 172.21.15.46:0/78540749 shutdown_connections 2024-09-11T14:39:35.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.540+0000 7f316b0bd640 1 -- 172.21.15.46:0/78540749 wait complete. 2024-09-11T14:39:35.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.540+0000 7f316b0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.542+0000 7f316b0bd640 1 Processor -- start 2024-09-11T14:39:35.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.542+0000 7f316b0bd640 1 -- start start 2024-09-11T14:39:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.544+0000 7f316b0bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31640a3450 0x7f316411e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.544+0000 7f316b0bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3164121ed0 con 0x7f31640a3450 2024-09-11T14:39:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.544+0000 7f3168e59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31640a3450 0x7f316411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.544+0000 7f3168e59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31640a3450 0x7f316411e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55236/0 (socket says 172.21.15.46:55236) 2024-09-11T14:39:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.544+0000 7f3168e59640 1 -- 172.21.15.46:0/1578998897 learned_addr learned my addr 172.21.15.46:0/1578998897 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.544+0000 7f3168e59640 1 -- 172.21.15.46:0/1578998897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3164121aa0 con 0x7f31640a3450 2024-09-11T14:39:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.544+0000 7f3168e59640 1 --2- 172.21.15.46:0/1578998897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31640a3450 0x7f316411e090 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:35.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.545+0000 7f31617fa640 1 -- 172.21.15.46:0/1578998897 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3158014540 con 0x7f31640a3450 2024-09-11T14:39:35.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.545+0000 7f31617fa640 1 -- 172.21.15.46:0/1578998897 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f31580146a0 con 0x7f31640a3450 2024-09-11T14:39:35.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.545+0000 7f31617fa640 1 -- 172.21.15.46:0/1578998897 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3158014940 con 0x7f31640a3450 2024-09-11T14:39:35.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.545+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3164135780 con 0x7f31640a3450 2024-09-11T14:39:35.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.545+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3164121790 con 0x7f31640a3450 2024-09-11T14:39:35.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.546+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316406a300 con 0x7f31640a3450 2024-09-11T14:39:35.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.546+0000 7f31617fa640 1 -- 172.21.15.46:0/1578998897 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f3158014b40 con 0x7f31640a3450 2024-09-11T14:39:35.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.546+0000 7f31617fa640 1 --2- 172.21.15.46:0/1578998897 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314803e8e0 0x7f3148040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:35.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.546+0000 7f31617fa640 1 -- 172.21.15.46:0/1578998897 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f3158019040 con 0x7f31640a3450 2024-09-11T14:39:35.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.546+0000 7f3163fff640 1 --2- 172.21.15.46:0/1578998897 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314803e8e0 0x7f3148040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:35.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.547+0000 7f3163fff640 1 --2- 172.21.15.46:0/1578998897 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314803e8e0 0x7f3148040df0 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:35.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.551+0000 7f31617fa640 1 -- 172.21.15.46:0/1578998897 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f3158011380 con 0x7f31640a3450 2024-09-11T14:39:35.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.738+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3164120120 con 0x7f31640a3450 2024-09-11T14:39:35.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.739+0000 7f31617fa640 1 -- 172.21.15.46:0/1578998897 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v729) ==== 74+0+11263 (crc 0 0 0) 0x7f3158018190 con 0x7f31640a3450 2024-09-11T14:39:35.741 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:39:35.741 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":729,"fsid":"1036f700-a934-4ca9-974c-2362e4adfb5d","created":"2024-09-11T14:19:51.780788+0000","modified":"2024-09-11T14:39:33.680989+0000","last_up_change":"2024-09-11T14:19:58.389280+0000","last_in_change":"2024-09-11T14:19:53.927574+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":200,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T14:20:00.363613+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T14:20:02.154593+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-09-11T14:25:16.042510+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"242","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38ba4d14-fba0-43ad-8341-3a4dff407458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":716,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6801","nonce":1724049974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1724049974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":1724049974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":1724049974}]},"public_addr":"172.21.15.46:6801/1724049974","cluster_addr":"172.21.15.46:6800/1724049974","heartbeat_back_addr":"172.21.15.46:6807/1724049974","heartbeat_front_addr":"172.21.15.46:6809/1724049974","state":["exists","up"]},{"osd":1,"uuid":"981ffb3f-b14b-49fd-bbed-bc853a1bb77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":716,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":1751227380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1751227380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":1751227380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":1751227380}]},"public_addr":"172.21.15.46:6805/1751227380","cluster_addr":"172.21.15.46:6804/1751227380","heartbeat_back_addr":"172.21.15.46:6816/1751227380","heartbeat_front_addr":"172.21.15.46:6815/1751227380","state":["exists","up"]},{"osd":2,"uuid":"3e1c22fb-cf45-43cd-a45c-d546b44d973b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":716,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6803","nonce":3757354244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":3757354244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":3757354244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6811","nonce":3757354244}]},"public_addr":"172.21.15.47:6803/3757354244","cluster_addr":"172.21.15.47:6802/3757354244","heartbeat_back_addr":"172.21.15.47:6810/3757354244","heartbeat_front_addr":"172.21.15.47:6811/3757354244","state":["exists","up"]},{"osd":3,"uuid":"9c1ff14e-10e9-4e46-9343-d3368a835700","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":716,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6805","nonce":1666238977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":1666238977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1666238977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6807","nonce":1666238977}]},"public_addr":"172.21.15.47:6805/1666238977","cluster_addr":"172.21.15.47:6804/1666238977","heartbeat_back_addr":"172.21.15.47:6808/1666238977","heartbeat_front_addr":"172.21.15.47:6807/1666238977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":9},{"begin":14,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":179,"snaps":[{"begin":1,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":2}]},{"pool":184,"snaps":[{"begin":3,"length":1}]},{"pool":187,"snaps":[{"begin":2,"length":2}]},{"pool":189,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T14:39:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314803e8e0 msgr2=0x7f3148040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 --2- 172.21.15.46:0/1578998897 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314803e8e0 0x7f3148040df0 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31640a3450 msgr2=0x7f316411e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 --2- 172.21.15.46:0/1578998897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31640a3450 0x7f316411e090 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 shutdown_connections 2024-09-11T14:39:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 --2- 172.21.15.46:0/1578998897 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314803e8e0 0x7f3148040df0 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 --2- 172.21.15.46:0/1578998897 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31640a3450 0x7f316411e090 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 >> 172.21.15.46:0/1578998897 conn(0x7f316406e490 msgr2=0x7f31640a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 shutdown_connections 2024-09-11T14:39:35.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:35.742+0000 7f316b0bd640 1 -- 172.21.15.46:0/1578998897 wait complete. 2024-09-11T14:39:36.756 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T14:39:36.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:39:36.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.878+0000 7f46a4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:36.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.888+0000 7f46a4791640 1 Processor -- start 2024-09-11T14:39:36.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.888+0000 7f46a4791640 1 -- start start 2024-09-11T14:39:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.890+0000 7f46a4791640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f469c09ec50 0x7f469c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.890+0000 7f46a4791640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469c0a0d00 con 0x7f469c06d380 2024-09-11T14:39:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.890+0000 7f46a4791640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f469c0a0a30 con 0x7f469c09ec50 2024-09-11T14:39:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.890+0000 7f46a252d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f469c09ec50 0x7f469c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.890+0000 7f46a1d2c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f469c06d380 0x7f469c12ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41082/0 (socket says 172.21.15.46:41082) 2024-09-11T14:39:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.890+0000 7f46a1d2c640 1 -- 172.21.15.46:0/1354521533 learned_addr learned my addr 172.21.15.46:0/1354521533 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.890+0000 7f46a252d640 1 -- 172.21.15.46:0/1354521533 >> v1:172.21.15.46:6789/0 conn(0x7f469c06d380 legacy=0x7f469c12ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.890+0000 7f46a152b640 1 -- 172.21.15.46:0/1354521533 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076390566 0 0) 0x7f469c0a0d00 con 0x7f469c06d380 2024-09-11T14:39:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.890+0000 7f46a252d640 1 -- 172.21.15.46:0/1354521533 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c0710b0 con 0x7f469c09ec50 2024-09-11T14:39:36.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.891+0000 7f46a252d640 1 --2- 172.21.15.46:0/1354521533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c09ec50 0x7f469c06ce40 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c48c422896ebbb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.891+0000 7f46a152b640 1 -- 172.21.15.46:0/1354521533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4698009d90 con 0x7f469c09ec50 2024-09-11T14:39:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.891+0000 7f46a152b640 1 -- 172.21.15.46:0/1354521533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f469800e230 con 0x7f469c09ec50 2024-09-11T14:39:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.891+0000 7f46a152b640 1 -- 172.21.15.46:0/1354521533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f469800e4d0 con 0x7f469c09ec50 2024-09-11T14:39:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.891+0000 7f46a4791640 1 -- 172.21.15.46:0/1354521533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c09ec50 msgr2=0x7f469c06ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.891+0000 7f46a4791640 1 --2- 172.21.15.46:0/1354521533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c09ec50 0x7f469c06ce40 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:36.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.892+0000 7f46a4791640 1 -- 172.21.15.46:0/1354521533 shutdown_connections 2024-09-11T14:39:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.892+0000 7f46a4791640 1 --2- 172.21.15.46:0/1354521533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c09ec50 0x7f469c06ce40 unknown :-1 s=CLOSED pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.892+0000 7f46a4791640 1 -- 172.21.15.46:0/1354521533 >> 172.21.15.46:0/1354521533 conn(0x7f469c069d10 msgr2=0x7f469c09f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.892+0000 7f46a4791640 1 -- 172.21.15.46:0/1354521533 shutdown_connections 2024-09-11T14:39:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.892+0000 7f46a4791640 1 -- 172.21.15.46:0/1354521533 wait complete. 2024-09-11T14:39:36.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.892+0000 7f46a4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:36.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.894+0000 7f46a4791640 1 Processor -- start 2024-09-11T14:39:36.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.894+0000 7f46a4791640 1 -- start start 2024-09-11T14:39:36.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.895+0000 7f46a4791640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c06d380 0x7f469c124bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:36.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.895+0000 7f46a4791640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1246a0 con 0x7f469c06d380 2024-09-11T14:39:36.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.895+0000 7f46a252d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c06d380 0x7f469c124bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:36.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.895+0000 7f46a252d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c06d380 0x7f469c124bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55258/0 (socket says 172.21.15.46:55258) 2024-09-11T14:39:36.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.895+0000 7f46a252d640 1 -- 172.21.15.46:0/2353125320 learned_addr learned my addr 172.21.15.46:0/2353125320 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:36.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.896+0000 7f46a252d640 1 -- 172.21.15.46:0/2353125320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c124300 con 0x7f469c06d380 2024-09-11T14:39:36.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.896+0000 7f46a252d640 1 --2- 172.21.15.46:0/2353125320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c06d380 0x7f469c124bf0 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:36.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.896+0000 7f4692ffd640 1 -- 172.21.15.46:0/2353125320 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4698013530 con 0x7f469c06d380 2024-09-11T14:39:36.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.896+0000 7f4692ffd640 1 -- 172.21.15.46:0/2353125320 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4698013690 con 0x7f469c06d380 2024-09-11T14:39:36.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.896+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c123660 con 0x7f469c06d380 2024-09-11T14:39:36.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.896+0000 7f4692ffd640 1 -- 172.21.15.46:0/2353125320 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4698013930 con 0x7f469c06d380 2024-09-11T14:39:36.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.896+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c12fc30 con 0x7f469c06d380 2024-09-11T14:39:36.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.897+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f469c06ce40 con 0x7f469c06d380 2024-09-11T14:39:36.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.897+0000 7f4692ffd640 1 -- 172.21.15.46:0/2353125320 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f4698013b30 con 0x7f469c06d380 2024-09-11T14:39:36.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.897+0000 7f4692ffd640 1 --2- 172.21.15.46:0/2353125320 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f468003e910 0x7f4680040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:36.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.897+0000 7f4692ffd640 1 -- 172.21.15.46:0/2353125320 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f4698018040 con 0x7f469c06d380 2024-09-11T14:39:36.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.898+0000 7f4692ffd640 1 --2- 172.21.15.46:0/2353125320 >> v2:172.21.15.46:6801/1724049974 conn(0x7f4680044a50 0x7f4680046f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:36.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.898+0000 7f4692ffd640 1 -- 172.21.15.46:0/2353125320 --> v2:172.21.15.46:6801/1724049974 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46800475d0 con 0x7f4680044a50 2024-09-11T14:39:36.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.898+0000 7f4692ffd640 1 -- 172.21.15.46:0/2353125320 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=729) ==== 24+0+0 (crc 0 0 0) 0x7f46980536c0 con 0x7f469c06d380 2024-09-11T14:39:36.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.898+0000 7f46a1d2c640 1 --2- 172.21.15.46:0/2353125320 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f468003e910 0x7f4680040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:36.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.898+0000 7f46a1d2c640 1 --2- 172.21.15.46:0/2353125320 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f468003e910 0x7f4680040e20 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:36.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.899+0000 7f46a2d2e640 1 --2- 172.21.15.46:0/2353125320 >> v2:172.21.15.46:6801/1724049974 conn(0x7f4680044a50 0x7f4680046f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:39:36.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.902+0000 7f46a2d2e640 1 --2- 172.21.15.46:0/2353125320 >> v2:172.21.15.46:6801/1724049974 conn(0x7f4680044a50 0x7f4680046f40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:36.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.904+0000 7f4692ffd640 1 -- 172.21.15.46:0/2353125320 <== osd.0 v2:172.21.15.46:6801/1724049974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f46800475d0 con 0x7f4680044a50 2024-09-11T14:39:36.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.907+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 --> v2:172.21.15.46:6801/1724049974 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f469c09eea0 con 0x7f4680044a50 2024-09-11T14:39:36.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f4692ffd640 1 -- 172.21.15.46:0/2353125320 <== osd.0 v2:172.21.15.46:6801/1724049974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f469c09eea0 con 0x7f4680044a50 2024-09-11T14:39:36.910 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-11T14:39:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "" 2024-09-11T14:39:36.911 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-11T14:39:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 >> v2:172.21.15.46:6801/1724049974 conn(0x7f4680044a50 msgr2=0x7f4680046f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 --2- 172.21.15.46:0/2353125320 >> v2:172.21.15.46:6801/1724049974 conn(0x7f4680044a50 0x7f4680046f40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f468003e910 msgr2=0x7f4680040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 --2- 172.21.15.46:0/2353125320 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f468003e910 0x7f4680040e20 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c06d380 msgr2=0x7f469c124bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:36.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 --2- 172.21.15.46:0/2353125320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c06d380 0x7f469c124bf0 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:36.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 shutdown_connections 2024-09-11T14:39:36.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 --2- 172.21.15.46:0/2353125320 >> v2:172.21.15.46:6801/1724049974 conn(0x7f4680044a50 0x7f4680046f40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:36.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 --2- 172.21.15.46:0/2353125320 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f468003e910 0x7f4680040e20 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:36.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 --2- 172.21.15.46:0/2353125320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f469c06d380 0x7f469c124bf0 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:36.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 >> 172.21.15.46:0/2353125320 conn(0x7f469c069d10 msgr2=0x7f469c1337c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:36.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.909+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 shutdown_connections 2024-09-11T14:39:36.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:36.910+0000 7f46a4791640 1 -- 172.21.15.46:0/2353125320 wait complete. 2024-09-11T14:39:36.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T14:39:37.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.029+0000 7f315a4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:37.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.036+0000 7f315a4c8640 1 Processor -- start 2024-09-11T14:39:37.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.036+0000 7f315a4c8640 1 -- start start 2024-09-11T14:39:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.038+0000 7f315a4c8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f315406d550 0x7f31541386d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.038+0000 7f315a4c8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31540a0d00 con 0x7f315409ec50 2024-09-11T14:39:37.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.038+0000 7f315a4c8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f31540a0a30 con 0x7f315406d550 2024-09-11T14:39:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.038+0000 7f3153fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f315409ec50 0x7f315406ce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:41084/0 (socket says 172.21.15.46:41084) 2024-09-11T14:39:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.038+0000 7f3153fff640 1 -- 172.21.15.46:0/969094775 learned_addr learned my addr 172.21.15.46:0/969094775 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.038+0000 7f31537fe640 1 --2- 172.21.15.46:0/969094775 >> v2:172.21.15.46:3300/0 conn(0x7f315406d550 0x7f31541386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.038+0000 7f31537fe640 1 -- 172.21.15.46:0/969094775 >> v1:172.21.15.46:6789/0 conn(0x7f315409ec50 legacy=0x7f315406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.038+0000 7f31537fe640 1 -- 172.21.15.46:0/969094775 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31540710b0 con 0x7f315406d550 2024-09-11T14:39:37.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.038+0000 7f31537fe640 1 --2- 172.21.15.46:0/969094775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 0x7f31541386d0 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a7dd3a48bc5148 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.039+0000 7f3152ffd640 1 -- 172.21.15.46:0/969094775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3148009d90 con 0x7f315406d550 2024-09-11T14:39:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.040+0000 7f3152ffd640 1 -- 172.21.15.46:0/969094775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f314800e230 con 0x7f315406d550 2024-09-11T14:39:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.040+0000 7f3152ffd640 1 -- 172.21.15.46:0/969094775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f314800e4d0 con 0x7f315406d550 2024-09-11T14:39:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.040+0000 7f315a4c8640 1 -- 172.21.15.46:0/969094775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 msgr2=0x7f31541386d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.040+0000 7f315a4c8640 1 --2- 172.21.15.46:0/969094775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 0x7f31541386d0 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.040+0000 7f315a4c8640 1 -- 172.21.15.46:0/969094775 shutdown_connections 2024-09-11T14:39:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.040+0000 7f315a4c8640 1 --2- 172.21.15.46:0/969094775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 0x7f31541386d0 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.040+0000 7f315a4c8640 1 -- 172.21.15.46:0/969094775 >> 172.21.15.46:0/969094775 conn(0x7f3154069d10 msgr2=0x7f315409f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.041+0000 7f315a4c8640 1 -- 172.21.15.46:0/969094775 shutdown_connections 2024-09-11T14:39:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.041+0000 7f315a4c8640 1 -- 172.21.15.46:0/969094775 wait complete. 2024-09-11T14:39:37.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.041+0000 7f315a4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:37.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.043+0000 7f315a4c8640 1 Processor -- start 2024-09-11T14:39:37.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.043+0000 7f315a4c8640 1 -- start start 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.044+0000 7f315a4c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 0x7f315409bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.044+0000 7f315a4c8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f315409cf50 con 0x7f315406d550 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f3153fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 0x7f315409bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f3153fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 0x7f315409bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55268/0 (socket says 172.21.15.46:55268) 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f3153fff640 1 -- 172.21.15.46:0/788810264 learned_addr learned my addr 172.21.15.46:0/788810264 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f3153fff640 1 -- 172.21.15.46:0/788810264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315409d570 con 0x7f315406d550 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f3153fff640 1 --2- 172.21.15.46:0/788810264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 0x7f315409bb00 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f3150ff9640 1 -- 172.21.15.46:0/788810264 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3144005a60 con 0x7f315406d550 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f3150ff9640 1 -- 172.21.15.46:0/788810264 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3144005bc0 con 0x7f315406d550 2024-09-11T14:39:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315409cbb0 con 0x7f315406d550 2024-09-11T14:39:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f3150ff9640 1 -- 172.21.15.46:0/788810264 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3144005e60 con 0x7f315406d550 2024-09-11T14:39:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.045+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31541257a0 con 0x7f315406d550 2024-09-11T14:39:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.046+0000 7f3150ff9640 1 -- 172.21.15.46:0/788810264 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f314400c820 con 0x7f315406d550 2024-09-11T14:39:37.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.046+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315406ce40 con 0x7f315406d550 2024-09-11T14:39:37.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.047+0000 7f3150ff9640 1 --2- 172.21.15.46:0/788810264 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314003e930 0x7f3140040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.047+0000 7f3150ff9640 1 -- 172.21.15.46:0/788810264 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f314404f9b0 con 0x7f315406d550 2024-09-11T14:39:37.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.047+0000 7f31537fe640 1 --2- 172.21.15.46:0/788810264 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314003e930 0x7f3140040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.048+0000 7f31537fe640 1 --2- 172.21.15.46:0/788810264 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314003e930 0x7f3140040e40 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.052+0000 7f3150ff9640 1 -- 172.21.15.46:0/788810264 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f314400dc60 con 0x7f315406d550 2024-09-11T14:39:37.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.237+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f3154125cb0 con 0x7f314003e930 2024-09-11T14:39:37.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.238+0000 7f3150ff9640 1 -- 172.21.15.46:0/788810264 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f314800e3a0 con 0x7f314003e930 2024-09-11T14:39:37.239 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T14:39:37.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314003e930 msgr2=0x7f3140040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 --2- 172.21.15.46:0/788810264 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314003e930 0x7f3140040e40 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 msgr2=0x7f315409bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 --2- 172.21.15.46:0/788810264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 0x7f315409bb00 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 shutdown_connections 2024-09-11T14:39:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 --2- 172.21.15.46:0/788810264 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f314003e930 0x7f3140040e40 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 --2- 172.21.15.46:0/788810264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f315406d550 0x7f315409bb00 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 >> 172.21.15.46:0/788810264 conn(0x7f3154069d10 msgr2=0x7f31540a26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 shutdown_connections 2024-09-11T14:39:37.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.240+0000 7f315a4c8640 1 -- 172.21.15.46:0/788810264 wait complete. 2024-09-11T14:39:37.257 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T14:39:37.257 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:39:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.374+0000 7f6908ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.383+0000 7f6908ed1640 1 Processor -- start 2024-09-11T14:39:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.383+0000 7f6908ed1640 1 -- start start 2024-09-11T14:39:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.385+0000 7f6908ed1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f690409ec50 0x7f690406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.385+0000 7f6908ed1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69040a0d00 con 0x7f690406d380 2024-09-11T14:39:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.385+0000 7f6908ed1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f69040a0a30 con 0x7f690409ec50 2024-09-11T14:39:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.385+0000 7f690259c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f690409ec50 0x7f690406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.385+0000 7f6901d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f690406d380 0x7f690412ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57188/0 (socket says 172.21.15.46:57188) 2024-09-11T14:39:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.385+0000 7f6901d9b640 1 -- 172.21.15.46:0/660378939 learned_addr learned my addr 172.21.15.46:0/660378939 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.385+0000 7f690259c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f690409ec50 0x7f690406ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40516/0 (socket says 172.21.15.46:40516) 2024-09-11T14:39:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.386+0000 7f690259c640 1 -- 172.21.15.46:0/660378939 >> v1:172.21.15.46:6789/0 conn(0x7f690406d380 legacy=0x7f690412ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.386+0000 7f690259c640 1 -- 172.21.15.46:0/660378939 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69040710b0 con 0x7f690409ec50 2024-09-11T14:39:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.386+0000 7f690259c640 1 --2- 172.21.15.46:0/660378939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690409ec50 0x7f690406ce40 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cbf6970424e08e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.386+0000 7f690159a640 1 -- 172.21.15.46:0/660378939 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f68f4009d90 con 0x7f690409ec50 2024-09-11T14:39:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.386+0000 7f690159a640 1 -- 172.21.15.46:0/660378939 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f68f400e230 con 0x7f690409ec50 2024-09-11T14:39:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.386+0000 7f690159a640 1 -- 172.21.15.46:0/660378939 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f68f400e4d0 con 0x7f690409ec50 2024-09-11T14:39:37.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.387+0000 7f6908ed1640 1 -- 172.21.15.46:0/660378939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690409ec50 msgr2=0x7f690406ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.387+0000 7f6908ed1640 1 --2- 172.21.15.46:0/660378939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690409ec50 0x7f690406ce40 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.387+0000 7f6908ed1640 1 -- 172.21.15.46:0/660378939 shutdown_connections 2024-09-11T14:39:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.387+0000 7f6908ed1640 1 --2- 172.21.15.46:0/660378939 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690409ec50 0x7f690406ce40 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.387+0000 7f6908ed1640 1 -- 172.21.15.46:0/660378939 >> 172.21.15.46:0/660378939 conn(0x7f6904069d10 msgr2=0x7f690409f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.387+0000 7f6908ed1640 1 -- 172.21.15.46:0/660378939 shutdown_connections 2024-09-11T14:39:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.387+0000 7f6908ed1640 1 -- 172.21.15.46:0/660378939 wait complete. 2024-09-11T14:39:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.387+0000 7f6908ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.389+0000 7f6908ed1640 1 Processor -- start 2024-09-11T14:39:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.389+0000 7f6908ed1640 1 -- start start 2024-09-11T14:39:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.390+0000 7f6908ed1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690406d380 0x7f69041c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.390+0000 7f6908ed1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f690411e550 con 0x7f690406d380 2024-09-11T14:39:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f690259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690406d380 0x7f69041c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f690259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690406d380 0x7f69041c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40518/0 (socket says 172.21.15.46:40518) 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f690259c640 1 -- 172.21.15.46:0/2471839595 learned_addr learned my addr 172.21.15.46:0/2471839595 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f690259c640 1 -- 172.21.15.46:0/2471839595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6904133570 con 0x7f690406d380 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f690259c640 1 --2- 172.21.15.46:0/2471839595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690406d380 0x7f69041c7b10 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f68f2ffd640 1 -- 172.21.15.46:0/2471839595 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f68f4014620 con 0x7f690406d380 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f68f2ffd640 1 -- 172.21.15.46:0/2471839595 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f68f4014780 con 0x7f690406d380 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690411cde0 con 0x7f690406d380 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f68f2ffd640 1 -- 172.21.15.46:0/2471839595 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f68f4014a20 con 0x7f690406d380 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.391+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f690411fe60 con 0x7f690406d380 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.392+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f690411cc70 con 0x7f690406d380 2024-09-11T14:39:37.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.392+0000 7f68f2ffd640 1 -- 172.21.15.46:0/2471839595 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f68f4014bd0 con 0x7f690406d380 2024-09-11T14:39:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.393+0000 7f68f2ffd640 1 --2- 172.21.15.46:0/2471839595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f68e403e930 0x7f68e4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.393+0000 7f68f2ffd640 1 -- 172.21.15.46:0/2471839595 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f68f4019040 con 0x7f690406d380 2024-09-11T14:39:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.393+0000 7f68f2ffd640 1 --2- 172.21.15.46:0/2471839595 >> v2:172.21.15.46:6805/1751227380 conn(0x7f68e4044a70 0x7f68e4046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.393+0000 7f68f2ffd640 1 -- 172.21.15.46:0/2471839595 --> v2:172.21.15.46:6805/1751227380 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68e40475f0 con 0x7f68e4044a70 2024-09-11T14:39:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.393+0000 7f68f2ffd640 1 -- 172.21.15.46:0/2471839595 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=729) ==== 24+0+0 (crc 0 0 0) 0x7f68f40536d0 con 0x7f690406d380 2024-09-11T14:39:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.393+0000 7f6901d9b640 1 --2- 172.21.15.46:0/2471839595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f68e403e930 0x7f68e4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.394+0000 7f6901d9b640 1 --2- 172.21.15.46:0/2471839595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f68e403e930 0x7f68e4040e40 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.394+0000 7f6902d9d640 1 --2- 172.21.15.46:0/2471839595 >> v2:172.21.15.46:6805/1751227380 conn(0x7f68e4044a70 0x7f68e4046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:39:37.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.397+0000 7f6902d9d640 1 --2- 172.21.15.46:0/2471839595 >> v2:172.21.15.46:6805/1751227380 conn(0x7f68e4044a70 0x7f68e4046f60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.399+0000 7f68f2ffd640 1 -- 172.21.15.46:0/2471839595 <== osd.1 v2:172.21.15.46:6805/1751227380 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f68e40475f0 con 0x7f68e4044a70 2024-09-11T14:39:37.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.402+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 --> v2:172.21.15.46:6805/1751227380 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6904120ab0 con 0x7f68e4044a70 2024-09-11T14:39:37.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f68f2ffd640 1 -- 172.21.15.46:0/2471839595 <== osd.1 v2:172.21.15.46:6805/1751227380 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f6904120ab0 con 0x7f68e4044a70 2024-09-11T14:39:37.405 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-11T14:39:37.405 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "" 2024-09-11T14:39:37.405 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-11T14:39:37.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 >> v2:172.21.15.46:6805/1751227380 conn(0x7f68e4044a70 msgr2=0x7f68e4046f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 --2- 172.21.15.46:0/2471839595 >> v2:172.21.15.46:6805/1751227380 conn(0x7f68e4044a70 0x7f68e4046f60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f68e403e930 msgr2=0x7f68e4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 --2- 172.21.15.46:0/2471839595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f68e403e930 0x7f68e4040e40 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690406d380 msgr2=0x7f69041c7b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 --2- 172.21.15.46:0/2471839595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690406d380 0x7f69041c7b10 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 shutdown_connections 2024-09-11T14:39:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 --2- 172.21.15.46:0/2471839595 >> v2:172.21.15.46:6805/1751227380 conn(0x7f68e4044a70 0x7f68e4046f60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 --2- 172.21.15.46:0/2471839595 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f68e403e930 0x7f68e4040e40 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 --2- 172.21.15.46:0/2471839595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f690406d380 0x7f69041c7b10 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 >> 172.21.15.46:0/2471839595 conn(0x7f6904069d10 msgr2=0x7f69040a28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 shutdown_connections 2024-09-11T14:39:37.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.404+0000 7f6908ed1640 1 -- 172.21.15.46:0/2471839595 wait complete. 2024-09-11T14:39:37.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T14:39:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.526+0000 7f9308f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:37.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.532+0000 7f9308f91640 1 Processor -- start 2024-09-11T14:39:37.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.533+0000 7f9308f91640 1 -- start start 2024-09-11T14:39:37.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.534+0000 7f9308f91640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f930409daa0 0x7f930409ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.534+0000 7f9308f91640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f930412f190 con 0x7f930409cfa0 2024-09-11T14:39:37.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.534+0000 7f9308f91640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f93040706a0 con 0x7f930409daa0 2024-09-11T14:39:37.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.534+0000 7f930259c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f930409daa0 0x7f930409ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.534+0000 7f9301d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f930409cfa0 0x7f9304131770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57200/0 (socket says 172.21.15.46:57200) 2024-09-11T14:39:37.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.534+0000 7f9301d9b640 1 -- 172.21.15.46:0/3879749901 learned_addr learned my addr 172.21.15.46:0/3879749901 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:37.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.535+0000 7f930259c640 1 -- 172.21.15.46:0/3879749901 >> v1:172.21.15.46:6789/0 conn(0x7f930409cfa0 legacy=0x7f9304131770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.535+0000 7f930259c640 1 -- 172.21.15.46:0/3879749901 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930412e970 con 0x7f930409daa0 2024-09-11T14:39:37.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.535+0000 7f930259c640 1 --2- 172.21.15.46:0/3879749901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409daa0 0x7f930409ca60 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c189105d17d8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.535+0000 7f930159a640 1 -- 172.21.15.46:0/3879749901 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f92f400f040 con 0x7f930409daa0 2024-09-11T14:39:37.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.535+0000 7f930159a640 1 -- 172.21.15.46:0/3879749901 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f92f400a1e0 con 0x7f930409daa0 2024-09-11T14:39:37.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.535+0000 7f930159a640 1 -- 172.21.15.46:0/3879749901 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f92f4008780 con 0x7f930409daa0 2024-09-11T14:39:37.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.536+0000 7f9308f91640 1 -- 172.21.15.46:0/3879749901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409daa0 msgr2=0x7f930409ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.536+0000 7f9308f91640 1 --2- 172.21.15.46:0/3879749901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409daa0 0x7f930409ca60 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.536+0000 7f9308f91640 1 -- 172.21.15.46:0/3879749901 shutdown_connections 2024-09-11T14:39:37.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.536+0000 7f9308f91640 1 --2- 172.21.15.46:0/3879749901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409daa0 0x7f930409ca60 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.536+0000 7f9308f91640 1 -- 172.21.15.46:0/3879749901 >> 172.21.15.46:0/3879749901 conn(0x7f9304069d60 msgr2=0x7f930409e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:37.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.536+0000 7f9308f91640 1 -- 172.21.15.46:0/3879749901 shutdown_connections 2024-09-11T14:39:37.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.536+0000 7f9308f91640 1 -- 172.21.15.46:0/3879749901 wait complete. 2024-09-11T14:39:37.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.537+0000 7f9308f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:37.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.538+0000 7f9308f91640 1 Processor -- start 2024-09-11T14:39:37.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.538+0000 7f9308f91640 1 -- start start 2024-09-11T14:39:37.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.540+0000 7f9308f91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409cfa0 0x7f930411acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.540+0000 7f9308f91640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9304121a70 con 0x7f930409cfa0 2024-09-11T14:39:37.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.540+0000 7f930259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409cfa0 0x7f930411acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.540+0000 7f930259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409cfa0 0x7f930411acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40536/0 (socket says 172.21.15.46:40536) 2024-09-11T14:39:37.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.540+0000 7f930259c640 1 -- 172.21.15.46:0/3681726079 learned_addr learned my addr 172.21.15.46:0/3681726079 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:37.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.540+0000 7f930259c640 1 -- 172.21.15.46:0/3681726079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9304122fc0 con 0x7f930409cfa0 2024-09-11T14:39:37.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.541+0000 7f930259c640 1 --2- 172.21.15.46:0/3681726079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409cfa0 0x7f930411acc0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.541+0000 7f92faffd640 1 -- 172.21.15.46:0/3681726079 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f92f400f040 con 0x7f930409cfa0 2024-09-11T14:39:37.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.541+0000 7f92faffd640 1 -- 172.21.15.46:0/3681726079 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f92f4013720 con 0x7f930409cfa0 2024-09-11T14:39:37.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.541+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93041217a0 con 0x7f930409cfa0 2024-09-11T14:39:37.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.541+0000 7f92faffd640 1 -- 172.21.15.46:0/3681726079 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f92f40139c0 con 0x7f930409cfa0 2024-09-11T14:39:37.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.541+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93040a2d60 con 0x7f930409cfa0 2024-09-11T14:39:37.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.542+0000 7f92faffd640 1 -- 172.21.15.46:0/3681726079 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f92f4013b70 con 0x7f930409cfa0 2024-09-11T14:39:37.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.542+0000 7f92faffd640 1 --2- 172.21.15.46:0/3681726079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f92e403e930 0x7f92e4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.542+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f930412e1f0 con 0x7f930409cfa0 2024-09-11T14:39:37.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.542+0000 7f92faffd640 1 -- 172.21.15.46:0/3681726079 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f92f4050ff0 con 0x7f930409cfa0 2024-09-11T14:39:37.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.542+0000 7f9301d9b640 1 --2- 172.21.15.46:0/3681726079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f92e403e930 0x7f92e4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.543+0000 7f9301d9b640 1 --2- 172.21.15.46:0/3681726079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f92e403e930 0x7f92e4040e40 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.547+0000 7f92faffd640 1 -- 172.21.15.46:0/3681726079 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f92f4015770 con 0x7f930409cfa0 2024-09-11T14:39:37.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.732+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f930406f860 con 0x7f92e403e930 2024-09-11T14:39:37.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.733+0000 7f92faffd640 1 -- 172.21.15.46:0/3681726079 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f92ec005930 con 0x7f92e403e930 2024-09-11T14:39:37.734 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f92e403e930 msgr2=0x7f92e4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 --2- 172.21.15.46:0/3681726079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f92e403e930 0x7f92e4040e40 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409cfa0 msgr2=0x7f930411acc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 --2- 172.21.15.46:0/3681726079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409cfa0 0x7f930411acc0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 shutdown_connections 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 --2- 172.21.15.46:0/3681726079 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f92e403e930 0x7f92e4040e40 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 --2- 172.21.15.46:0/3681726079 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f930409cfa0 0x7f930411acc0 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 >> 172.21.15.46:0/3681726079 conn(0x7f9304069d60 msgr2=0x7f930409eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 shutdown_connections 2024-09-11T14:39:37.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.735+0000 7f9308f91640 1 -- 172.21.15.46:0/3681726079 wait complete. 2024-09-11T14:39:37.757 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T14:39:37.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:39:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.871+0000 7fbc7d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.880+0000 7fbc7d911640 1 Processor -- start 2024-09-11T14:39:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.881+0000 7fbc7d911640 1 -- start start 2024-09-11T14:39:37.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.882+0000 7fbc7d911640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbc78131a10 0x7fbc78137350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.882+0000 7fbc7d911640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc78131e20 con 0x7fbc78074c90 2024-09-11T14:39:37.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.882+0000 7fbc7d911640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fbc78070710 con 0x7fbc78131a10 2024-09-11T14:39:37.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.882+0000 7fbc76ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbc78074c90 0x7fbc78131300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57202/0 (socket says 172.21.15.46:57202) 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.882+0000 7fbc76ffd640 1 -- 172.21.15.46:0/2098279637 learned_addr learned my addr 172.21.15.46:0/2098279637 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.882+0000 7fbc767fc640 1 --2- 172.21.15.46:0/2098279637 >> v2:172.21.15.46:3300/0 conn(0x7fbc78131a10 0x7fbc78137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.882+0000 7fbc75ffb640 1 -- 172.21.15.46:0/2098279637 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151460904 0 0) 0x7fbc68001490 con 0x7fbc78074c90 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.883+0000 7fbc75ffb640 1 -- 172.21.15.46:0/2098279637 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc64003580 con 0x7fbc78074c90 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.883+0000 7fbc767fc640 1 -- 172.21.15.46:0/2098279637 >> v1:172.21.15.46:6789/0 conn(0x7fbc78074c90 legacy=0x7fbc78131300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.883+0000 7fbc767fc640 1 -- 172.21.15.46:0/2098279637 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc780a00f0 con 0x7fbc78131a10 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.883+0000 7fbc767fc640 1 --2- 172.21.15.46:0/2098279637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78131a10 0x7fbc78137350 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd23d8ca04863bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.883+0000 7fbc75ffb640 1 -- 172.21.15.46:0/2098279637 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc60009d90 con 0x7fbc78131a10 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.883+0000 7fbc75ffb640 1 -- 172.21.15.46:0/2098279637 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbc6000e230 con 0x7fbc78131a10 2024-09-11T14:39:37.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.883+0000 7fbc75ffb640 1 -- 172.21.15.46:0/2098279637 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc6000e4d0 con 0x7fbc78131a10 2024-09-11T14:39:37.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.884+0000 7fbc7d911640 1 -- 172.21.15.46:0/2098279637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78131a10 msgr2=0x7fbc78137350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.884+0000 7fbc7d911640 1 --2- 172.21.15.46:0/2098279637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78131a10 0x7fbc78137350 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.884+0000 7fbc7d911640 1 -- 172.21.15.46:0/2098279637 shutdown_connections 2024-09-11T14:39:37.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.884+0000 7fbc7d911640 1 --2- 172.21.15.46:0/2098279637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78131a10 0x7fbc78137350 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.884+0000 7fbc7d911640 1 -- 172.21.15.46:0/2098279637 >> 172.21.15.46:0/2098279637 conn(0x7fbc78069d60 msgr2=0x7fbc7809e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:37.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.884+0000 7fbc7d911640 1 -- 172.21.15.46:0/2098279637 shutdown_connections 2024-09-11T14:39:37.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.884+0000 7fbc7d911640 1 -- 172.21.15.46:0/2098279637 wait complete. 2024-09-11T14:39:37.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.884+0000 7fbc7d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:37.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.886+0000 7fbc7d911640 1 Processor -- start 2024-09-11T14:39:37.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.886+0000 7fbc7d911640 1 -- start start 2024-09-11T14:39:37.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.887+0000 7fbc7d911640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78074c90 0x7fbc7811ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.887+0000 7fbc7d911640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7811fc40 con 0x7fbc78074c90 2024-09-11T14:39:37.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.887+0000 7fbc76ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78074c90 0x7fbc7811ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.887+0000 7fbc76ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78074c90 0x7fbc7811ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40548/0 (socket says 172.21.15.46:40548) 2024-09-11T14:39:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.888+0000 7fbc76ffd640 1 -- 172.21.15.46:0/3467346738 learned_addr learned my addr 172.21.15.46:0/3467346738 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.888+0000 7fbc76ffd640 1 -- 172.21.15.46:0/3467346738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7809c560 con 0x7fbc78074c90 2024-09-11T14:39:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.888+0000 7fbc76ffd640 1 --2- 172.21.15.46:0/3467346738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78074c90 0x7fbc7811ccd0 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.888+0000 7fbc6ffff640 1 -- 172.21.15.46:0/3467346738 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc680070b0 con 0x7fbc78074c90 2024-09-11T14:39:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.888+0000 7fbc6ffff640 1 -- 172.21.15.46:0/3467346738 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbc68007210 con 0x7fbc78074c90 2024-09-11T14:39:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.888+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc7811f8d0 con 0x7fbc78074c90 2024-09-11T14:39:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.888+0000 7fbc6ffff640 1 -- 172.21.15.46:0/3467346738 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc680074b0 con 0x7fbc78074c90 2024-09-11T14:39:37.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.888+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc7811df50 con 0x7fbc78074c90 2024-09-11T14:39:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.889+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc7809fb70 con 0x7fbc78074c90 2024-09-11T14:39:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.889+0000 7fbc6ffff640 1 -- 172.21.15.46:0/3467346738 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fbc68007610 con 0x7fbc78074c90 2024-09-11T14:39:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.890+0000 7fbc6ffff640 1 --2- 172.21.15.46:0/3467346738 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fbc5803e980 0x7fbc58040e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.890+0000 7fbc6ffff640 1 -- 172.21.15.46:0/3467346738 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7fbc68050190 con 0x7fbc78074c90 2024-09-11T14:39:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.890+0000 7fbc6ffff640 1 --2- 172.21.15.46:0/3467346738 >> v2:172.21.15.47:6803/3757354244 conn(0x7fbc58044ac0 0x7fbc58046fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:37.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.890+0000 7fbc6ffff640 1 -- 172.21.15.46:0/3467346738 --> v2:172.21.15.47:6803/3757354244 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc58047640 con 0x7fbc58044ac0 2024-09-11T14:39:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.890+0000 7fbc6ffff640 1 -- 172.21.15.46:0/3467346738 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=729) ==== 24+0+0 (crc 0 0 0) 0x7fbc680504d0 con 0x7fbc78074c90 2024-09-11T14:39:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.890+0000 7fbc767fc640 1 --2- 172.21.15.46:0/3467346738 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fbc5803e980 0x7fbc58040e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.891+0000 7fbc767fc640 1 --2- 172.21.15.46:0/3467346738 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fbc5803e980 0x7fbc58040e90 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.891+0000 7fbc777fe640 1 --2- 172.21.15.46:0/3467346738 >> v2:172.21.15.47:6803/3757354244 conn(0x7fbc58044ac0 0x7fbc58046fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:39:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.896+0000 7fbc777fe640 1 --2- 172.21.15.46:0/3467346738 >> v2:172.21.15.47:6803/3757354244 conn(0x7fbc58044ac0 0x7fbc58046fb0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.898+0000 7fbc6ffff640 1 -- 172.21.15.46:0/3467346738 <== osd.2 v2:172.21.15.47:6803/3757354244 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fbc58047640 con 0x7fbc58044ac0 2024-09-11T14:39:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.901+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 --> v2:172.21.15.47:6803/3757354244 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbc78070400 con 0x7fbc58044ac0 2024-09-11T14:39:37.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc6ffff640 1 -- 172.21.15.46:0/3467346738 <== osd.2 v2:172.21.15.47:6803/3757354244 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fbc70009830 con 0x7fbc58044ac0 2024-09-11T14:39:37.904 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-11T14:39:37.905 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "" 2024-09-11T14:39:37.905 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-11T14:39:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 >> v2:172.21.15.47:6803/3757354244 conn(0x7fbc58044ac0 msgr2=0x7fbc58046fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 --2- 172.21.15.46:0/3467346738 >> v2:172.21.15.47:6803/3757354244 conn(0x7fbc58044ac0 0x7fbc58046fb0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fbc5803e980 msgr2=0x7fbc58040e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 --2- 172.21.15.46:0/3467346738 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fbc5803e980 0x7fbc58040e90 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78074c90 msgr2=0x7fbc7811ccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 --2- 172.21.15.46:0/3467346738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78074c90 0x7fbc7811ccd0 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 shutdown_connections 2024-09-11T14:39:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 --2- 172.21.15.46:0/3467346738 >> v2:172.21.15.47:6803/3757354244 conn(0x7fbc58044ac0 0x7fbc58046fb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 --2- 172.21.15.46:0/3467346738 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fbc5803e980 0x7fbc58040e90 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 --2- 172.21.15.46:0/3467346738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc78074c90 0x7fbc7811ccd0 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.903+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 >> 172.21.15.46:0/3467346738 conn(0x7fbc78069d60 msgr2=0x7fbc781301b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.904+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 shutdown_connections 2024-09-11T14:39:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:37.904+0000 7fbc7d911640 1 -- 172.21.15.46:0/3467346738 wait complete. 2024-09-11T14:39:37.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T14:39:38.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.022+0000 7fc9ce6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:38.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.028+0000 7fc9ce6bd640 1 Processor -- start 2024-09-11T14:39:38.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.028+0000 7fc9ce6bd640 1 -- start start 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9ce6bd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc9c809ec50 0x7fc9c806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9ce6bd640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c80a0d00 con 0x7fc9c806d380 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9ce6bd640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c80a0a30 con 0x7fc9c809ec50 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9c7fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc9c809ec50 0x7fc9c806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9c77fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc9c806d380 0x7fc9c812ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57210/0 (socket says 172.21.15.46:57210) 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9c77fe640 1 -- 172.21.15.46:0/1660067997 learned_addr learned my addr 172.21.15.46:0/1660067997 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9c7fff640 1 -- 172.21.15.46:0/1660067997 >> v1:172.21.15.46:6789/0 conn(0x7fc9c806d380 legacy=0x7fc9c812ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9c7fff640 1 -- 172.21.15.46:0/1660067997 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c80710b0 con 0x7fc9c809ec50 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9c7fff640 1 --2- 172.21.15.46:0/1660067997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c809ec50 0x7fc9c806ce40 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ef6caa73d47316 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.030+0000 7fc9c6ffd640 1 -- 172.21.15.46:0/1660067997 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc9b8009d90 con 0x7fc9c809ec50 2024-09-11T14:39:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.031+0000 7fc9c6ffd640 1 -- 172.21.15.46:0/1660067997 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc9b800e230 con 0x7fc9c809ec50 2024-09-11T14:39:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.031+0000 7fc9c6ffd640 1 -- 172.21.15.46:0/1660067997 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc9b800e4d0 con 0x7fc9c809ec50 2024-09-11T14:39:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.031+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/1660067997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c809ec50 msgr2=0x7fc9c806ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.031+0000 7fc9ce6bd640 1 --2- 172.21.15.46:0/1660067997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c809ec50 0x7fc9c806ce40 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.031+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/1660067997 shutdown_connections 2024-09-11T14:39:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.031+0000 7fc9ce6bd640 1 --2- 172.21.15.46:0/1660067997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c809ec50 0x7fc9c806ce40 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.031+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/1660067997 >> 172.21.15.46:0/1660067997 conn(0x7fc9c8069d10 msgr2=0x7fc9c809f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.031+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/1660067997 shutdown_connections 2024-09-11T14:39:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.031+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/1660067997 wait complete. 2024-09-11T14:39:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.032+0000 7fc9ce6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:38.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.033+0000 7fc9ce6bd640 1 Processor -- start 2024-09-11T14:39:38.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.034+0000 7fc9ce6bd640 1 -- start start 2024-09-11T14:39:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.035+0000 7fc9ce6bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c806d380 0x7fc9c811cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.035+0000 7fc9ce6bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c811df20 con 0x7fc9c806d380 2024-09-11T14:39:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.035+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c806d380 0x7fc9c811cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.035+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c806d380 0x7fc9c811cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40560/0 (socket says 172.21.15.46:40560) 2024-09-11T14:39:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.035+0000 7fc9c7fff640 1 -- 172.21.15.46:0/2899899322 learned_addr learned my addr 172.21.15.46:0/2899899322 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.035+0000 7fc9c7fff640 1 -- 172.21.15.46:0/2899899322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c8133530 con 0x7fc9c806d380 2024-09-11T14:39:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.035+0000 7fc9c7fff640 1 --2- 172.21.15.46:0/2899899322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c806d380 0x7fc9c811cbe0 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.036+0000 7fc9c4ff9640 1 -- 172.21.15.46:0/2899899322 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc9b8013610 con 0x7fc9c806d380 2024-09-11T14:39:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.036+0000 7fc9c4ff9640 1 -- 172.21.15.46:0/2899899322 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc9b8013770 con 0x7fc9c806d380 2024-09-11T14:39:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.036+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c8120b80 con 0x7fc9c806d380 2024-09-11T14:39:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.036+0000 7fc9c4ff9640 1 -- 172.21.15.46:0/2899899322 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc9b8013a10 con 0x7fc9c806d380 2024-09-11T14:39:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.036+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c8130d90 con 0x7fc9c806d380 2024-09-11T14:39:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.037+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c806ce40 con 0x7fc9c806d380 2024-09-11T14:39:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.037+0000 7fc9c4ff9640 1 -- 172.21.15.46:0/2899899322 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fc9b8013bc0 con 0x7fc9c806d380 2024-09-11T14:39:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.037+0000 7fc9c4ff9640 1 --2- 172.21.15.46:0/2899899322 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc9b403e930 0x7fc9b4040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.037+0000 7fc9c4ff9640 1 -- 172.21.15.46:0/2899899322 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7fc9b8018040 con 0x7fc9c806d380 2024-09-11T14:39:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.037+0000 7fc9c77fe640 1 --2- 172.21.15.46:0/2899899322 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc9b403e930 0x7fc9b4040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.038+0000 7fc9c77fe640 1 --2- 172.21.15.46:0/2899899322 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc9b403e930 0x7fc9b4040e40 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.042+0000 7fc9c4ff9640 1 -- 172.21.15.46:0/2899899322 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fc9b8011380 con 0x7fc9c806d380 2024-09-11T14:39:38.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.225+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc9c806e0b0 con 0x7fc9b403e930 2024-09-11T14:39:38.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.225+0000 7fc9c4ff9640 1 -- 172.21.15.46:0/2899899322 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fc9c806e0b0 con 0x7fc9b403e930 2024-09-11T14:39:38.227 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T14:39:38.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.227+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc9b403e930 msgr2=0x7fc9b4040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.227+0000 7fc9ce6bd640 1 --2- 172.21.15.46:0/2899899322 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc9b403e930 0x7fc9b4040e40 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.228+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c806d380 msgr2=0x7fc9c811cbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.228+0000 7fc9ce6bd640 1 --2- 172.21.15.46:0/2899899322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c806d380 0x7fc9c811cbe0 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.228+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 shutdown_connections 2024-09-11T14:39:38.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.228+0000 7fc9ce6bd640 1 --2- 172.21.15.46:0/2899899322 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fc9b403e930 0x7fc9b4040e40 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.228+0000 7fc9ce6bd640 1 --2- 172.21.15.46:0/2899899322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c806d380 0x7fc9c811cbe0 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.228+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 >> 172.21.15.46:0/2899899322 conn(0x7fc9c8069d10 msgr2=0x7fc9c81bb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:38.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.228+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 shutdown_connections 2024-09-11T14:39:38.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.228+0000 7fc9ce6bd640 1 -- 172.21.15.46:0/2899899322 wait complete. 2024-09-11T14:39:38.241 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T14:39:38.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T14:39:38.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.352+0000 7f8587d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:38.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.362+0000 7f8587d11640 1 Processor -- start 2024-09-11T14:39:38.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.362+0000 7f8587d11640 1 -- start start 2024-09-11T14:39:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.363+0000 7f8587d11640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8580132520 0x7f8580132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8587d11640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858006f6d0 con 0x7f85800a3450 2024-09-11T14:39:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8587d11640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f858006f3d0 con 0x7f8580132520 2024-09-11T14:39:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8585aad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8580132520 0x7f8580132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f85852ac640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f85800a3450 0x7f85800a3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57214/0 (socket says 172.21.15.46:57214) 2024-09-11T14:39:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f85852ac640 1 -- 172.21.15.46:0/3459815082 learned_addr learned my addr 172.21.15.46:0/3459815082 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8585aad640 1 -- 172.21.15.46:0/3459815082 >> v1:172.21.15.46:6789/0 conn(0x7f85800a3450 legacy=0x7f85800a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8584aab640 1 -- 172.21.15.46:0/3459815082 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186704940 0 0) 0x7f858006f6d0 con 0x7f85800a3450 2024-09-11T14:39:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8585aad640 1 -- 172.21.15.46:0/3459815082 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858006f0c0 con 0x7f8580132520 2024-09-11T14:39:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8585aad640 1 --2- 172.21.15.46:0/3459815082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8580132520 0x7f8580132930 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e31f41f4a68dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8584aab640 1 -- 172.21.15.46:0/3459815082 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f857800e040 con 0x7f8580132520 2024-09-11T14:39:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8584aab640 1 -- 172.21.15.46:0/3459815082 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8578007670 con 0x7f8580132520 2024-09-11T14:39:38.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.364+0000 7f8584aab640 1 -- 172.21.15.46:0/3459815082 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8578007910 con 0x7f8580132520 2024-09-11T14:39:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.365+0000 7f8587d11640 1 -- 172.21.15.46:0/3459815082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8580132520 msgr2=0x7f8580132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.365+0000 7f8587d11640 1 --2- 172.21.15.46:0/3459815082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8580132520 0x7f8580132930 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.365+0000 7f8587d11640 1 -- 172.21.15.46:0/3459815082 shutdown_connections 2024-09-11T14:39:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.365+0000 7f8587d11640 1 --2- 172.21.15.46:0/3459815082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8580132520 0x7f8580132930 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.365+0000 7f8587d11640 1 -- 172.21.15.46:0/3459815082 >> 172.21.15.46:0/3459815082 conn(0x7f858006e490 msgr2=0x7f858006e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.365+0000 7f8587d11640 1 -- 172.21.15.46:0/3459815082 shutdown_connections 2024-09-11T14:39:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.365+0000 7f8587d11640 1 -- 172.21.15.46:0/3459815082 wait complete. 2024-09-11T14:39:38.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.366+0000 7f8587d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.367+0000 7f8587d11640 1 Processor -- start 2024-09-11T14:39:38.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.367+0000 7f8587d11640 1 -- start start 2024-09-11T14:39:38.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.369+0000 7f8587d11640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85800a3450 0x7f8580120fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.369+0000 7f8587d11640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f85801219d0 con 0x7f85800a3450 2024-09-11T14:39:38.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.369+0000 7f8585aad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85800a3450 0x7f8580120fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.369+0000 7f8585aad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85800a3450 0x7f8580120fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40588/0 (socket says 172.21.15.46:40588) 2024-09-11T14:39:38.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.369+0000 7f8585aad640 1 -- 172.21.15.46:0/1508782156 learned_addr learned my addr 172.21.15.46:0/1508782156 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:38.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.369+0000 7f8585aad640 1 -- 172.21.15.46:0/1508782156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858011f8f0 con 0x7f85800a3450 2024-09-11T14:39:38.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.369+0000 7f8585aad640 1 --2- 172.21.15.46:0/1508782156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85800a3450 0x7f8580120fa0 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.370+0000 7f857e7fc640 1 -- 172.21.15.46:0/1508782156 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f857800e040 con 0x7f85800a3450 2024-09-11T14:39:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.370+0000 7f857e7fc640 1 -- 172.21.15.46:0/1508782156 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8578013ad0 con 0x7f85800a3450 2024-09-11T14:39:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.370+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85801216c0 con 0x7f85800a3450 2024-09-11T14:39:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.370+0000 7f857e7fc640 1 -- 172.21.15.46:0/1508782156 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8578013d70 con 0x7f85800a3450 2024-09-11T14:39:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.370+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8580121d50 con 0x7f85800a3450 2024-09-11T14:39:38.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.370+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f858009c830 con 0x7f85800a3450 2024-09-11T14:39:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.371+0000 7f857e7fc640 1 -- 172.21.15.46:0/1508782156 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f8578011040 con 0x7f85800a3450 2024-09-11T14:39:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.371+0000 7f857e7fc640 1 --2- 172.21.15.46:0/1508782156 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f856c03e960 0x7f856c040e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.371+0000 7f857e7fc640 1 -- 172.21.15.46:0/1508782156 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f85780512f0 con 0x7f85800a3450 2024-09-11T14:39:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.371+0000 7f857e7fc640 1 --2- 172.21.15.46:0/1508782156 >> v2:172.21.15.47:6805/1666238977 conn(0x7f856c044b00 0x7f856c046ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.371+0000 7f857e7fc640 1 -- 172.21.15.46:0/1508782156 --> v2:172.21.15.47:6805/1666238977 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f856c047680 con 0x7f856c044b00 2024-09-11T14:39:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.371+0000 7f857e7fc640 1 -- 172.21.15.46:0/1508782156 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=729) ==== 24+0+0 (crc 0 0 0) 0x7f85780537e0 con 0x7f85800a3450 2024-09-11T14:39:38.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.372+0000 7f85852ac640 1 --2- 172.21.15.46:0/1508782156 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f856c03e960 0x7f856c040e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.372+0000 7f85852ac640 1 --2- 172.21.15.46:0/1508782156 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f856c03e960 0x7f856c040e70 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.373+0000 7f85862ae640 1 --2- 172.21.15.46:0/1508782156 >> v2:172.21.15.47:6805/1666238977 conn(0x7f856c044b00 0x7f856c046ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-11T14:39:38.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.377+0000 7f85862ae640 1 --2- 172.21.15.46:0/1508782156 >> v2:172.21.15.47:6805/1666238977 conn(0x7f856c044b00 0x7f856c046ff0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.379+0000 7f857e7fc640 1 -- 172.21.15.46:0/1508782156 <== osd.3 v2:172.21.15.47:6805/1666238977 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f856c047680 con 0x7f856c044b00 2024-09-11T14:39:38.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.383+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 --> v2:172.21.15.47:6805/1666238977 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f858006a300 con 0x7f856c044b00 2024-09-11T14:39:38.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f857e7fc640 1 -- 172.21.15.46:0/1508782156 <== osd.3 v2:172.21.15.47:6805/1666238977 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f858006a300 con 0x7f856c044b00 2024-09-11T14:39:38.386 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-11T14:39:38.386 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "" 2024-09-11T14:39:38.386 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-11T14:39:38.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 >> v2:172.21.15.47:6805/1666238977 conn(0x7f856c044b00 msgr2=0x7f856c046ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 --2- 172.21.15.46:0/1508782156 >> v2:172.21.15.47:6805/1666238977 conn(0x7f856c044b00 0x7f856c046ff0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f856c03e960 msgr2=0x7f856c040e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 --2- 172.21.15.46:0/1508782156 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f856c03e960 0x7f856c040e70 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85800a3450 msgr2=0x7f8580120fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 --2- 172.21.15.46:0/1508782156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85800a3450 0x7f8580120fa0 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 shutdown_connections 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 --2- 172.21.15.46:0/1508782156 >> v2:172.21.15.47:6805/1666238977 conn(0x7f856c044b00 0x7f856c046ff0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 --2- 172.21.15.46:0/1508782156 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f856c03e960 0x7f856c040e70 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 --2- 172.21.15.46:0/1508782156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85800a3450 0x7f8580120fa0 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 >> 172.21.15.46:0/1508782156 conn(0x7f858006e490 msgr2=0x7f85801bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 shutdown_connections 2024-09-11T14:39:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.385+0000 7f8587d11640 1 -- 172.21.15.46:0/1508782156 wait complete. 2024-09-11T14:39:38.397 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T14:39:38.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.504+0000 7f67b1911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:38.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.510+0000 7f67b1911640 1 Processor -- start 2024-09-11T14:39:38.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.510+0000 7f67b1911640 1 -- start start 2024-09-11T14:39:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67b1911640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f67ac1365a0 0x7f67ac1389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67b1911640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67ac074a00 con 0x7f67ac130420 2024-09-11T14:39:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67b1911640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f67ac074c30 con 0x7f67ac1365a0 2024-09-11T14:39:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67aa7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f67ac1365a0 0x7f67ac1389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67aaffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f67ac130420 0x7f67ac130830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57220/0 (socket says 172.21.15.46:57220) 2024-09-11T14:39:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67aaffd640 1 -- 172.21.15.46:0/3458715763 learned_addr learned my addr 172.21.15.46:0/3458715763 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67aa7fc640 1 -- 172.21.15.46:0/3458715763 >> v1:172.21.15.46:6789/0 conn(0x7f67ac130420 legacy=0x7f67ac130830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67aa7fc640 1 -- 172.21.15.46:0/3458715763 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac071930 con 0x7f67ac1365a0 2024-09-11T14:39:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67a9ffb640 1 -- 172.21.15.46:0/3458715763 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481543002 0 0) 0x7f67ac074a00 con 0x7f67ac130420 2024-09-11T14:39:38.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.512+0000 7f67aa7fc640 1 --2- 172.21.15.46:0/3458715763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac1365a0 0x7f67ac1389c0 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521c0f2997dff951 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.513+0000 7f67a9ffb640 1 -- 172.21.15.46:0/3458715763 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f67a0009d90 con 0x7f67ac1365a0 2024-09-11T14:39:38.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.513+0000 7f67a9ffb640 1 -- 172.21.15.46:0/3458715763 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f67a000e230 con 0x7f67ac1365a0 2024-09-11T14:39:38.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.513+0000 7f67a9ffb640 1 -- 172.21.15.46:0/3458715763 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f67a000e4d0 con 0x7f67ac1365a0 2024-09-11T14:39:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.513+0000 7f67b1911640 1 -- 172.21.15.46:0/3458715763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac1365a0 msgr2=0x7f67ac1389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.513+0000 7f67b1911640 1 --2- 172.21.15.46:0/3458715763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac1365a0 0x7f67ac1389c0 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.513+0000 7f67b1911640 1 -- 172.21.15.46:0/3458715763 shutdown_connections 2024-09-11T14:39:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.513+0000 7f67b1911640 1 --2- 172.21.15.46:0/3458715763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac1365a0 0x7f67ac1389c0 unknown :-1 s=CLOSED pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.513+0000 7f67b1911640 1 -- 172.21.15.46:0/3458715763 >> 172.21.15.46:0/3458715763 conn(0x7f67ac0a0320 msgr2=0x7f67ac0a0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.513+0000 7f67b1911640 1 -- 172.21.15.46:0/3458715763 shutdown_connections 2024-09-11T14:39:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.514+0000 7f67b1911640 1 -- 172.21.15.46:0/3458715763 wait complete. 2024-09-11T14:39:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.514+0000 7f67b1911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.515+0000 7f67b1911640 1 Processor -- start 2024-09-11T14:39:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.516+0000 7f67b1911640 1 -- start start 2024-09-11T14:39:38.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.517+0000 7f67b1911640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac130420 0x7f67ac12fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.517+0000 7f67b1911640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac120b10 con 0x7f67ac130420 2024-09-11T14:39:38.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.517+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac130420 0x7f67ac12fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.517+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac130420 0x7f67ac12fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40604/0 (socket says 172.21.15.46:40604) 2024-09-11T14:39:38.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.517+0000 7f67aaffd640 1 -- 172.21.15.46:0/2610994842 learned_addr learned my addr 172.21.15.46:0/2610994842 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.518+0000 7f67aaffd640 1 -- 172.21.15.46:0/2610994842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac11de70 con 0x7f67ac130420 2024-09-11T14:39:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.518+0000 7f67aaffd640 1 --2- 172.21.15.46:0/2610994842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac130420 0x7f67ac12fa40 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.518+0000 7f6793fff640 1 -- 172.21.15.46:0/2610994842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f679c004bc0 con 0x7f67ac130420 2024-09-11T14:39:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.518+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ac11ed90 con 0x7f67ac130420 2024-09-11T14:39:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.518+0000 7f6793fff640 1 -- 172.21.15.46:0/2610994842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f679c004d20 con 0x7f67ac130420 2024-09-11T14:39:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.518+0000 7f6793fff640 1 -- 172.21.15.46:0/2610994842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f679c007120 con 0x7f67ac130420 2024-09-11T14:39:38.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.518+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ac0a48f0 con 0x7f67ac130420 2024-09-11T14:39:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.519+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67ac06a300 con 0x7f67ac130420 2024-09-11T14:39:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.519+0000 7f6793fff640 1 -- 172.21.15.46:0/2610994842 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f679c007320 con 0x7f67ac130420 2024-09-11T14:39:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.519+0000 7f6793fff640 1 --2- 172.21.15.46:0/2610994842 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f679803e8e0 0x7f6798040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.519+0000 7f6793fff640 1 -- 172.21.15.46:0/2610994842 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f679c0502a0 con 0x7f67ac130420 2024-09-11T14:39:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.520+0000 7f67aa7fc640 1 --2- 172.21.15.46:0/2610994842 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f679803e8e0 0x7f6798040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.520+0000 7f67aa7fc640 1 --2- 172.21.15.46:0/2610994842 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f679803e8e0 0x7f6798040df0 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.524+0000 7f6793fff640 1 -- 172.21.15.46:0/2610994842 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f679c0066b0 con 0x7f67ac130420 2024-09-11T14:39:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.712+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f67ac0a1f00 con 0x7f679803e8e0 2024-09-11T14:39:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.712+0000 7f6793fff640 1 -- 172.21.15.46:0/2610994842 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f67a0009e80 con 0x7f679803e8e0 2024-09-11T14:39:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T14:39:38.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f679803e8e0 msgr2=0x7f6798040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 --2- 172.21.15.46:0/2610994842 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f679803e8e0 0x7f6798040df0 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac130420 msgr2=0x7f67ac12fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 --2- 172.21.15.46:0/2610994842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac130420 0x7f67ac12fa40 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 shutdown_connections 2024-09-11T14:39:38.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 --2- 172.21.15.46:0/2610994842 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f679803e8e0 0x7f6798040df0 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 --2- 172.21.15.46:0/2610994842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67ac130420 0x7f67ac12fa40 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 >> 172.21.15.46:0/2610994842 conn(0x7f67ac0a0320 msgr2=0x7f67ac132b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:38.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 shutdown_connections 2024-09-11T14:39:38.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.715+0000 7f67b1911640 1 -- 172.21.15.46:0/2610994842 wait complete. 2024-09-11T14:39:38.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.841+0000 7fcdd9ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.847+0000 7fcdd9ed1640 1 Processor -- start 2024-09-11T14:39:38.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.847+0000 7fcdd9ed1640 1 -- start start 2024-09-11T14:39:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.848+0000 7fcdd9ed1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcdd4132520 0x7fcdd4132930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.848+0000 7fcdd9ed1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd406f6d0 con 0x7fcdd40a3450 2024-09-11T14:39:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.848+0000 7fcdd9ed1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd406f3d0 con 0x7fcdd4132520 2024-09-11T14:39:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd37fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcdd4132520 0x7fcdd4132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd2ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcdd40a3450 0x7fcdd40a3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:57222/0 (socket says 172.21.15.46:57222) 2024-09-11T14:39:38.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd2ffd640 1 -- 172.21.15.46:0/1447114751 learned_addr learned my addr 172.21.15.46:0/1447114751 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:38.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd37fe640 1 -- 172.21.15.46:0/1447114751 >> v1:172.21.15.46:6789/0 conn(0x7fcdd40a3450 legacy=0x7fcdd40a3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd37fe640 1 -- 172.21.15.46:0/1447114751 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd406f0c0 con 0x7fcdd4132520 2024-09-11T14:39:38.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd27fc640 1 -- 172.21.15.46:0/1447114751 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734255738 0 0) 0x7fcdd406f6d0 con 0x7fcdd40a3450 2024-09-11T14:39:38.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd37fe640 1 --2- 172.21.15.46:0/1447114751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd4132520 0x7fcdd4132930 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d257afa7ac7e3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd27fc640 1 -- 172.21.15.46:0/1447114751 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcdc4009d90 con 0x7fcdd4132520 2024-09-11T14:39:38.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd27fc640 1 -- 172.21.15.46:0/1447114751 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcdc400e230 con 0x7fcdd4132520 2024-09-11T14:39:38.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.849+0000 7fcdd27fc640 1 -- 172.21.15.46:0/1447114751 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcdc400e4d0 con 0x7fcdd4132520 2024-09-11T14:39:38.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.850+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/1447114751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd4132520 msgr2=0x7fcdd4132930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:38.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.850+0000 7fcdd9ed1640 1 --2- 172.21.15.46:0/1447114751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd4132520 0x7fcdd4132930 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.850+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/1447114751 shutdown_connections 2024-09-11T14:39:38.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.850+0000 7fcdd9ed1640 1 --2- 172.21.15.46:0/1447114751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd4132520 0x7fcdd4132930 unknown :-1 s=CLOSED pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:38.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.850+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/1447114751 >> 172.21.15.46:0/1447114751 conn(0x7fcdd406e490 msgr2=0x7fcdd406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:38.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.850+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/1447114751 shutdown_connections 2024-09-11T14:39:38.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.850+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/1447114751 wait complete. 2024-09-11T14:39:38.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.850+0000 7fcdd9ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:38.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.852+0000 7fcdd9ed1640 1 Processor -- start 2024-09-11T14:39:38.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.852+0000 7fcdd9ed1640 1 -- start start 2024-09-11T14:39:38.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.854+0000 7fcdd9ed1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd40a3450 0x7fcdd4120f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.854+0000 7fcdd9ed1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41320e0 con 0x7fcdd40a3450 2024-09-11T14:39:38.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.854+0000 7fcdd37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd40a3450 0x7fcdd4120f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.854+0000 7fcdd37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd40a3450 0x7fcdd4120f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40620/0 (socket says 172.21.15.46:40620) 2024-09-11T14:39:38.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.854+0000 7fcdd37fe640 1 -- 172.21.15.46:0/3040244819 learned_addr learned my addr 172.21.15.46:0/3040244819 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:38.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.854+0000 7fcdd37fe640 1 -- 172.21.15.46:0/3040244819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd41219c0 con 0x7fcdd40a3450 2024-09-11T14:39:38.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.854+0000 7fcdd37fe640 1 --2- 172.21.15.46:0/3040244819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd40a3450 0x7fcdd4120f90 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.855+0000 7fcdbbfff640 1 -- 172.21.15.46:0/3040244819 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcdc4013610 con 0x7fcdd40a3450 2024-09-11T14:39:38.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.855+0000 7fcdbbfff640 1 -- 172.21.15.46:0/3040244819 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcdc4013770 con 0x7fcdd40a3450 2024-09-11T14:39:38.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.855+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd411f8e0 con 0x7fcdd40a3450 2024-09-11T14:39:38.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.855+0000 7fcdbbfff640 1 -- 172.21.15.46:0/3040244819 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcdc4013a10 con 0x7fcdd40a3450 2024-09-11T14:39:38.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.855+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd4135790 con 0x7fcdd40a3450 2024-09-11T14:39:38.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.856+0000 7fcdbbfff640 1 -- 172.21.15.46:0/3040244819 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7fcdc4013c10 con 0x7fcdd40a3450 2024-09-11T14:39:38.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.856+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd406a300 con 0x7fcdd40a3450 2024-09-11T14:39:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.856+0000 7fcdbbfff640 1 --2- 172.21.15.46:0/3040244819 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fcdc003e8e0 0x7fcdc0040df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.856+0000 7fcdbbfff640 1 -- 172.21.15.46:0/3040244819 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7fcdc4018040 con 0x7fcdd40a3450 2024-09-11T14:39:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.856+0000 7fcdd2ffd640 1 --2- 172.21.15.46:0/3040244819 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fcdc003e8e0 0x7fcdc0040df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.857+0000 7fcdd2ffd640 1 --2- 172.21.15.46:0/3040244819 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fcdc003e8e0 0x7fcdc0040df0 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:38.861+0000 7fcdbbfff640 1 -- 172.21.15.46:0/3040244819 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7fcdc4011380 con 0x7fcdd40a3450 2024-09-11T14:39:39.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.045+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcdd4121850 con 0x7fcdc003e8e0 2024-09-11T14:39:39.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.048+0000 7fcdbbfff640 1 -- 172.21.15.46:0/3040244819 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109430 (crc 0 0 0) 0x7fcdd4121850 con 0x7fcdc003e8e0 2024-09-11T14:39:39.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:39:39.051 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-11T14:39:39.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.050+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fcdc003e8e0 msgr2=0x7fcdc0040df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:39.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.050+0000 7fcdd9ed1640 1 --2- 172.21.15.46:0/3040244819 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fcdc003e8e0 0x7fcdc0040df0 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:39.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.050+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd40a3450 msgr2=0x7fcdd4120f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:39.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.050+0000 7fcdd9ed1640 1 --2- 172.21.15.46:0/3040244819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd40a3450 0x7fcdd4120f90 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:39.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.050+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 shutdown_connections 2024-09-11T14:39:39.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.050+0000 7fcdd9ed1640 1 --2- 172.21.15.46:0/3040244819 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7fcdc003e8e0 0x7fcdc0040df0 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:39.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.050+0000 7fcdd9ed1640 1 --2- 172.21.15.46:0/3040244819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdd40a3450 0x7fcdd4120f90 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:39.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.050+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 >> 172.21.15.46:0/3040244819 conn(0x7fcdd406e490 msgr2=0x7fcdd40a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:39.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.050+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 shutdown_connections 2024-09-11T14:39:39.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:39.051+0000 7fcdd9ed1640 1 -- 172.21.15.46:0/3040244819 wait complete. 2024-09-11T14:39:39.063 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1311,"stamp":"2024-09-11T14:39:38.623271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":23336,"kb_used_data":23336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209167576,"statfs":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-319425,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002019"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.710571+0000","last_change":"2024-09-11T14:25:17.967604+0000","last_active":"2024-09-11T14:39:01.710571+0000","last_peered":"2024-09-11T14:39:01.710571+0000","last_clean":"2024-09-11T14:39:01.710571+0000","last_became_active":"2024-09-11T14:25:17.959003+0000","last_became_peered":"2024-09-11T14:25:17.959003+0000","last_unstale":"2024-09-11T14:39:01.710571+0000","last_undegraded":"2024-09-11T14:39:01.710571+0000","last_fullsized":"2024-09-11T14:39:01.710571+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729888+0000","last_change":"2024-09-11T14:25:18.071413+0000","last_active":"2024-09-11T14:39:01.729888+0000","last_peered":"2024-09-11T14:39:01.729888+0000","last_clean":"2024-09-11T14:39:01.729888+0000","last_became_active":"2024-09-11T14:25:18.057804+0000","last_became_peered":"2024-09-11T14:25:18.057804+0000","last_unstale":"2024-09-11T14:39:01.729888+0000","last_undegraded":"2024-09-11T14:39:01.729888+0000","last_fullsized":"2024-09-11T14:39:01.729888+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722357+0000","last_change":"2024-09-11T14:25:18.010778+0000","last_active":"2024-09-11T14:39:01.722357+0000","last_peered":"2024-09-11T14:39:01.722357+0000","last_clean":"2024-09-11T14:39:01.722357+0000","last_became_active":"2024-09-11T14:25:17.997485+0000","last_became_peered":"2024-09-11T14:25:17.997485+0000","last_unstale":"2024-09-11T14:39:01.722357+0000","last_undegraded":"2024-09-11T14:39:01.722357+0000","last_fullsized":"2024-09-11T14:39:01.722357+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.723217+0000","last_change":"2024-09-11T14:25:18.022706+0000","last_active":"2024-09-11T14:39:01.723217+0000","last_peered":"2024-09-11T14:39:01.723217+0000","last_clean":"2024-09-11T14:39:01.723217+0000","last_became_active":"2024-09-11T14:25:17.988591+0000","last_became_peered":"2024-09-11T14:25:17.988591+0000","last_unstale":"2024-09-11T14:39:01.723217+0000","last_undegraded":"2024-09-11T14:39:01.723217+0000","last_fullsized":"2024-09-11T14:39:01.723217+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720683+0000","last_change":"2024-09-11T14:25:18.016706+0000","last_active":"2024-09-11T14:39:01.720683+0000","last_peered":"2024-09-11T14:39:01.720683+0000","last_clean":"2024-09-11T14:39:01.720683+0000","last_became_active":"2024-09-11T14:25:18.001149+0000","last_became_peered":"2024-09-11T14:25:18.001149+0000","last_unstale":"2024-09-11T14:39:01.720683+0000","last_undegraded":"2024-09-11T14:39:01.720683+0000","last_fullsized":"2024-09-11T14:39:01.720683+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.723213+0000","last_change":"2024-09-11T14:25:18.040831+0000","last_active":"2024-09-11T14:39:01.723213+0000","last_peered":"2024-09-11T14:39:01.723213+0000","last_clean":"2024-09-11T14:39:01.723213+0000","last_became_active":"2024-09-11T14:25:17.962220+0000","last_became_peered":"2024-09-11T14:25:17.962220+0000","last_unstale":"2024-09-11T14:39:01.723213+0000","last_undegraded":"2024-09-11T14:39:01.723213+0000","last_fullsized":"2024-09-11T14:39:01.723213+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726176+0000","last_change":"2024-09-11T14:25:18.030832+0000","last_active":"2024-09-11T14:39:01.726176+0000","last_peered":"2024-09-11T14:39:01.726176+0000","last_clean":"2024-09-11T14:39:01.726176+0000","last_became_active":"2024-09-11T14:25:18.001816+0000","last_became_peered":"2024-09-11T14:25:18.001816+0000","last_unstale":"2024-09-11T14:39:01.726176+0000","last_undegraded":"2024-09-11T14:39:01.726176+0000","last_fullsized":"2024-09-11T14:39:01.726176+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.735137+0000","last_change":"2024-09-11T14:25:18.036731+0000","last_active":"2024-09-11T14:39:01.735137+0000","last_peered":"2024-09-11T14:39:01.735137+0000","last_clean":"2024-09-11T14:39:01.735137+0000","last_became_active":"2024-09-11T14:25:18.014278+0000","last_became_peered":"2024-09-11T14:25:18.014278+0000","last_unstale":"2024-09-11T14:39:01.735137+0000","last_undegraded":"2024-09-11T14:39:01.735137+0000","last_fullsized":"2024-09-11T14:39:01.735137+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.716999+0000","last_change":"2024-09-11T14:25:18.122293+0000","last_active":"2024-09-11T14:39:01.716999+0000","last_peered":"2024-09-11T14:39:01.716999+0000","last_clean":"2024-09-11T14:39:01.716999+0000","last_became_active":"2024-09-11T14:25:18.116721+0000","last_became_peered":"2024-09-11T14:25:18.116721+0000","last_unstale":"2024-09-11T14:39:01.716999+0000","last_undegraded":"2024-09-11T14:39:01.716999+0000","last_fullsized":"2024-09-11T14:39:01.716999+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721546+0000","last_change":"2024-09-11T14:25:17.963491+0000","last_active":"2024-09-11T14:39:01.721546+0000","last_peered":"2024-09-11T14:39:01.721546+0000","last_clean":"2024-09-11T14:39:01.721546+0000","last_became_active":"2024-09-11T14:25:17.956766+0000","last_became_peered":"2024-09-11T14:25:17.956766+0000","last_unstale":"2024-09-11T14:39:01.721546+0000","last_undegraded":"2024-09-11T14:39:01.721546+0000","last_fullsized":"2024-09-11T14:39:01.721546+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729097+0000","last_change":"2024-09-11T14:25:18.053878+0000","last_active":"2024-09-11T14:39:01.729097+0000","last_peered":"2024-09-11T14:39:01.729097+0000","last_clean":"2024-09-11T14:39:01.729097+0000","last_became_active":"2024-09-11T14:25:18.047823+0000","last_became_peered":"2024-09-11T14:25:18.047823+0000","last_unstale":"2024-09-11T14:39:01.729097+0000","last_undegraded":"2024-09-11T14:39:01.729097+0000","last_fullsized":"2024-09-11T14:39:01.729097+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.718601+0000","last_change":"2024-09-11T14:25:18.140132+0000","last_active":"2024-09-11T14:39:01.718601+0000","last_peered":"2024-09-11T14:39:01.718601+0000","last_clean":"2024-09-11T14:39:01.718601+0000","last_became_active":"2024-09-11T14:25:18.071958+0000","last_became_peered":"2024-09-11T14:25:18.071958+0000","last_unstale":"2024-09-11T14:39:01.718601+0000","last_undegraded":"2024-09-11T14:39:01.718601+0000","last_fullsized":"2024-09-11T14:39:01.718601+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.715774+0000","last_change":"2024-09-11T14:25:18.118269+0000","last_active":"2024-09-11T14:39:01.715774+0000","last_peered":"2024-09-11T14:39:01.715774+0000","last_clean":"2024-09-11T14:39:01.715774+0000","last_became_active":"2024-09-11T14:25:18.097464+0000","last_became_peered":"2024-09-11T14:25:18.097464+0000","last_unstale":"2024-09-11T14:39:01.715774+0000","last_undegraded":"2024-09-11T14:39:01.715774+0000","last_fullsized":"2024-09-11T14:39:01.715774+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726258+0000","last_change":"2024-09-11T14:25:18.235222+0000","last_active":"2024-09-11T14:39:01.726258+0000","last_peered":"2024-09-11T14:39:01.726258+0000","last_clean":"2024-09-11T14:39:01.726258+0000","last_became_active":"2024-09-11T14:25:18.228702+0000","last_became_peered":"2024-09-11T14:25:18.228702+0000","last_unstale":"2024-09-11T14:39:01.726258+0000","last_undegraded":"2024-09-11T14:39:01.726258+0000","last_fullsized":"2024-09-11T14:39:01.726258+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.730436+0000","last_change":"2024-09-11T14:25:18.105924+0000","last_active":"2024-09-11T14:39:01.730436+0000","last_peered":"2024-09-11T14:39:01.730436+0000","last_clean":"2024-09-11T14:39:01.730436+0000","last_became_active":"2024-09-11T14:25:18.076782+0000","last_became_peered":"2024-09-11T14:25:18.076782+0000","last_unstale":"2024-09-11T14:39:01.730436+0000","last_undegraded":"2024-09-11T14:39:01.730436+0000","last_fullsized":"2024-09-11T14:39:01.730436+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.724673+0000","last_change":"2024-09-11T14:25:18.108880+0000","last_active":"2024-09-11T14:39:01.724673+0000","last_peered":"2024-09-11T14:39:01.724673+0000","last_clean":"2024-09-11T14:39:01.724673+0000","last_became_active":"2024-09-11T14:25:18.090898+0000","last_became_peered":"2024-09-11T14:25:18.090898+0000","last_unstale":"2024-09-11T14:39:01.724673+0000","last_undegraded":"2024-09-11T14:39:01.724673+0000","last_fullsized":"2024-09-11T14:39:01.724673+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729038+0000","last_change":"2024-09-11T14:25:18.041164+0000","last_active":"2024-09-11T14:39:01.729038+0000","last_peered":"2024-09-11T14:39:01.729038+0000","last_clean":"2024-09-11T14:39:01.729038+0000","last_became_active":"2024-09-11T14:25:18.021680+0000","last_became_peered":"2024-09-11T14:25:18.021680+0000","last_unstale":"2024-09-11T14:39:01.729038+0000","last_undegraded":"2024-09-11T14:39:01.729038+0000","last_fullsized":"2024-09-11T14:39:01.729038+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727878+0000","last_change":"2024-09-11T14:25:18.005865+0000","last_active":"2024-09-11T14:39:01.727878+0000","last_peered":"2024-09-11T14:39:01.727878+0000","last_clean":"2024-09-11T14:39:01.727878+0000","last_became_active":"2024-09-11T14:25:17.997072+0000","last_became_peered":"2024-09-11T14:25:17.997072+0000","last_unstale":"2024-09-11T14:39:01.727878+0000","last_undegraded":"2024-09-11T14:39:01.727878+0000","last_fullsized":"2024-09-11T14:39:01.727878+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.708846+0000","last_change":"2024-09-11T14:25:18.065279+0000","last_active":"2024-09-11T14:39:01.708846+0000","last_peered":"2024-09-11T14:39:01.708846+0000","last_clean":"2024-09-11T14:39:01.708846+0000","last_became_active":"2024-09-11T14:25:18.024131+0000","last_became_peered":"2024-09-11T14:25:18.024131+0000","last_unstale":"2024-09-11T14:39:01.708846+0000","last_undegraded":"2024-09-11T14:39:01.708846+0000","last_fullsized":"2024-09-11T14:39:01.708846+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722562+0000","last_change":"2024-09-11T14:25:18.024308+0000","last_active":"2024-09-11T14:39:01.722562+0000","last_peered":"2024-09-11T14:39:01.722562+0000","last_clean":"2024-09-11T14:39:01.722562+0000","last_became_active":"2024-09-11T14:25:18.002727+0000","last_became_peered":"2024-09-11T14:25:18.002727+0000","last_unstale":"2024-09-11T14:39:01.722562+0000","last_undegraded":"2024-09-11T14:39:01.722562+0000","last_fullsized":"2024-09-11T14:39:01.722562+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713328+0000","last_change":"2024-09-11T14:25:18.184581+0000","last_active":"2024-09-11T14:39:01.713328+0000","last_peered":"2024-09-11T14:39:01.713328+0000","last_clean":"2024-09-11T14:39:01.713328+0000","last_became_active":"2024-09-11T14:25:18.176059+0000","last_became_peered":"2024-09-11T14:25:18.176059+0000","last_unstale":"2024-09-11T14:39:01.713328+0000","last_undegraded":"2024-09-11T14:39:01.713328+0000","last_fullsized":"2024-09-11T14:39:01.713328+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726404+0000","last_change":"2024-09-11T14:25:18.085645+0000","last_active":"2024-09-11T14:39:01.726404+0000","last_peered":"2024-09-11T14:39:01.726404+0000","last_clean":"2024-09-11T14:39:01.726404+0000","last_became_active":"2024-09-11T14:25:18.032463+0000","last_became_peered":"2024-09-11T14:25:18.032463+0000","last_unstale":"2024-09-11T14:39:01.726404+0000","last_undegraded":"2024-09-11T14:39:01.726404+0000","last_fullsized":"2024-09-11T14:39:01.726404+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720622+0000","last_change":"2024-09-11T14:25:18.104584+0000","last_active":"2024-09-11T14:39:01.720622+0000","last_peered":"2024-09-11T14:39:01.720622+0000","last_clean":"2024-09-11T14:39:01.720622+0000","last_became_active":"2024-09-11T14:25:18.095787+0000","last_became_peered":"2024-09-11T14:25:18.095787+0000","last_unstale":"2024-09-11T14:39:01.720622+0000","last_undegraded":"2024-09-11T14:39:01.720622+0000","last_fullsized":"2024-09-11T14:39:01.720622+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.710903+0000","last_change":"2024-09-11T14:25:18.032561+0000","last_active":"2024-09-11T14:39:01.710903+0000","last_peered":"2024-09-11T14:39:01.710903+0000","last_clean":"2024-09-11T14:39:01.710903+0000","last_became_active":"2024-09-11T14:25:18.008366+0000","last_became_peered":"2024-09-11T14:25:18.008366+0000","last_unstale":"2024-09-11T14:39:01.710903+0000","last_undegraded":"2024-09-11T14:39:01.710903+0000","last_fullsized":"2024-09-11T14:39:01.710903+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.720656+0000","last_change":"2024-09-11T14:25:18.036132+0000","last_active":"2024-09-11T14:39:01.720656+0000","last_peered":"2024-09-11T14:39:01.720656+0000","last_clean":"2024-09-11T14:39:01.720656+0000","last_became_active":"2024-09-11T14:25:17.998831+0000","last_became_peered":"2024-09-11T14:25:17.998831+0000","last_unstale":"2024-09-11T14:39:01.720656+0000","last_undegraded":"2024-09-11T14:39:01.720656+0000","last_fullsized":"2024-09-11T14:39:01.720656+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.726698+0000","last_change":"2024-09-11T14:25:18.024958+0000","last_active":"2024-09-11T14:39:01.726698+0000","last_peered":"2024-09-11T14:39:01.726698+0000","last_clean":"2024-09-11T14:39:01.726698+0000","last_became_active":"2024-09-11T14:25:17.997086+0000","last_became_peered":"2024-09-11T14:25:17.997086+0000","last_unstale":"2024-09-11T14:39:01.726698+0000","last_undegraded":"2024-09-11T14:39:01.726698+0000","last_fullsized":"2024-09-11T14:39:01.726698+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.719520+0000","last_change":"2024-09-11T14:25:17.998094+0000","last_active":"2024-09-11T14:39:01.719520+0000","last_peered":"2024-09-11T14:39:01.719520+0000","last_clean":"2024-09-11T14:39:01.719520+0000","last_became_active":"2024-09-11T14:25:17.975159+0000","last_became_peered":"2024-09-11T14:25:17.975159+0000","last_unstale":"2024-09-11T14:39:01.719520+0000","last_undegraded":"2024-09-11T14:39:01.719520+0000","last_fullsized":"2024-09-11T14:39:01.719520+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.714922+0000","last_change":"2024-09-11T14:25:18.052250+0000","last_active":"2024-09-11T14:39:01.714922+0000","last_peered":"2024-09-11T14:39:01.714922+0000","last_clean":"2024-09-11T14:39:01.714922+0000","last_became_active":"2024-09-11T14:25:17.980204+0000","last_became_peered":"2024-09-11T14:25:17.980204+0000","last_unstale":"2024-09-11T14:39:01.714922+0000","last_undegraded":"2024-09-11T14:39:01.714922+0000","last_fullsized":"2024-09-11T14:39:01.714922+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727283+0000","last_change":"2024-09-11T14:25:18.067709+0000","last_active":"2024-09-11T14:39:01.727283+0000","last_peered":"2024-09-11T14:39:01.727283+0000","last_clean":"2024-09-11T14:39:01.727283+0000","last_became_active":"2024-09-11T14:25:18.045624+0000","last_became_peered":"2024-09-11T14:25:18.045624+0000","last_unstale":"2024-09-11T14:39:01.727283+0000","last_undegraded":"2024-09-11T14:39:01.727283+0000","last_fullsized":"2024-09-11T14:39:01.727283+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.727546+0000","last_change":"2024-09-11T14:25:18.149907+0000","last_active":"2024-09-11T14:39:01.727546+0000","last_peered":"2024-09-11T14:39:01.727546+0000","last_clean":"2024-09-11T14:39:01.727546+0000","last_became_active":"2024-09-11T14:25:18.059476+0000","last_became_peered":"2024-09-11T14:25:18.059476+0000","last_unstale":"2024-09-11T14:39:01.727546+0000","last_undegraded":"2024-09-11T14:39:01.727546+0000","last_fullsized":"2024-09-11T14:39:01.727546+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1479,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.722147+0000","last_change":"2024-09-11T14:25:17.995302+0000","last_active":"2024-09-11T14:39:01.722147+0000","last_peered":"2024-09-11T14:39:01.722147+0000","last_clean":"2024-09-11T14:39:01.722147+0000","last_became_active":"2024-09-11T14:25:17.965924+0000","last_became_peered":"2024-09-11T14:25:17.965924+0000","last_unstale":"2024-09-11T14:39:01.722147+0000","last_undegraded":"2024-09-11T14:39:01.722147+0000","last_fullsized":"2024-09-11T14:39:01.722147+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1466,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721971+0000","last_change":"2024-09-11T14:25:18.017389+0000","last_active":"2024-09-11T14:39:01.721971+0000","last_peered":"2024-09-11T14:39:01.721971+0000","last_clean":"2024-09-11T14:39:01.721971+0000","last_became_active":"2024-09-11T14:25:18.009130+0000","last_became_peered":"2024-09-11T14:25:18.009130+0000","last_unstale":"2024-09-11T14:39:01.721971+0000","last_undegraded":"2024-09-11T14:39:01.721971+0000","last_fullsized":"2024-09-11T14:39:01.721971+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:25:16.834009+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.725196+0000","last_change":"2024-09-11T14:20:05.441963+0000","last_active":"2024-09-11T14:39:01.725196+0000","last_peered":"2024-09-11T14:39:01.725196+0000","last_clean":"2024-09-11T14:39:01.725196+0000","last_became_active":"2024-09-11T14:20:03.484694+0000","last_became_peered":"2024-09-11T14:20:03.484694+0000","last_unstale":"2024-09-11T14:39:01.725196+0000","last_undegraded":"2024-09-11T14:39:01.725196+0000","last_fullsized":"2024-09-11T14:39:01.725196+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.716804+0000","last_change":"2024-09-11T14:20:05.440901+0000","last_active":"2024-09-11T14:39:01.716804+0000","last_peered":"2024-09-11T14:39:01.716804+0000","last_clean":"2024-09-11T14:39:01.716804+0000","last_became_active":"2024-09-11T14:20:03.517121+0000","last_became_peered":"2024-09-11T14:20:03.517121+0000","last_unstale":"2024-09-11T14:39:01.716804+0000","last_undegraded":"2024-09-11T14:39:01.716804+0000","last_fullsized":"2024-09-11T14:39:01.716804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.729794+0000","last_change":"2024-09-11T14:20:05.436801+0000","last_active":"2024-09-11T14:39:01.729794+0000","last_peered":"2024-09-11T14:39:01.729794+0000","last_clean":"2024-09-11T14:39:01.729794+0000","last_became_active":"2024-09-11T14:20:03.488911+0000","last_became_peered":"2024-09-11T14:20:03.488911+0000","last_unstale":"2024-09-11T14:39:01.729794+0000","last_undegraded":"2024-09-11T14:39:01.729794+0000","last_fullsized":"2024-09-11T14:39:01.729794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713302+0000","last_change":"2024-09-11T14:20:05.435707+0000","last_active":"2024-09-11T14:39:01.713302+0000","last_peered":"2024-09-11T14:39:01.713302+0000","last_clean":"2024-09-11T14:39:01.713302+0000","last_became_active":"2024-09-11T14:20:03.480359+0000","last_became_peered":"2024-09-11T14:20:03.480359+0000","last_unstale":"2024-09-11T14:39:01.713302+0000","last_undegraded":"2024-09-11T14:39:01.713302+0000","last_fullsized":"2024-09-11T14:39:01.713302+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2147,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.731932+0000","last_change":"2024-09-11T14:20:05.443617+0000","last_active":"2024-09-11T14:39:01.731932+0000","last_peered":"2024-09-11T14:39:01.731932+0000","last_clean":"2024-09-11T14:39:01.731932+0000","last_became_active":"2024-09-11T14:20:03.479775+0000","last_became_peered":"2024-09-11T14:20:03.479775+0000","last_unstale":"2024-09-11T14:39:01.731932+0000","last_undegraded":"2024-09-11T14:39:01.731932+0000","last_fullsized":"2024-09-11T14:39:01.731932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2151,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.713868+0000","last_change":"2024-09-11T14:20:05.435614+0000","last_active":"2024-09-11T14:39:01.713868+0000","last_peered":"2024-09-11T14:39:01.713868+0000","last_clean":"2024-09-11T14:39:01.713868+0000","last_became_active":"2024-09-11T14:20:03.469827+0000","last_became_peered":"2024-09-11T14:20:03.469827+0000","last_unstale":"2024-09-11T14:39:01.713868+0000","last_undegraded":"2024-09-11T14:39:01.713868+0000","last_fullsized":"2024-09-11T14:39:01.713868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2145,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.721904+0000","last_change":"2024-09-11T14:20:05.442983+0000","last_active":"2024-09-11T14:39:01.721904+0000","last_peered":"2024-09-11T14:39:01.721904+0000","last_clean":"2024-09-11T14:39:01.721904+0000","last_became_active":"2024-09-11T14:20:03.491981+0000","last_became_peered":"2024-09-11T14:20:03.491981+0000","last_unstale":"2024-09-11T14:39:01.721904+0000","last_undegraded":"2024-09-11T14:39:01.721904+0000","last_fullsized":"2024-09-11T14:39:01.721904+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2152,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.730323+0000","last_change":"2024-09-11T14:20:05.440350+0000","last_active":"2024-09-11T14:39:01.730323+0000","last_peered":"2024-09-11T14:39:01.730323+0000","last_clean":"2024-09-11T14:39:01.730323+0000","last_became_active":"2024-09-11T14:20:03.498001+0000","last_became_peered":"2024-09-11T14:20:03.498001+0000","last_unstale":"2024-09-11T14:39:01.730323+0000","last_undegraded":"2024-09-11T14:39:01.730323+0000","last_fullsized":"2024-09-11T14:39:01.730323+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:02.399958+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2223,"reported_epoch":727,"state":"active+clean","last_fresh":"2024-09-11T14:39:01.714639+0000","last_change":"2024-09-11T14:20:01.465936+0000","last_active":"2024-09-11T14:39:01.714639+0000","last_peered":"2024-09-11T14:39:01.714639+0000","last_clean":"2024-09-11T14:39:01.714639+0000","last_became_active":"2024-09-11T14:20:01.446610+0000","last_became_peered":"2024-09-11T14:20:01.446610+0000","last_unstale":"2024-09-11T14:39:01.714639+0000","last_undegraded":"2024-09-11T14:39:01.714639+0000","last_fullsized":"2024-09-11T14:39:01.714639+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:20:00.391487+0000","last_clean_scrub_stamp":"2024-09-11T14:20:00.391487+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214187597824,"internally_reserved":0,"allocated":23896064,"data_stored":23896064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6212,"kb_used_data":6212,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52291516,"statfs":{"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5264,"kb_used_data":5264,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292464,"statfs":{"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":5100,"kb_used_data":5100,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292628,"statfs":{"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":6760,"kb_used_data":6760,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52290968,"statfs":{"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53545951232,"internally_reserved":0,"allocated":6922240,"data_stored":6922240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53547651072,"internally_reserved":0,"allocated":5222400,"data_stored":5222400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53547483136,"internally_reserved":0,"allocated":5390336,"data_stored":5390336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53546512384,"internally_reserved":0,"allocated":6361088,"data_stored":6361088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:39.068 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.068 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.068 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.069 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.069 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.069 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.069 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.069 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.069 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.069 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.069 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.070 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.070 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.070 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.070 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.070 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.070 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.070 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.070 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.070 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.071 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.071 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.071 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.071 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.071 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.071 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.071 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.071 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.071 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.072 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.072 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.072 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-11T14:25:16.834009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=25, tm_sec=16, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.072 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T14:20:02.399958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=20, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.072 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T14:20:02.399958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=20, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.072 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T14:20:02.399958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=20, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.072 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T14:20:02.399958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=20, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.072 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T14:20:02.399958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=20, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.072 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T14:20:02.399958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=20, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.073 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T14:20:02.399958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=20, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.073 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T14:20:02.399958+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=20, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.073 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T14:20:00.391487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=20, tm_sec=0, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=14, tm_min=39, tm_sec=35, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T14:39:39.073 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T14:39:59.074 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T14:39:59.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.196+0000 7f5800ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:59.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.202+0000 7f5800ed1640 1 Processor -- start 2024-09-11T14:39:59.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.202+0000 7f5800ed1640 1 -- start start 2024-09-11T14:39:59.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.203+0000 7f5800ed1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57fc1365c0 0x7f57fc1389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.203+0000 7f5800ed1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57fc0745e0 con 0x7f57fc130470 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.203+0000 7f5800ed1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f57fc0740f0 con 0x7f57fc1365c0 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57f3fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f57fc1365c0 0x7f57fc1389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57fa59c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f57fc130470 0x7f57fc130880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36486/0 (socket says 172.21.15.46:36486) 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57fa59c640 1 -- 172.21.15.46:0/163622975 learned_addr learned my addr 172.21.15.46:0/163622975 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57f3fff640 1 -- 172.21.15.46:0/163622975 >> v1:172.21.15.46:6789/0 conn(0x7f57fc130470 legacy=0x7f57fc130880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57f3fff640 1 -- 172.21.15.46:0/163622975 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc0749a0 con 0x7f57fc1365c0 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57f9d9b640 1 -- 172.21.15.46:0/163622975 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775281752 0 0) 0x7f57fc0745e0 con 0x7f57fc130470 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57f3fff640 1 --2- 172.21.15.46:0/163622975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc1365c0 0x7f57fc1389e0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7627c5af81a9b4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57f9d9b640 1 -- 172.21.15.46:0/163622975 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57e4009d90 con 0x7f57fc1365c0 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57f9d9b640 1 -- 172.21.15.46:0/163622975 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57e400e230 con 0x7f57fc1365c0 2024-09-11T14:39:59.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.204+0000 7f57f9d9b640 1 -- 172.21.15.46:0/163622975 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57e400e4d0 con 0x7f57fc1365c0 2024-09-11T14:39:59.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.205+0000 7f5800ed1640 1 -- 172.21.15.46:0/163622975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc1365c0 msgr2=0x7f57fc1389e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:59.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.205+0000 7f5800ed1640 1 --2- 172.21.15.46:0/163622975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc1365c0 0x7f57fc1389e0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.205+0000 7f5800ed1640 1 -- 172.21.15.46:0/163622975 shutdown_connections 2024-09-11T14:39:59.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.205+0000 7f5800ed1640 1 --2- 172.21.15.46:0/163622975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc1365c0 0x7f57fc1389e0 unknown :-1 s=CLOSED pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.205+0000 7f5800ed1640 1 -- 172.21.15.46:0/163622975 >> 172.21.15.46:0/163622975 conn(0x7f57fc0690e0 msgr2=0x7f57fc0694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:59.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.205+0000 7f5800ed1640 1 -- 172.21.15.46:0/163622975 shutdown_connections 2024-09-11T14:39:59.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.205+0000 7f5800ed1640 1 -- 172.21.15.46:0/163622975 wait complete. 2024-09-11T14:39:59.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.205+0000 7f5800ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:59.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.207+0000 7f5800ed1640 1 Processor -- start 2024-09-11T14:39:59.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.207+0000 7f5800ed1640 1 -- start start 2024-09-11T14:39:59.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.209+0000 7f5800ed1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc130470 0x7f57fc11d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:59.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.209+0000 7f5800ed1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc1209b0 con 0x7f57fc130470 2024-09-11T14:39:59.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.209+0000 7f57fa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc130470 0x7f57fc11d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:59.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.209+0000 7f57fa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc130470 0x7f57fc11d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34394/0 (socket says 172.21.15.46:34394) 2024-09-11T14:39:59.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.209+0000 7f57fa59c640 1 -- 172.21.15.46:0/1230519509 learned_addr learned my addr 172.21.15.46:0/1230519509 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:59.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.209+0000 7f57fa59c640 1 -- 172.21.15.46:0/1230519509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc11e430 con 0x7f57fc130470 2024-09-11T14:39:59.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.210+0000 7f57fa59c640 1 --2- 172.21.15.46:0/1230519509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc130470 0x7f57fc11d040 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:59.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.210+0000 7f57f2ffd640 1 -- 172.21.15.46:0/1230519509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57ec004b80 con 0x7f57fc130470 2024-09-11T14:39:59.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.210+0000 7f57f2ffd640 1 -- 172.21.15.46:0/1230519509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57ec004ce0 con 0x7f57fc130470 2024-09-11T14:39:59.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.210+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57fc11f2e0 con 0x7f57fc130470 2024-09-11T14:39:59.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.210+0000 7f57f2ffd640 1 -- 172.21.15.46:0/1230519509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57ec007120 con 0x7f57fc130470 2024-09-11T14:39:59.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.210+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57fc11fdb0 con 0x7f57fc130470 2024-09-11T14:39:59.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.211+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57fc06a300 con 0x7f57fc130470 2024-09-11T14:39:59.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.211+0000 7f57f2ffd640 1 -- 172.21.15.46:0/1230519509 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f57ec0072d0 con 0x7f57fc130470 2024-09-11T14:39:59.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.211+0000 7f57f2ffd640 1 --2- 172.21.15.46:0/1230519509 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57dc03e930 0x7f57dc040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:59.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.211+0000 7f57f2ffd640 1 -- 172.21.15.46:0/1230519509 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f57ec04fb40 con 0x7f57fc130470 2024-09-11T14:39:59.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.212+0000 7f57f3fff640 1 --2- 172.21.15.46:0/1230519509 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57dc03e930 0x7f57dc040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:59.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.212+0000 7f57f3fff640 1 --2- 172.21.15.46:0/1230519509 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57dc03e930 0x7f57dc040e40 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:59.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.216+0000 7f57f2ffd640 1 -- 172.21.15.46:0/1230519509 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f57ec00f420 con 0x7f57fc130470 2024-09-11T14:39:59.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.401+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 --> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57fc11ced0 con 0x7f57dc03e930 2024-09-11T14:39:59.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.404+0000 7f57f2ffd640 1 -- 172.21.15.46:0/1230519509 <== mgr.4100 v2:172.21.15.47:6800/455983768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109422 (crc 0 0 0) 0x7f57fc11ced0 con 0x7f57dc03e930 2024-09-11T14:39:59.406 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-11T14:39:59.406 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-11T14:39:59.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57dc03e930 msgr2=0x7f57dc040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:59.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 --2- 172.21.15.46:0/1230519509 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57dc03e930 0x7f57dc040e40 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc130470 msgr2=0x7f57fc11d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:59.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 --2- 172.21.15.46:0/1230519509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc130470 0x7f57fc11d040 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 shutdown_connections 2024-09-11T14:39:59.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 --2- 172.21.15.46:0/1230519509 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f57dc03e930 0x7f57dc040e40 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 --2- 172.21.15.46:0/1230519509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57fc130470 0x7f57fc11d040 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 >> 172.21.15.46:0/1230519509 conn(0x7f57fc0690e0 msgr2=0x7f57fc1343a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:59.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 shutdown_connections 2024-09-11T14:39:59.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.406+0000 7f5800ed1640 1 -- 172.21.15.46:0/1230519509 wait complete. 2024-09-11T14:39:59.419 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1321,"stamp":"2024-09-11T14:39:58.628145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":16344,"kb_used_data":16344,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209174568,"statfs":{"total":214211493888,"available":214194757632,"internally_reserved":0,"allocated":16736256,"data_stored":16736256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002923"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.743861+0000","last_change":"2024-09-11T14:39:37.778599+0000","last_active":"2024-09-11T14:39:37.743861+0000","last_peered":"2024-09-11T14:39:37.743861+0000","last_clean":"2024-09-11T14:39:37.743861+0000","last_became_active":"2024-09-11T14:25:17.959003+0000","last_became_peered":"2024-09-11T14:25:17.959003+0000","last_unstale":"2024-09-11T14:39:37.743861+0000","last_undegraded":"2024-09-11T14:39:37.743861+0000","last_fullsized":"2024-09-11T14:39:37.743861+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.778418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.778418+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.258871+0000","last_change":"2024-09-11T14:39:37.302859+0000","last_active":"2024-09-11T14:39:37.258871+0000","last_peered":"2024-09-11T14:39:37.258871+0000","last_clean":"2024-09-11T14:39:37.258871+0000","last_became_active":"2024-09-11T14:25:18.057804+0000","last_became_peered":"2024-09-11T14:25:18.057804+0000","last_unstale":"2024-09-11T14:39:37.258871+0000","last_undegraded":"2024-09-11T14:39:37.258871+0000","last_fullsized":"2024-09-11T14:39:37.258871+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.302675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.302675+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.236971+0000","last_change":"2024-09-11T14:39:38.267893+0000","last_active":"2024-09-11T14:39:38.236971+0000","last_peered":"2024-09-11T14:39:38.236971+0000","last_clean":"2024-09-11T14:39:38.236971+0000","last_became_active":"2024-09-11T14:25:17.997485+0000","last_became_peered":"2024-09-11T14:25:17.997485+0000","last_unstale":"2024-09-11T14:39:38.236971+0000","last_undegraded":"2024-09-11T14:39:38.236971+0000","last_fullsized":"2024-09-11T14:39:38.236971+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.267660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.267660+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.732151+0000","last_change":"2024-09-11T14:39:38.768690+0000","last_active":"2024-09-11T14:39:38.732151+0000","last_peered":"2024-09-11T14:39:38.732151+0000","last_clean":"2024-09-11T14:39:38.732151+0000","last_became_active":"2024-09-11T14:25:17.988591+0000","last_became_peered":"2024-09-11T14:25:17.988591+0000","last_unstale":"2024-09-11T14:39:38.732151+0000","last_undegraded":"2024-09-11T14:39:38.732151+0000","last_fullsized":"2024-09-11T14:39:38.732151+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.768369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.768369+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.744678+0000","last_change":"2024-09-11T14:39:37.783223+0000","last_active":"2024-09-11T14:39:37.744678+0000","last_peered":"2024-09-11T14:39:37.744678+0000","last_clean":"2024-09-11T14:39:37.744678+0000","last_became_active":"2024-09-11T14:25:18.001149+0000","last_became_peered":"2024-09-11T14:25:18.001149+0000","last_unstale":"2024-09-11T14:39:37.744678+0000","last_undegraded":"2024-09-11T14:39:37.744678+0000","last_fullsized":"2024-09-11T14:39:37.744678+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.782889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.782889+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.250861+0000","last_change":"2024-09-11T14:39:37.298634+0000","last_active":"2024-09-11T14:39:37.250861+0000","last_peered":"2024-09-11T14:39:37.250861+0000","last_clean":"2024-09-11T14:39:37.250861+0000","last_became_active":"2024-09-11T14:25:17.962220+0000","last_became_peered":"2024-09-11T14:25:17.962220+0000","last_unstale":"2024-09-11T14:39:37.250861+0000","last_undegraded":"2024-09-11T14:39:37.250861+0000","last_fullsized":"2024-09-11T14:39:37.250861+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.298447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.298447+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.251324+0000","last_change":"2024-09-11T14:39:37.273355+0000","last_active":"2024-09-11T14:39:37.251324+0000","last_peered":"2024-09-11T14:39:37.251324+0000","last_clean":"2024-09-11T14:39:37.251324+0000","last_became_active":"2024-09-11T14:25:18.001816+0000","last_became_peered":"2024-09-11T14:25:18.001816+0000","last_unstale":"2024-09-11T14:39:37.251324+0000","last_undegraded":"2024-09-11T14:39:37.251324+0000","last_fullsized":"2024-09-11T14:39:37.251324+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.273165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.273165+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.253747+0000","last_change":"2024-09-11T14:39:37.298806+0000","last_active":"2024-09-11T14:39:37.253747+0000","last_peered":"2024-09-11T14:39:37.253747+0000","last_clean":"2024-09-11T14:39:37.253747+0000","last_became_active":"2024-09-11T14:25:18.014278+0000","last_became_peered":"2024-09-11T14:25:18.014278+0000","last_unstale":"2024-09-11T14:39:37.253747+0000","last_undegraded":"2024-09-11T14:39:37.253747+0000","last_fullsized":"2024-09-11T14:39:37.253747+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.298630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.298630+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.730965+0000","last_change":"2024-09-11T14:39:38.770808+0000","last_active":"2024-09-11T14:39:38.730965+0000","last_peered":"2024-09-11T14:39:38.730965+0000","last_clean":"2024-09-11T14:39:38.730965+0000","last_became_active":"2024-09-11T14:25:18.116721+0000","last_became_peered":"2024-09-11T14:25:18.116721+0000","last_unstale":"2024-09-11T14:39:38.730965+0000","last_undegraded":"2024-09-11T14:39:38.730965+0000","last_fullsized":"2024-09-11T14:39:38.730965+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.770592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.770592+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.235773+0000","last_change":"2024-09-11T14:39:38.264322+0000","last_active":"2024-09-11T14:39:38.235773+0000","last_peered":"2024-09-11T14:39:38.235773+0000","last_clean":"2024-09-11T14:39:38.235773+0000","last_became_active":"2024-09-11T14:25:17.956766+0000","last_became_peered":"2024-09-11T14:25:17.956766+0000","last_unstale":"2024-09-11T14:39:38.235773+0000","last_undegraded":"2024-09-11T14:39:38.235773+0000","last_fullsized":"2024-09-11T14:39:38.235773+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.264095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.264095+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.728776+0000","last_change":"2024-09-11T14:39:38.771924+0000","last_active":"2024-09-11T14:39:38.728776+0000","last_peered":"2024-09-11T14:39:38.728776+0000","last_clean":"2024-09-11T14:39:38.728776+0000","last_became_active":"2024-09-11T14:25:18.047823+0000","last_became_peered":"2024-09-11T14:25:18.047823+0000","last_unstale":"2024-09-11T14:39:38.728776+0000","last_undegraded":"2024-09-11T14:39:38.728776+0000","last_fullsized":"2024-09-11T14:39:38.728776+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.771717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.771717+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.247326+0000","last_change":"2024-09-11T14:39:37.284980+0000","last_active":"2024-09-11T14:39:37.247326+0000","last_peered":"2024-09-11T14:39:37.247326+0000","last_clean":"2024-09-11T14:39:37.247326+0000","last_became_active":"2024-09-11T14:25:18.071958+0000","last_became_peered":"2024-09-11T14:25:18.071958+0000","last_unstale":"2024-09-11T14:39:37.247326+0000","last_undegraded":"2024-09-11T14:39:37.247326+0000","last_fullsized":"2024-09-11T14:39:37.247326+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.284657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.284657+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.725526+0000","last_change":"2024-09-11T14:39:38.774165+0000","last_active":"2024-09-11T14:39:38.725526+0000","last_peered":"2024-09-11T14:39:38.725526+0000","last_clean":"2024-09-11T14:39:38.725526+0000","last_became_active":"2024-09-11T14:25:18.097464+0000","last_became_peered":"2024-09-11T14:25:18.097464+0000","last_unstale":"2024-09-11T14:39:38.725526+0000","last_undegraded":"2024-09-11T14:39:38.725526+0000","last_fullsized":"2024-09-11T14:39:38.725526+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.773969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.773969+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.727089+0000","last_change":"2024-09-11T14:39:38.770005+0000","last_active":"2024-09-11T14:39:38.727089+0000","last_peered":"2024-09-11T14:39:38.727089+0000","last_clean":"2024-09-11T14:39:38.727089+0000","last_became_active":"2024-09-11T14:25:18.228702+0000","last_became_peered":"2024-09-11T14:25:18.228702+0000","last_unstale":"2024-09-11T14:39:38.727089+0000","last_undegraded":"2024-09-11T14:39:38.727089+0000","last_fullsized":"2024-09-11T14:39:38.727089+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.769801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.769801+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.251630+0000","last_change":"2024-09-11T14:39:37.299527+0000","last_active":"2024-09-11T14:39:37.251630+0000","last_peered":"2024-09-11T14:39:37.251630+0000","last_clean":"2024-09-11T14:39:37.251630+0000","last_became_active":"2024-09-11T14:25:18.076782+0000","last_became_peered":"2024-09-11T14:25:18.076782+0000","last_unstale":"2024-09-11T14:39:37.251630+0000","last_undegraded":"2024-09-11T14:39:37.251630+0000","last_fullsized":"2024-09-11T14:39:37.251630+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.299344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.299344+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.249680+0000","last_change":"2024-09-11T14:39:37.292063+0000","last_active":"2024-09-11T14:39:37.249680+0000","last_peered":"2024-09-11T14:39:37.249680+0000","last_clean":"2024-09-11T14:39:37.249680+0000","last_became_active":"2024-09-11T14:25:18.090898+0000","last_became_peered":"2024-09-11T14:25:18.090898+0000","last_unstale":"2024-09-11T14:39:37.249680+0000","last_undegraded":"2024-09-11T14:39:37.249680+0000","last_fullsized":"2024-09-11T14:39:37.249680+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.291850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.291850+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.247963+0000","last_change":"2024-09-11T14:39:37.296584+0000","last_active":"2024-09-11T14:39:37.247963+0000","last_peered":"2024-09-11T14:39:37.247963+0000","last_clean":"2024-09-11T14:39:37.247963+0000","last_became_active":"2024-09-11T14:25:18.021680+0000","last_became_peered":"2024-09-11T14:25:18.021680+0000","last_unstale":"2024-09-11T14:39:37.247963+0000","last_undegraded":"2024-09-11T14:39:37.247963+0000","last_fullsized":"2024-09-11T14:39:37.247963+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.296384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.296384+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.723994+0000","last_change":"2024-09-11T14:39:38.756514+0000","last_active":"2024-09-11T14:39:38.723994+0000","last_peered":"2024-09-11T14:39:38.723994+0000","last_clean":"2024-09-11T14:39:38.723994+0000","last_became_active":"2024-09-11T14:25:17.997072+0000","last_became_peered":"2024-09-11T14:25:17.997072+0000","last_unstale":"2024-09-11T14:39:38.723994+0000","last_undegraded":"2024-09-11T14:39:38.723994+0000","last_fullsized":"2024-09-11T14:39:38.723994+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.756302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.756302+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.232479+0000","last_change":"2024-09-11T14:39:38.260038+0000","last_active":"2024-09-11T14:39:38.232479+0000","last_peered":"2024-09-11T14:39:38.232479+0000","last_clean":"2024-09-11T14:39:38.232479+0000","last_became_active":"2024-09-11T14:25:18.024131+0000","last_became_peered":"2024-09-11T14:25:18.024131+0000","last_unstale":"2024-09-11T14:39:38.232479+0000","last_undegraded":"2024-09-11T14:39:38.232479+0000","last_fullsized":"2024-09-11T14:39:38.232479+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.259655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.259655+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.741581+0000","last_change":"2024-09-11T14:39:37.775791+0000","last_active":"2024-09-11T14:39:37.741581+0000","last_peered":"2024-09-11T14:39:37.741581+0000","last_clean":"2024-09-11T14:39:37.741581+0000","last_became_active":"2024-09-11T14:25:18.002727+0000","last_became_peered":"2024-09-11T14:25:18.002727+0000","last_unstale":"2024-09-11T14:39:37.741581+0000","last_undegraded":"2024-09-11T14:39:37.741581+0000","last_fullsized":"2024-09-11T14:39:37.741581+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.775599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.775599+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.741112+0000","last_change":"2024-09-11T14:39:37.781019+0000","last_active":"2024-09-11T14:39:37.741112+0000","last_peered":"2024-09-11T14:39:37.741112+0000","last_clean":"2024-09-11T14:39:37.741112+0000","last_became_active":"2024-09-11T14:25:18.176059+0000","last_became_peered":"2024-09-11T14:25:18.176059+0000","last_unstale":"2024-09-11T14:39:37.741112+0000","last_undegraded":"2024-09-11T14:39:37.741112+0000","last_fullsized":"2024-09-11T14:39:37.741112+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.780814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.780814+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.741608+0000","last_change":"2024-09-11T14:39:37.780639+0000","last_active":"2024-09-11T14:39:37.741608+0000","last_peered":"2024-09-11T14:39:37.741608+0000","last_clean":"2024-09-11T14:39:37.741608+0000","last_became_active":"2024-09-11T14:25:18.032463+0000","last_became_peered":"2024-09-11T14:25:18.032463+0000","last_unstale":"2024-09-11T14:39:37.741608+0000","last_undegraded":"2024-09-11T14:39:37.741608+0000","last_fullsized":"2024-09-11T14:39:37.741608+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.780445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.780445+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.236014+0000","last_change":"2024-09-11T14:39:38.267123+0000","last_active":"2024-09-11T14:39:38.236014+0000","last_peered":"2024-09-11T14:39:38.236014+0000","last_clean":"2024-09-11T14:39:38.236014+0000","last_became_active":"2024-09-11T14:25:18.095787+0000","last_became_peered":"2024-09-11T14:25:18.095787+0000","last_unstale":"2024-09-11T14:39:38.236014+0000","last_undegraded":"2024-09-11T14:39:38.236014+0000","last_fullsized":"2024-09-11T14:39:38.236014+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.266890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.266890+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.721512+0000","last_change":"2024-09-11T14:39:38.772268+0000","last_active":"2024-09-11T14:39:38.721512+0000","last_peered":"2024-09-11T14:39:38.721512+0000","last_clean":"2024-09-11T14:39:38.721512+0000","last_became_active":"2024-09-11T14:25:18.008366+0000","last_became_peered":"2024-09-11T14:25:18.008366+0000","last_unstale":"2024-09-11T14:39:38.721512+0000","last_undegraded":"2024-09-11T14:39:38.721512+0000","last_fullsized":"2024-09-11T14:39:38.721512+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.772068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.772068+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.721397+0000","last_change":"2024-09-11T14:39:38.753881+0000","last_active":"2024-09-11T14:39:38.721397+0000","last_peered":"2024-09-11T14:39:38.721397+0000","last_clean":"2024-09-11T14:39:38.721397+0000","last_became_active":"2024-09-11T14:25:17.998831+0000","last_became_peered":"2024-09-11T14:25:17.998831+0000","last_unstale":"2024-09-11T14:39:38.721397+0000","last_undegraded":"2024-09-11T14:39:38.721397+0000","last_fullsized":"2024-09-11T14:39:38.721397+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.753485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.753485+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.247149+0000","last_change":"2024-09-11T14:39:37.270366+0000","last_active":"2024-09-11T14:39:37.247149+0000","last_peered":"2024-09-11T14:39:37.247149+0000","last_clean":"2024-09-11T14:39:37.247149+0000","last_became_active":"2024-09-11T14:25:17.997086+0000","last_became_peered":"2024-09-11T14:25:17.997086+0000","last_unstale":"2024-09-11T14:39:37.247149+0000","last_undegraded":"2024-09-11T14:39:37.247149+0000","last_fullsized":"2024-09-11T14:39:37.247149+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.270176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.270176+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.719610+0000","last_change":"2024-09-11T14:39:38.762241+0000","last_active":"2024-09-11T14:39:38.719610+0000","last_peered":"2024-09-11T14:39:38.719610+0000","last_clean":"2024-09-11T14:39:38.719610+0000","last_became_active":"2024-09-11T14:25:17.975159+0000","last_became_peered":"2024-09-11T14:25:17.975159+0000","last_unstale":"2024-09-11T14:39:38.719610+0000","last_undegraded":"2024-09-11T14:39:38.719610+0000","last_fullsized":"2024-09-11T14:39:38.719610+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.762020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.762020+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.243529+0000","last_change":"2024-09-11T14:39:37.281463+0000","last_active":"2024-09-11T14:39:37.243529+0000","last_peered":"2024-09-11T14:39:37.243529+0000","last_clean":"2024-09-11T14:39:37.243529+0000","last_became_active":"2024-09-11T14:25:17.980204+0000","last_became_peered":"2024-09-11T14:25:17.980204+0000","last_unstale":"2024-09-11T14:39:37.243529+0000","last_undegraded":"2024-09-11T14:39:37.243529+0000","last_fullsized":"2024-09-11T14:39:37.243529+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.281264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.281264+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.242304+0000","last_change":"2024-09-11T14:39:37.261631+0000","last_active":"2024-09-11T14:39:37.242304+0000","last_peered":"2024-09-11T14:39:37.242304+0000","last_clean":"2024-09-11T14:39:37.242304+0000","last_became_active":"2024-09-11T14:25:18.045624+0000","last_became_peered":"2024-09-11T14:25:18.045624+0000","last_unstale":"2024-09-11T14:39:37.242304+0000","last_undegraded":"2024-09-11T14:39:37.242304+0000","last_fullsized":"2024-09-11T14:39:37.242304+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.261437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.261437+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.242265+0000","last_change":"2024-09-11T14:39:37.275522+0000","last_active":"2024-09-11T14:39:37.242265+0000","last_peered":"2024-09-11T14:39:37.242265+0000","last_clean":"2024-09-11T14:39:37.242265+0000","last_became_active":"2024-09-11T14:25:18.059476+0000","last_became_peered":"2024-09-11T14:25:18.059476+0000","last_unstale":"2024-09-11T14:39:37.242265+0000","last_undegraded":"2024-09-11T14:39:37.242265+0000","last_fullsized":"2024-09-11T14:39:37.242265+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.275340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.275340+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"241'7","reported_seq":1487,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.739889+0000","last_change":"2024-09-11T14:39:37.778147+0000","last_active":"2024-09-11T14:39:37.739889+0000","last_peered":"2024-09-11T14:39:37.739889+0000","last_clean":"2024-09-11T14:39:37.739889+0000","last_became_active":"2024-09-11T14:25:17.965924+0000","last_became_peered":"2024-09-11T14:25:17.965924+0000","last_unstale":"2024-09-11T14:39:37.739889+0000","last_undegraded":"2024-09-11T14:39:37.739889+0000","last_fullsized":"2024-09-11T14:39:37.739889+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"241'7","last_scrub_stamp":"2024-09-11T14:39:37.777917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.777917+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1474,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.233864+0000","last_change":"2024-09-11T14:39:38.263245+0000","last_active":"2024-09-11T14:39:38.233864+0000","last_peered":"2024-09-11T14:39:38.233864+0000","last_clean":"2024-09-11T14:39:38.233864+0000","last_became_active":"2024-09-11T14:25:18.009130+0000","last_became_peered":"2024-09-11T14:25:18.009130+0000","last_unstale":"2024-09-11T14:39:38.233864+0000","last_undegraded":"2024-09-11T14:39:38.233864+0000","last_fullsized":"2024-09-11T14:39:38.233864+0000","mapping_epoch":240,"log_start":"0'0","ondisk_log_start":"0'0","created":240,"last_epoch_clean":241,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.263015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.263015+0000","last_clean_scrub_stamp":"2024-09-11T14:25:16.834009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2159,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.739377+0000","last_change":"2024-09-11T14:39:37.767392+0000","last_active":"2024-09-11T14:39:37.739377+0000","last_peered":"2024-09-11T14:39:37.739377+0000","last_clean":"2024-09-11T14:39:37.739377+0000","last_became_active":"2024-09-11T14:20:03.484694+0000","last_became_peered":"2024-09-11T14:20:03.484694+0000","last_unstale":"2024-09-11T14:39:37.739377+0000","last_undegraded":"2024-09-11T14:39:37.739377+0000","last_fullsized":"2024-09-11T14:39:37.739377+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.767202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.767202+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2159,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.232400+0000","last_change":"2024-09-11T14:39:38.259890+0000","last_active":"2024-09-11T14:39:38.232400+0000","last_peered":"2024-09-11T14:39:38.232400+0000","last_clean":"2024-09-11T14:39:38.232400+0000","last_became_active":"2024-09-11T14:20:03.517121+0000","last_became_peered":"2024-09-11T14:20:03.517121+0000","last_unstale":"2024-09-11T14:39:38.232400+0000","last_undegraded":"2024-09-11T14:39:38.232400+0000","last_fullsized":"2024-09-11T14:39:38.232400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.259647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.259647+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2159,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.716873+0000","last_change":"2024-09-11T14:39:38.744952+0000","last_active":"2024-09-11T14:39:38.716873+0000","last_peered":"2024-09-11T14:39:38.716873+0000","last_clean":"2024-09-11T14:39:38.716873+0000","last_became_active":"2024-09-11T14:20:03.488911+0000","last_became_peered":"2024-09-11T14:20:03.488911+0000","last_unstale":"2024-09-11T14:39:38.716873+0000","last_undegraded":"2024-09-11T14:39:38.716873+0000","last_fullsized":"2024-09-11T14:39:38.716873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.744593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.744593+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2159,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.229985+0000","last_change":"2024-09-11T14:39:38.264985+0000","last_active":"2024-09-11T14:39:38.229985+0000","last_peered":"2024-09-11T14:39:38.229985+0000","last_clean":"2024-09-11T14:39:38.229985+0000","last_became_active":"2024-09-11T14:20:03.480359+0000","last_became_peered":"2024-09-11T14:20:03.480359+0000","last_unstale":"2024-09-11T14:39:38.229985+0000","last_undegraded":"2024-09-11T14:39:38.229985+0000","last_fullsized":"2024-09-11T14:39:38.229985+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:38.264769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.264769+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2155,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.243761+0000","last_change":"2024-09-11T14:39:37.305600+0000","last_active":"2024-09-11T14:39:37.243761+0000","last_peered":"2024-09-11T14:39:37.243761+0000","last_clean":"2024-09-11T14:39:37.243761+0000","last_became_active":"2024-09-11T14:20:03.479775+0000","last_became_peered":"2024-09-11T14:20:03.479775+0000","last_unstale":"2024-09-11T14:39:37.243761+0000","last_undegraded":"2024-09-11T14:39:37.243761+0000","last_fullsized":"2024-09-11T14:39:37.243761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-11T14:39:37.305390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.305390+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2159,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.736822+0000","last_change":"2024-09-11T14:39:37.770073+0000","last_active":"2024-09-11T14:39:37.736822+0000","last_peered":"2024-09-11T14:39:37.736822+0000","last_clean":"2024-09-11T14:39:37.736822+0000","last_became_active":"2024-09-11T14:20:03.469827+0000","last_became_peered":"2024-09-11T14:20:03.469827+0000","last_unstale":"2024-09-11T14:39:37.736822+0000","last_undegraded":"2024-09-11T14:39:37.736822+0000","last_fullsized":"2024-09-11T14:39:37.736822+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.769868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.769868+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2153,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.242580+0000","last_change":"2024-09-11T14:39:37.273219+0000","last_active":"2024-09-11T14:39:37.242580+0000","last_peered":"2024-09-11T14:39:37.242580+0000","last_clean":"2024-09-11T14:39:37.242580+0000","last_became_active":"2024-09-11T14:20:03.491981+0000","last_became_peered":"2024-09-11T14:20:03.491981+0000","last_unstale":"2024-09-11T14:39:37.242580+0000","last_undegraded":"2024-09-11T14:39:37.242580+0000","last_fullsized":"2024-09-11T14:39:37.242580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T14:39:37.273018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.273018+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2160,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:37.738223+0000","last_change":"2024-09-11T14:39:37.784510+0000","last_active":"2024-09-11T14:39:37.738223+0000","last_peered":"2024-09-11T14:39:37.738223+0000","last_clean":"2024-09-11T14:39:37.738223+0000","last_became_active":"2024-09-11T14:20:03.498001+0000","last_became_peered":"2024-09-11T14:20:03.498001+0000","last_unstale":"2024-09-11T14:39:37.738223+0000","last_undegraded":"2024-09-11T14:39:37.738223+0000","last_fullsized":"2024-09-11T14:39:37.738223+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-11T14:39:37.784312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:37.784312+0000","last_clean_scrub_stamp":"2024-09-11T14:20:02.399958+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2231,"reported_epoch":729,"state":"active+clean","last_fresh":"2024-09-11T14:39:38.716603+0000","last_change":"2024-09-11T14:39:38.792397+0000","last_active":"2024-09-11T14:39:38.716603+0000","last_peered":"2024-09-11T14:39:38.716603+0000","last_clean":"2024-09-11T14:39:38.716603+0000","last_became_active":"2024-09-11T14:20:01.446610+0000","last_became_peered":"2024-09-11T14:20:01.446610+0000","last_unstale":"2024-09-11T14:39:38.716603+0000","last_undegraded":"2024-09-11T14:39:38.716603+0000","last_fullsized":"2024-09-11T14:39:38.716603+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-11T14:39:38.792167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T14:39:38.792167+0000","last_clean_scrub_stamp":"2024-09-11T14:20:00.391487+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214194757632,"internally_reserved":0,"allocated":16736256,"data_stored":16736256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214194757632,"internally_reserved":0,"allocated":16736256,"data_stored":16736256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53548339200,"internally_reserved":0,"allocated":4534272,"data_stored":4534272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4428,"kb_used_data":4428,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52293300,"statfs":{"total":53552873472,"available":53548339200,"internally_reserved":0,"allocated":4534272,"data_stored":4534272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3560,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294168,"statfs":{"total":53552873472,"available":53549228032,"internally_reserved":0,"allocated":3645440,"data_stored":3645440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":3540,"kb_used_data":3540,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52294188,"statfs":{"total":53552873472,"available":53549248512,"internally_reserved":0,"allocated":3624960,"data_stored":3624960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":4816,"kb_used_data":4816,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52292912,"statfs":{"total":53552873472,"available":53547941888,"internally_reserved":0,"allocated":4931584,"data_stored":4931584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53552873472,"available":53548339200,"internally_reserved":0,"allocated":4534272,"data_stored":4534272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":53552873472,"available":53547941888,"internally_reserved":0,"allocated":4931584,"data_stored":4931584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53549248512,"internally_reserved":0,"allocated":3624960,"data_stored":3624960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53549228032,"internally_reserved":0,"allocated":3645440,"data_stored":3645440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53548339200,"internally_reserved":0,"allocated":4534272,"data_stored":4534272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":53552873472,"available":53547941888,"internally_reserved":0,"allocated":4931584,"data_stored":4931584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":53552873472,"available":53549248512,"internally_reserved":0,"allocated":3624960,"data_stored":3624960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":53552873472,"available":53549228032,"internally_reserved":0,"allocated":3645440,"data_stored":3645440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":53552873472,"available":53548339200,"internally_reserved":0,"allocated":4534272,"data_stored":4534272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T14:39:59.422 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T14:39:59.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.526+0000 7f95b3a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:59.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.535+0000 7f95b3a74640 1 Processor -- start 2024-09-11T14:39:59.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.535+0000 7f95b3a74640 1 -- start start 2024-09-11T14:39:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.537+0000 7f95b3a74640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95ac135aa0 0x7f95ac135eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.537+0000 7f95b3a74640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ac09c1f0 con 0x7f95ac06ce40 2024-09-11T14:39:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.537+0000 7f95b3a74640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f95ac09d690 con 0x7f95ac135aa0 2024-09-11T14:39:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.537+0000 7f95b1810640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95ac135aa0 0x7f95ac135eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.537+0000 7f95b100f640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f95ac06ce40 0x7f95ac06d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:36500/0 (socket says 172.21.15.46:36500) 2024-09-11T14:39:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.537+0000 7f95b100f640 1 -- 172.21.15.46:0/4268525621 learned_addr learned my addr 172.21.15.46:0/4268525621 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-09-11T14:39:59.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.537+0000 7f95b1810640 1 -- 172.21.15.46:0/4268525621 >> v1:172.21.15.46:6789/0 conn(0x7f95ac06ce40 legacy=0x7f95ac06d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:59.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.537+0000 7f95b1810640 1 -- 172.21.15.46:0/4268525621 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac135650 con 0x7f95ac135aa0 2024-09-11T14:39:59.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.538+0000 7f95b1810640 1 --2- 172.21.15.46:0/4268525621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac135aa0 0x7f95ac135eb0 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576f3458adf00d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:59.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.538+0000 7f95b080e640 1 -- 172.21.15.46:0/4268525621 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f959c00e040 con 0x7f95ac135aa0 2024-09-11T14:39:59.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.538+0000 7f95b080e640 1 -- 172.21.15.46:0/4268525621 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f959c007670 con 0x7f95ac135aa0 2024-09-11T14:39:59.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.538+0000 7f95b080e640 1 -- 172.21.15.46:0/4268525621 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f959c007910 con 0x7f95ac135aa0 2024-09-11T14:39:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.538+0000 7f95b3a74640 1 -- 172.21.15.46:0/4268525621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac135aa0 msgr2=0x7f95ac135eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.538+0000 7f95b3a74640 1 --2- 172.21.15.46:0/4268525621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac135aa0 0x7f95ac135eb0 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.539+0000 7f95b3a74640 1 -- 172.21.15.46:0/4268525621 shutdown_connections 2024-09-11T14:39:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.539+0000 7f95b3a74640 1 --2- 172.21.15.46:0/4268525621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac135aa0 0x7f95ac135eb0 unknown :-1 s=CLOSED pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.539+0000 7f95b3a74640 1 -- 172.21.15.46:0/4268525621 >> 172.21.15.46:0/4268525621 conn(0x7f95ac069c40 msgr2=0x7f95ac09f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.539+0000 7f95b3a74640 1 -- 172.21.15.46:0/4268525621 shutdown_connections 2024-09-11T14:39:59.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.539+0000 7f95b3a74640 1 -- 172.21.15.46:0/4268525621 wait complete. 2024-09-11T14:39:59.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.539+0000 7f95b3a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-11T14:39:59.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.541+0000 7f95b3a74640 1 Processor -- start 2024-09-11T14:39:59.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.541+0000 7f95b3a74640 1 -- start start 2024-09-11T14:39:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.542+0000 7f95b3a74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06ce40 0x7f95ac121f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.542+0000 7f95b3a74640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac125ea0 con 0x7f95ac06ce40 2024-09-11T14:39:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.542+0000 7f95b1810640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06ce40 0x7f95ac121f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:59.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.542+0000 7f95b1810640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06ce40 0x7f95ac121f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34418/0 (socket says 172.21.15.46:34418) 2024-09-11T14:39:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.542+0000 7f95b1810640 1 -- 172.21.15.46:0/2563802116 learned_addr learned my addr 172.21.15.46:0/2563802116 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-11T14:39:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.543+0000 7f95b1810640 1 -- 172.21.15.46:0/2563802116 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac123940 con 0x7f95ac06ce40 2024-09-11T14:39:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.543+0000 7f95b1810640 1 --2- 172.21.15.46:0/2563802116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06ce40 0x7f95ac121f50 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.543+0000 7f95aa7fc640 1 -- 172.21.15.46:0/2563802116 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f959c00e040 con 0x7f95ac06ce40 2024-09-11T14:39:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.543+0000 7f95aa7fc640 1 -- 172.21.15.46:0/2563802116 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f959c012a70 con 0x7f95ac06ce40 2024-09-11T14:39:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.543+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ac0a3c40 con 0x7f95ac06ce40 2024-09-11T14:39:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.543+0000 7f95aa7fc640 1 -- 172.21.15.46:0/2563802116 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f959c012d10 con 0x7f95ac06ce40 2024-09-11T14:39:59.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.543+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ac132bf0 con 0x7f95ac06ce40 2024-09-11T14:39:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.544+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ac09d180 con 0x7f95ac06ce40 2024-09-11T14:39:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.544+0000 7f95aa7fc640 1 -- 172.21.15.46:0/2563802116 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (crc 0 0 0) 0x7f959c0153f0 con 0x7f95ac06ce40 2024-09-11T14:39:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.544+0000 7f95aa7fc640 1 --2- 172.21.15.46:0/2563802116 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f959803e930 0x7f9598040e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T14:39:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.544+0000 7f95aa7fc640 1 -- 172.21.15.46:0/2563802116 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(729..729 src has 593..729) ==== 3431+0+0 (crc 0 0 0) 0x7f959c051370 con 0x7f95ac06ce40 2024-09-11T14:39:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.545+0000 7f95b100f640 1 --2- 172.21.15.46:0/2563802116 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f959803e930 0x7f9598040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T14:39:59.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.545+0000 7f95b100f640 1 --2- 172.21.15.46:0/2563802116 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f959803e930 0x7f9598040e40 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T14:39:59.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.549+0000 7f95aa7fc640 1 -- 172.21.15.46:0/2563802116 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195771 (crc 0 0 0) 0x7f959c00e7a0 con 0x7f95ac06ce40 2024-09-11T14:39:59.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.736+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f95ac06e190 con 0x7f95ac06ce40 2024-09-11T14:39:59.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.739+0000 7f95aa7fc640 1 -- 172.21.15.46:0/2563802116 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7f959c00f210 con 0x7f95ac06ce40 2024-09-11T14:39:59.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.739+0000 7f95aa7fc640 1 -- 172.21.15.46:0/2563802116 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7f959c00fe70 con 0x7f95ac06ce40 2024-09-11T14:39:59.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f959803e930 msgr2=0x7f9598040e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 --2- 172.21.15.46:0/2563802116 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f959803e930 0x7f9598040e40 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06ce40 msgr2=0x7f95ac121f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T14:39:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 --2- 172.21.15.46:0/2563802116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06ce40 0x7f95ac121f50 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 shutdown_connections 2024-09-11T14:39:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 --2- 172.21.15.46:0/2563802116 >> [v2:172.21.15.47:6800/455983768,v1:172.21.15.47:6801/455983768] conn(0x7f959803e930 0x7f9598040e40 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 --2- 172.21.15.46:0/2563802116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06ce40 0x7f95ac121f50 unknown :-1 s=CLOSED pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T14:39:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 >> 172.21.15.46:0/2563802116 conn(0x7f95ac069c40 msgr2=0x7f95ac0a3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T14:39:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 shutdown_connections 2024-09-11T14:39:59.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-11T14:39:59.741+0000 7f95b3a74640 1 -- 172.21.15.46:0/2563802116 wait complete. 2024-09-11T14:39:59.755 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T14:39:59.755 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T14:39:59.756 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T14:39:59.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:39:59.834 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T14:39:59.835 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T14:39:59.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:39:59.906 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T14:39:59.907 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T14:39:59.907 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:39:59.986 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T14:39:59.986 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T14:39:59.986 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:40:00.063 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T14:40:00.063 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T14:40:00.063 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T14:40:00.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:40:00.092 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T14:40:00.093 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T14:40:00.093 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T14:40:00.093 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T14:40:00.108 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T14:40:00.108 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T14:40:00.108 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-11T14:40:00.179 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-09-11T14:40:00.179 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T14:40:00.412 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-09-11T14:40:00.412 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T14:40:00.503 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-11T14:40:00.503 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T14:40:00.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-11T14:40:00.605 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T14:40:00.686 INFO:tasks.ceph:Archiving mon data... 2024-09-11T14:40:00.687 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333/data/mon.a.tgz 2024-09-11T14:40:00.687 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-09-11T14:40:00.703 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.qcExn7P0GF 2024-09-11T14:40:00.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.qcExn7P0GF 2024-09-11T14:40:00.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.qcExn7P0GF 2024-09-11T14:40:00.933 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.qcExn7P0GF is 301KB 2024-09-11T14:40:01.031 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.qcExn7P0GF 2024-09-11T14:40:01.046 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T14:40:01.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T14:40:01.088 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T14:40:01.167 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T14:40:01.186 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T14:40:01.187 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T14:40:01.188 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333/remote/smithi046/crash 2024-09-11T14:40:01.192 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T14:40:01.232 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333/remote/smithi047/crash 2024-09-11T14:40:01.233 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T14:40:01.273 INFO:tasks.ceph:Compressing logs... 2024-09-11T14:40:01.273 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T14:40:01.277 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T14:40:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28867.log 2024-09-11T14:40:01.300 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92967.log 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28867.log.gz 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96919.log 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.92967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95914.log 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96919.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92967.log.gz 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92593.log 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.96919.log.gz 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95656.log 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95914.log.gz 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96040.log 2024-09-11T14:40:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96125.log 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92593.log.gz 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96040.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95656.log.gz 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29036.log 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96040.log.gz 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29448.log 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96125.log.gz 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.29036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96375.log 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.29448.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29036.log.gz 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94089.log 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93005.log 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.96375.log.gz 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95571.log 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30693.log 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94089.log.gz 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95571.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T14:40:01.307 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- 90.3% /var/log/ceph/ceph-client.admin.93705.log 2024-09-11T14:40:01.308 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93005.log.gz 2024-09-11T14:40:01.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30693.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95571.log.gz 2024-09-11T14:40:01.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29229.log 2024-09-11T14:40:01.345 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96333.log 2024-09-11T14:40:01.345 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.30693.log.gz 2024-09-11T14:40:01.345 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.29229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94052.log 2024-09-11T14:40:01.345 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29229.log.gz 2024-09-11T14:40:01.345 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93762.log 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5%/var/log/ceph/ceph-client.admin.94052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92851.log 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96333.log.gz 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.93705.log.gz 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93948.log 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.30727.log 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94052.log.gz 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.93762.log.gz 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92851.log: /var/log/ceph/ceph-client.admin.93948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96220.log 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30861.log 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96220.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93948.log.gz 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94017.log 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96220.log.gz 2024-09-11T14:40:01.346 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29448.log.gz 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93578.log 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30861.log: /var/log/ceph/ceph-client.admin.94017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29145.log 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr: 85.7%/var/log/ceph/ceph-client.admin.93578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95748.log 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94017.log.gz 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.92851.log.gz 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.29145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95956.log 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% 92.9% -- replaced with /var/log/ceph/ceph-client.admin.29145.log.gz 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30727.log.gz/var/log/ceph/ceph-client.admin.95748.log: 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94703.log 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.95748.log.gz 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95508.log 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94703.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95956.log.gz 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96061.log 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28179.log 2024-09-11T14:40:01.347 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4%/var/log/ceph/ceph-client.admin.96061.log: -- replaced with /var/log/ceph/ceph-client.admin.95508.log.gz 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95722.log 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr: 91.6% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96061.log.gz 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94703.log.gz 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94520.log 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28179.log: /var/log/ceph/ceph-client.admin.95722.log: 84.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92814.log 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28179.log.gz 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95722.log.gz 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93763.log 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96082.log 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94090.log 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96082.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.92814.log.gz 89.5% -- replaced with /var/log/ceph/ceph-client.admin.93763.log.gz 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:40:01.348 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96082.log.gz 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93162.log 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96170.log 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5%/var/log/ceph/ceph-client.admin.93162.log: -- replaced with /var/log/ceph/ceph-client.admin.94090.log.gz 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96669.log 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.94520.log.gz 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96753.log 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96170.log: /var/log/ceph/ceph-client.admin.96669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95420.log 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96753.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96170.log.gz 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96669.log.gz 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95838.log 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96753.log.gz 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.95420.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95792.log 2024-09-11T14:40:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30842.log 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95420.log.gz 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95838.log.gz 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95792.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.93578.log.gz 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.95792.log.gz 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27393.log 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30842.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.93162.log.gz 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.27393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95701.log 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr: 68.0% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30842.log.gz 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.27393.log.gz 2024-09-11T14:40:01.350 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28641.log 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94195.log 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95701.log: /var/log/ceph/ceph-client.admin.28641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94126.log 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95701.log.gz 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95592.log 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28641.log.gz 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29917.log 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr: 86.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93724.log 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.94126.log.gz 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95592.log: /var/log/ceph/ceph-client.admin.29917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95550.log 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30823.log 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95592.log.gz 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94195.log.gz 2024-09-11T14:40:01.351 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95550.log: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.93724.log.gz 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96879.log 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95550.log.gz 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95998.log 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96879.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30823.log.gz 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96501.log 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.96879.log.gz 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93813.log 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95998.log.gz 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95657.log 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96417.log 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96501.log.gz 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93812.log 2024-09-11T14:40:01.352 INFO:teuthology.orchestra.run.smithi046.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.93813.log.gz/var/log/ceph/ceph-client.admin.96417.log: 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96196.log 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.95657.log.gz 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.96417.log.gz 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96585.log 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93812.log: /var/log/ceph/ceph-client.admin.96196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95223.log 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr: 86.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28866.log 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96585.log: -- replaced with /var/log/ceph/ceph-client.admin.96196.log.gz 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95223.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96585.log.gz 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95024.log 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93812.log.gz 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93025.log 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28866.log.gz 2024-09-11T14:40:01.353 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96103.log 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95024.log: /var/log/ceph/ceph-client.admin.93025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93814.log 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96103.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96103.log.gz 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr: 91.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.93025.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.94053.log 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93814.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93814.log.gz 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93864.log 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93950.log 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.95024.log.gz 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93864.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.94053.log.gz 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92986.log 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose 90.1% -- replaced with /var/log/ceph/ceph-client.admin.93864.log.gz 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.95613.log 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92986.log: /var/log/ceph/ceph-client.admin.93950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94127.log 2024-09-11T14:40:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95613.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.92986.log.gz 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92507.log 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95613.log.gz 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94127.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93950.log.gz 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93111.log 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94127.log.gz 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.92507.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95529.log 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93111.log: 93.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29034.log 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29917.log.gz 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93866.log 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.29034.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95529.log.gz 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29034.log.gz 93.2% -- replaced with /var/log/ceph/ceph-client.admin.95223.log.gz 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.93111.log.gz 2024-09-11T14:40:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96711.log 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93866.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93867.log 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96711.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95445.log 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93866.log.gz 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.96711.log.gz 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93867.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.93867.log.gz 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95487.log 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93865.log 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6%/var/log/ceph/ceph-client.admin.95487.log: -- replaced with /var/log/ceph/ceph-client.admin.95445.log.gz 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28767.log 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95487.log.gz 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94811.log 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93865.log: /var/log/ceph/ceph-client.admin.28767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94259.log 2024-09-11T14:40:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94811.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28767.log.gz 2024-09-11T14:40:01.357 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93497.log 2024-09-11T14:40:01.357 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4%/var/log/ceph/ceph-client.admin.94259.log: -- replaced with /var/log/ceph/ceph-client.admin.93865.log.gz 2024-09-11T14:40:01.357 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28415.log 2024-09-11T14:40:01.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93497.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.93497.log.gz 2024-09-11T14:40:01.357 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95396.log 2024-09-11T14:40:01.357 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28415.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.94811.log.gz 2024-09-11T14:40:01.357 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% 84.8% -- replaced with /var/log/ceph/ceph-client.admin.94259.log.gz 2024-09-11T14:40:01.357 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28415.log.gz 2024-09-11T14:40:01.357 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93761.log 2024-09-11T14:40:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T14:40:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28177.log 2024-09-11T14:40:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28258.log 2024-09-11T14:40:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.28177.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T14:40:01.361 INFO:teuthology.orchestra.run.smithi047.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28177.log.gz 2024-09-11T14:40:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.28258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28218.log 2024-09-11T14:40:01.361 INFO:teuthology.orchestra.run.smithi047.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28258.log.gz 2024-09-11T14:40:01.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T14:40:01.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.28218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28127.log 2024-09-11T14:40:01.362 INFO:teuthology.orchestra.run.smithi047.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28218.log.gz 2024-09-11T14:40:01.362 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.28127.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.28127.log.gz 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93044.log 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95396.log.gz/var/log/ceph/ceph-client.admin.93761.log: 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95466.log 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28683.log 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5%/var/log/ceph/ceph-client.admin.93044.log: -- replaced with /var/log/ceph/ceph-client.admin.93761.log.gz 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95466.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95466.log.gz 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93725.log 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28258.log 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93725.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28683.log.gz 2024-09-11T14:40:01.382 INFO:teuthology.orchestra.run.smithi046.stderr: 95.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28868.log 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92507.log.gz 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.93044.log.gz 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28258.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93725.log.gz 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 84.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.28258.log.gz 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-client.admin.28725.log 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28868.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28868.log.gz 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94242.log 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.28725.log.gz 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30785.log 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28590.log 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30785.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.94242.log.gz 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96459.log 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.28590.log: /var/log/ceph/ceph-client.admin.30746.log 2024-09-11T14:40:01.383 INFO:teuthology.orchestra.run.smithi046.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28590.log.gz/var/log/ceph/ceph-client.admin.96459.log: 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.96459.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95935.log 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95191.log 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30746.log.gz 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95935.log: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95935.log.gz 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28869.log 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93949.log 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94178.log 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95191.log.gz 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28869.log.gz 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95747.log 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28443.log 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.93949.log.gz 2024-09-11T14:40:01.384 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.94178.log.gz 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29037.log 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95747.log: /var/log/ceph/ceph-client.admin.28443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95888.log 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr: 84.5%/var/log/ceph/ceph-client.admin.29037.log: -- replaced with /var/log/ceph/ceph-client.admin.28443.log.gz 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95747.log.gz 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29037.log.gz 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93863.log 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.95888.log: /var/log/ceph/ceph-client.admin.96627.log 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93863.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.95888.log.gz 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95634.log 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93863.log.gz 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.96146.log 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95634.log: /var/log/ceph/ceph-client.admin.96627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92631.log 2024-09-11T14:40:01.385 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95634.log.gz 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96146.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.30785.log.gz 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.96627.log.gz 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96146.log.gz 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94125.log 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95816.log 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95370.log 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29035.log 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94125.log.gz 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95816.log.gzgzip 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94016.log 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95370.log: /var/log/ceph/ceph-client.admin.29035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96795.log 91.9% 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92631.log.gz 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94016.log: 85.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95977.log 2024-09-11T14:40:01.386 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29035.log.gz 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95370.log.gz 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94473.log 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.96795.log.gz 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94016.log.gz 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96019.log 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95977.log.gz 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29187.log 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28500.log 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4%/var/log/ceph/ceph-client.admin.29187.log: -- replaced with /var/log/ceph/ceph-client.admin.96019.log.gz 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93726.log 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.29187.log.gz 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96837.log 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28500.log: /var/log/ceph/ceph-client.admin.93726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95864.log 2024-09-11T14:40:01.387 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96837.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.28500.log.gz 2024-09-11T14:40:01.388 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.93726.log.gz 2024-09-11T14:40:01.388 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28556.log 2024-09-11T14:40:01.388 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.96837.log.gz 2024-09-11T14:40:01.388 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96543.log 2024-09-11T14:40:01.388 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28556.log: /var/log/ceph/ceph-client.admin.95864.log: 86.0% 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28556.log.gz 2024-09-11T14:40:01.388 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95864.log.gz 2024-09-11T14:40:01.388 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96543.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.96543.log.gz 2024-09-11T14:40:01.388 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.94473.log.gz 2024-09-11T14:40:01.545 INFO:teuthology.orchestra.run.smithi047.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T14:40:01.747 INFO:teuthology.orchestra.run.smithi046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.30861.log.gz 2024-09-11T14:40:02.923 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T14:40:04.573 INFO:teuthology.orchestra.run.smithi047.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T14:40:04.589 INFO:teuthology.orchestra.run.smithi046.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T14:40:04.735 INFO:teuthology.orchestra.run.smithi047.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T14:40:04.737 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-11T14:40:04.737 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m3.400s 2024-09-11T14:40:04.737 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m6.532s 2024-09-11T14:40:04.737 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.286s 2024-09-11T14:40:05.303 INFO:teuthology.orchestra.run.smithi046.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T14:40:05.305 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-11T14:40:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m4.015s 2024-09-11T14:40:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m9.117s 2024-09-11T14:40:05.305 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m0.451s 2024-09-11T14:40:05.305 INFO:tasks.ceph:Archiving logs... 2024-09-11T14:40:05.305 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333/remote/smithi046/log 2024-09-11T14:40:05.306 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T14:40:06.724 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333/remote/smithi047/log 2024-09-11T14:40:06.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T14:40:07.605 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T14:40:07.614 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T14:40:07.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T14:40:07.617 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T14:40:07.718 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T14:40:07.727 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T14:40:07.727 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:40:07.730 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T14:40:07.744 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:40:07.747 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-09-11T14:40:07.749 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:40:07.749 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-11T14:40:07.750 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 +702us[ +747us] +/- 47ms 2024-09-11T14:40:07.750 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -547us[ -502us] +/- 78ms 2024-09-11T14:40:07.750 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -569us[ -524us] +/- 77ms 2024-09-11T14:40:07.750 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:40:07.752 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T14:40:07.753 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-09-11T14:40:07.753 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 +634us[ +653us] +/- 47ms 2024-09-11T14:40:07.753 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 -645us[ -625us] +/- 78ms 2024-09-11T14:40:07.753 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -617us[ -617us] +/- 77ms 2024-09-11T14:40:07.753 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T14:40:07.753 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T14:40:07.762 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T14:40:07.762 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T14:40:07.786 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T14:40:07.858 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T14:40:07.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:40:07.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:40:07.958 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T14:40:07.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:40:07.989 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T14:40:07.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T14:40:08.037 INFO:teuthology.task.internal:Duration was 1660.022540 seconds 2024-09-11T14:40:08.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T14:40:08.069 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T14:40:08.070 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T14:40:08.073 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T14:40:08.112 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:40:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T14:40:08.253 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T14:40:08.253 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-09-11T14:40:08.253 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T14:40:08.316 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-09-11T14:40:08.316 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T14:40:08.344 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T14:40:08.344 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T14:40:08.358 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T14:40:08.413 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T14:40:08.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T14:40:08.427 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T14:40:08.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T14:40:08.566 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T14:40:08.566 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T14:40:08.592 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T14:40:08.618 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T14:40:08.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:40:08.634 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:40:08.656 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-09-11T14:40:08.682 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-09-11T14:40:08.702 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:40:08.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:40:08.721 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T14:40:08.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T14:40:08.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T14:40:08.767 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T14:40:08.768 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333/remote/smithi046 2024-09-11T14:40:08.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T14:40:08.803 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-11_13:53:46-crimson-rados-wip-matanb-crimson-testing-sep11-distro-crimson-smithi/7901333/remote/smithi047 2024-09-11T14:40:08.803 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T14:40:08.837 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T14:40:08.837 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T14:40:08.840 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T14:40:08.888 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T14:40:08.898 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T14:40:08.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T14:40:08.920 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T14:40:08.921 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T14:40:08.923 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T14:40:08.936 INFO:teuthology.orchestra.run.smithi046.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 14:40 /home/ubuntu/cephtest 2024-09-11T14:40:08.943 INFO:teuthology.orchestra.run.smithi047.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 14:40 /home/ubuntu/cephtest 2024-09-11T14:40:08.944 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T14:40:08.953 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T14:40:09.040 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore tasks/rados_api_tests} duration: 1660.0225403308868 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-11T14:40:09.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T14:40:09.120 INFO:teuthology.run:pass