2024-05-08T02:34:10.626 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T02:34:10.626 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yingxin@teuthology --archive /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180 --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} --name yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi --verbose -- /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180/orig.config.yaml 2024-05-08T02:34:10.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T02:34:10.751 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180 branch: ci-yingxin-crimson-load-obc-new-2 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: yingxin.cheng@intel.com first_in_suite: false job_id: '7697180' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: ci-yingxin-crimson-load-obc-new-2 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 4184b4e61afa6555ed712d5225eb247792c31f69 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: crimson sha1: 4184b4e61afa6555ed712d5225eb247792c31f69 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: ci-yingxin-crimson-load-obc-new-2 env: CRIMSON_COMPAT: '1' sha1: 4184b4e61afa6555ed712d5225eb247792c31f69 owner: scheduled_yingxin@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b sha1: 4184b4e61afa6555ed712d5225eb247792c31f69 sleep_before_teardown: 0 suite: crimson-rados suite_branch: ci-yingxin-crimson-load-obc-new-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4184b4e61afa6555ed712d5225eb247792c31f69/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4184b4e61afa6555ed712d5225eb247792c31f69 targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFmkAdeXW+sNVEnWFfEVQLl1TJDGaQagcC4ub5MhBeQTIBTjWzQjNWMjpL2HKiTnAeldwnTHMBRoyQKBfqN/Hqw= smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBms0g3VmRsExDQpVWWeccQc1ghvHhJMVRQyKVoNNuuyOojuqkrQhwhwF5tZEZUqlU2yWAil6Ntydq50SWvFiN0= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_02:24:47 tube: smithi user: yingxin verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T02:34:10.751 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4184b4e61afa6555ed712d5225eb247792c31f69/qa; will attempt to use it 2024-05-08T02:34:10.752 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4184b4e61afa6555ed712d5225eb247792c31f69/qa/tasks 2024-05-08T02:34:10.752 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T02:34:10.753 INFO:teuthology.task.internal:Checking packages... 2024-05-08T02:34:10.775 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '4184b4e61afa6555ed712d5225eb247792c31f69' 2024-05-08T02:34:10.775 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T02:34:10.775 INFO:teuthology.packaging:ref: None 2024-05-08T02:34:10.775 INFO:teuthology.packaging:tag: None 2024-05-08T02:34:10.775 INFO:teuthology.packaging:branch: ci-yingxin-crimson-load-obc-new-2 2024-05-08T02:34:10.775 INFO:teuthology.packaging:sha1: 4184b4e61afa6555ed712d5225eb247792c31f69 2024-05-08T02:34:10.776 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=ci-yingxin-crimson-load-obc-new-2 2024-05-08T02:34:11.013 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3229.g4184b4e6 2024-05-08T02:34:11.014 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T02:34:11.020 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T02:34:11.020 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T02:34:11.031 INFO:teuthology.task.internal:Saving configuration 2024-05-08T02:34:11.043 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T02:34:11.049 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T02:34:11.084 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 02:29:04.840951', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFmkAdeXW+sNVEnWFfEVQLl1TJDGaQagcC4ub5MhBeQTIBTjWzQjNWMjpL2HKiTnAeldwnTHMBRoyQKBfqN/Hqw='} 2024-05-08T02:34:11.117 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 02:29:04.842985', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBms0g3VmRsExDQpVWWeccQc1ghvHhJMVRQyKVoNNuuyOojuqkrQhwhwF5tZEZUqlU2yWAil6Ntydq50SWvFiN0='} 2024-05-08T02:34:11.117 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T02:34:11.125 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-05-08T02:34:11.125 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-05-08T02:34:11.125 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T02:34:11.212 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8d12852e50>, signals=[15]) 2024-05-08T02:34:11.213 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T02:34:11.220 INFO:teuthology.task.internal:Opening connections... 2024-05-08T02:34:11.221 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-05-08T02:34:11.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T02:34:11.336 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T02:34:11.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T02:34:11.416 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T02:34:11.426 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-05-08T02:34:11.445 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-05-08T02:34:11.445 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-05-08T02:34:11.503 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-05-08T02:34:11.504 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T02:34:11.505 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T02:34:11.505 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T02:34:11.505 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-05-08T02:34:11.538 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-05-08T02:34:11.555 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-05-08T02:34:11.555 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-05-08T02:34:11.611 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-05-08T02:34:11.611 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="9" 2024-05-08T02:34:11.611 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-05-08T02:34:11.611 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="9" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el9" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:LOGO="fedora-logo-icon" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T02:34:11.612 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T02:34:11.612 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-05-08T02:34:11.638 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T02:34:11.652 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T02:34:11.665 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T02:34:11.666 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-05-08T02:34:11.668 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-05-08T02:34:11.683 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T02:34:11.694 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T02:34:11.694 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-05-08T02:34:11.726 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-05-08T02:34:11.758 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T02:34:11.832 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T02:34:11.847 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-08T02:34:11.848 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-08T02:34:11.848 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T02:34:11.848 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T02:34:11.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T02:34:11.864 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-05-08T02:34:11.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T02:34:11.865 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-05-08T02:34:11.919 INFO:teuthology.orchestra.run.smithi080.stdout:5.14.0-437.el9.x86_64 2024-05-08T02:34:11.920 INFO:teuthology.task.kernel:Running kernel on smithi080: 5.14.0-437.el9.x86_64 2024-05-08T02:34:11.920 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y kernel 2024-05-08T02:34:11.923 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-437.el9.x86_64 2024-05-08T02:34:11.923 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-437.el9.x86_64 2024-05-08T02:34:11.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-05-08T02:34:14.310 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-08T02:34:14.466 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.1 MB 00:00 2024-05-08T02:34:17.219 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-05-08T02:34:18.767 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 19 MB 00:03 2024-05-08T02:34:22.345 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.2 MB 00:01 2024-05-08T02:34:23.542 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.2 MB 00:01 2024-05-08T02:34:23.978 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-05-08T02:34:25.959 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-05-08T02:34:26.015 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-08T02:34:27.527 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-08T02:34:31.295 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 8.9 kB/s | 1.7 kB 00:00 2024-05-08T02:34:32.902 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-05-08T02:34:33.113 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:01 ago on Wed 08 May 2024 02:34:32 AM UTC. 2024-05-08T02:34:33.335 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T02:34:33.335 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T02:34:33.428 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:34:33.440 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:34:33.441 INFO:teuthology.orchestra.run.smithi080.stdout:Install 4 Packages 2024-05-08T02:34:33.441 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:34:33.441 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 78 M 2024-05-08T02:34:33.441 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 123 M 2024-05-08T02:34:33.442 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:34:33.763 INFO:teuthology.orchestra.run.smithi080.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 1.8 MB/s | 484 kB 00:00 2024-05-08T02:34:34.950 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T02:34:34.950 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T02:34:35.043 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T02:34:35.052 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:34:35.053 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:34:35.053 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:34:35.053 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-05-08T02:34:35.053 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:34:35.053 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 78 M 2024-05-08T02:34:35.053 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 123 M 2024-05-08T02:34:35.053 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:34:35.230 INFO:teuthology.orchestra.run.smithi080.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 8.9 MB/s | 15 MB 00:01 2024-05-08T02:34:35.654 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 1.4 MB/s | 484 kB 00:00 2024-05-08T02:34:37.196 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 8.2 MB/s | 15 MB 00:01 2024-05-08T02:34:37.855 INFO:teuthology.orchestra.run.smithi080.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 7.8 MB/s | 34 MB 00:04 2024-05-08T02:34:37.937 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 12 MB/s | 28 MB 00:02 2024-05-08T02:34:38.254 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 12 MB/s | 34 MB 00:02 2024-05-08T02:34:38.259 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:34:38.259 INFO:teuthology.orchestra.run.smithi046.stdout:Total 24 MB/s | 78 MB 00:03 2024-05-08T02:34:38.967 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:34:39.357 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:34:39.357 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:34:40.320 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:34:40.320 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:34:41.454 INFO:teuthology.orchestra.run.smithi080.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 3.6 MB/s | 28 MB 00:07 2024-05-08T02:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:34:41.455 INFO:teuthology.orchestra.run.smithi080.stdout:Total 9.7 MB/s | 78 MB 00:08 2024-05-08T02:34:42.136 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:34:42.490 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:34:42.490 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:34:42.869 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:34:43.447 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:34:43.447 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:34:43.521 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T02:34:43.604 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T02:34:45.874 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:34:46.420 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T02:34:46.579 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T02:34:46.589 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T02:34:46.672 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T02:34:49.331 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T02:34:49.471 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T02:34:51.660 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T02:34:51.707 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:34:54.160 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T02:34:54.290 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:34:56.799 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:34:59.017 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:35:27.886 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:35:27.926 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:35:28.254 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:35:28.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T02:35:28.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T02:35:28.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T02:35:28.334 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:35:28.372 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:35:28.733 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:35:28.733 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T02:35:28.733 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T02:35:28.733 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T02:35:29.076 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:35:29.076 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:35:29.076 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:35:29.076 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.076 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.076 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.076 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.076 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:35:29.077 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:35:29.407 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T02:35:29.483 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.484 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T02:35:29.484 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T02:35:29.484 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T02:35:29.484 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T02:35:29.484 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T02:35:29.484 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T02:35:29.485 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T02:35:29.535 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.536 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T02:35:29.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-05-08T02:35:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T02:35:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:35:29.545 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:35:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.545 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:35:29.546 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:35:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-05-08T02:35:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:35:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T02:35:29.573 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T02:35:29.573 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-444.el9.x86_64 2024-05-08T02:35:29.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T02:35:29.900 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T02:35:29.968 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T02:35:29.968 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T02:35:29.968 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T02:35:29.968 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T02:35:29.968 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T02:35:29.968 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-05-08T02:35:29.968 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T02:35:29.968 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T02:35:30.018 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T02:35:30.018 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T02:35:30.018 DEBUG:teuthology.orchestra.run.smithi080:> sudo rpm -qi grub2-tools 2024-05-08T02:35:30.048 INFO:teuthology.orchestra.run.smithi080.stdout:Name : grub2-tools 2024-05-08T02:35:30.048 INFO:teuthology.orchestra.run.smithi080.stdout:Epoch : 1 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Version : 2.06 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Release : 68.el9 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: x86_64 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Group : Unspecified 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Size : 8264254 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:License : GPLv3+ 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Packager : builder@centos.org 2024-05-08T02:35:30.049 INFO:teuthology.orchestra.run.smithi080.stdout:Vendor : CentOS 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout:Summary : Support tools for GRUB. 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout:Description : 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout:hardware devices. 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:35:30.050 INFO:teuthology.orchestra.run.smithi080.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T02:35:30.051 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T02:35:30.051 INFO:teuthology.task.kernel:Updating grub on smithi080 to boot 5.14.0-444.el9.x86_64 2024-05-08T02:35:30.051 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T02:35:30.193 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-05-08T02:35:30.636 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-05-08T02:35:31.637 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T02:35:31.681 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-05-08T02:35:31.683 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-05-08T02:35:31.700 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.nRW9VWMrKO 2024-05-08T02:35:31.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nRW9VWMrKO 2024-05-08T02:35:31.767 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.nRW9VWMrKO 2024-05-08T02:35:31.908 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.nRW9VWMrKO is 6KB 2024-05-08T02:35:31.957 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.nRW9VWMrKO 2024-05-08T02:35:31.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T02:35:32.029 INFO:teuthology.orchestra.run.smithi080.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T02:35:32.034 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T02:35:32.034 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T02:35:32.034 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T02:35:32.034 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T02:35:32.036 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T02:35:32.062 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-05-08T02:35:32.065 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-05-08T02:35:32.080 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.i0ktwsgrgs 2024-05-08T02:35:32.080 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.i0ktwsgrgs 2024-05-08T02:35:32.164 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.i0ktwsgrgs 2024-05-08T02:35:32.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-05-08T02:35:32.299 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.i0ktwsgrgs is 6KB 2024-05-08T02:35:32.347 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.i0ktwsgrgs 2024-05-08T02:35:32.361 DEBUG:teuthology.orchestra.run.smithi080:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T02:35:32.422 INFO:teuthology.orchestra.run.smithi080.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T02:35:32.423 INFO:teuthology.orchestra.run.smithi080.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T02:35:32.423 INFO:teuthology.orchestra.run.smithi080.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T02:35:32.423 INFO:teuthology.orchestra.run.smithi080.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T02:35:32.424 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T02:35:32.576 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-05-08T02:36:02.229 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T02:36:02.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-08T02:36:02.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T02:36:02.580 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-05-08T02:36:02.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T02:36:02.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T02:37:02.296 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T02:37:02.591 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T02:37:11.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-08T02:37:11.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T02:37:11.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T02:37:11.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T02:37:12.030 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-05-08T02:37:12.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T02:37:12.510 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-444.el9.x86_64"... 2024-05-08T02:37:12.510 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-05-08T02:37:12.524 INFO:teuthology.orchestra.run.smithi080.stdout:5.14.0-444.el9.x86_64 2024-05-08T02:37:12.524 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T02:37:12.524 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T02:37:12.524 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T02:37:13.525 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-05-08T02:37:13.525 DEBUG:teuthology.orchestra.run.smithi080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T02:37:13.604 INFO:teuthology.orchestra.run.smithi080.stdout:ttyS1 2024-05-08T02:37:13.640 DEBUG:teuthology.parallel:result is None 2024-05-08T02:37:19.211 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-05-08T02:37:19.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-08T02:37:19.628 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-08T02:37:19.628 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-05-08T02:37:19.643 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-444.el9.x86_64 2024-05-08T02:37:19.644 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T02:37:19.644 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T02:37:19.644 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T02:37:20.645 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T02:37:20.645 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T02:37:20.717 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-05-08T02:37:20.763 DEBUG:teuthology.parallel:result is None 2024-05-08T02:37:20.764 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T02:37:20.772 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T02:37:20.772 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T02:37:20.775 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T02:37:20.792 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T02:37:20.803 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T02:37:20.865 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T02:37:20.865 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T02:37:20.867 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T02:37:20.908 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T02:37:20.915 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T02:37:20.916 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T02:37:20.929 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T02:37:20.960 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T02:37:20.969 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T02:37:20.971 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T02:37:20.979 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T02:37:20.981 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T02:37:20.992 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T02:37:20.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T02:37:21.020 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T02:37:21.046 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T02:37:21.056 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T02:37:21.056 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T02:37:21.092 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T02:37:21.108 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T02:37:21.203 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T02:37:21.249 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T02:37:21.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T02:37:21.381 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:37:21.381 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T02:37:21.451 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T02:37:21.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T02:37:21.535 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T02:37:21.625 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T02:37:21.659 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:37:21.659 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T02:37:21.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-05-08T02:37:21.727 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-05-08T02:37:21.761 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T02:37:21.818 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T02:37:22.316 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T02:37:22.327 INFO:teuthology.task.internal:Starting timer... 2024-05-08T02:37:22.327 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T02:37:22.337 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T02:37:22.345 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-08T02:37:22.345 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-05-08T02:37:22.424 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-05-08T02:37:22.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-05-08T02:37:22.498 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-05-08T02:37:22.500 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T02:37:22.500 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-05-08T02:37:22.521 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-05-08T02:37:22.521 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-05-08T02:37:22.541 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-05-08T02:37:22.541 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi080.front.sepia.ceph.com': 'permissive'} 2024-05-08T02:37:22.541 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T02:37:22.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T02:37:22.591 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T02:37:22.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T02:37:22.616 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T02:37:22.617 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-05-08T02:37:22.661 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-05-08T02:37:22.694 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T02:37:22.704 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T02:37:22.720 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T02:37:22.721 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi080.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T02:41:28.236 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi080.front.sepia.ceph.com')] 2024-05-08T02:41:28.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-08T02:41:28.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T02:41:28.327 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-05-08T02:41:28.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-05-08T02:41:28.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T02:41:28.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T02:41:28.445 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-05-08T02:41:28.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-05-08T02:41:28.527 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T02:41:28.539 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T02:41:28.539 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T02:41:28.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T02:41:28.542 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T02:41:28.542 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T02:41:28.571 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T02:41:28.586 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T02:41:28.597 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T02:41:28.612 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T02:41:28.612 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-05-08T02:41:28.624 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-05-08T02:41:28.635 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-05-08T02:41:28.639 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T02:41:28.647 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-05-08T02:41:28.653 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T02:41:28.660 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T02:41:28.674 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T02:41:28.708 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-05-08T02:41:28.711 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T02:41:28.711 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-05-08T02:41:28.711 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T02:41:28.711 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T02:41:28.711 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T02:41:28.712 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T02:41:28.736 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-05-08T02:41:28.739 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T02:41:28.739 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-05-08T02:41:28.739 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T02:41:28.740 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T02:41:28.740 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T02:41:28.740 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T02:41:28.741 INFO:teuthology.run_tasks:Running task install... 2024-05-08T02:41:28.749 DEBUG:teuthology.task.install:project ceph 2024-05-08T02:41:28.749 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '4184b4e61afa6555ed712d5225eb247792c31f69'}} 2024-05-08T02:41:28.749 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '4184b4e61afa6555ed712d5225eb247792c31f69'} 2024-05-08T02:41:28.749 INFO:teuthology.task.install:Using flavor: crimson 2024-05-08T02:41:28.755 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T02:41:28.755 INFO:teuthology.task.install:extra packages: [] 2024-05-08T02:41:28.755 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4184b4e61afa6555ed712d5225eb247792c31f69', 'tag': None, 'wait_for_package': False} 2024-05-08T02:41:28.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4184b4e61afa6555ed712d5225eb247792c31f69 2024-05-08T02:41:28.758 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4184b4e61afa6555ed712d5225eb247792c31f69', 'tag': None, 'wait_for_package': False} 2024-05-08T02:41:28.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4184b4e61afa6555ed712d5225eb247792c31f69 2024-05-08T02:41:28.924 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-2/4184b4e61afa6555ed712d5225eb247792c31f69/centos/9/flavors/crimson/ 2024-05-08T02:41:28.924 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3229.g4184b4e6 2024-05-08T02:41:29.016 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-2/4184b4e61afa6555ed712d5225eb247792c31f69/centos/9/flavors/crimson/ 2024-05-08T02:41:29.016 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3229.g4184b4e6 2024-05-08T02:41:29.144 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-2/4184b4e61afa6555ed712d5225eb247792c31f69/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-2/4184b4e61afa6555ed712d5225eb247792c31f69/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-2/4184b4e61afa6555ed712d5225eb247792c31f69/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T02:41:29.144 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:41:29.144 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T02:41:29.170 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T02:41:29.171 DEBUG:teuthology.orchestra.run.smithi080:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4184b4e61afa6555ed712d5225eb247792c31f69/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T02:41:29.238 DEBUG:teuthology.orchestra.run.smithi080:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T02:41:29.313 DEBUG:teuthology.orchestra.run.smithi080:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T02:41:29.377 INFO:teuthology.orchestra.run.smithi080.stdout:check_obsoletes = 1 2024-05-08T02:41:29.379 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum clean all 2024-05-08T02:41:29.616 INFO:teuthology.orchestra.run.smithi080.stdout:54 files removed 2024-05-08T02:41:29.643 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-radosgw 2024-05-08T02:41:30.269 INFO:teuthology.orchestra.run.smithi080.stdout:ceph packages for x86_64 246 kB/s | 87 kB 00:00 2024-05-08T02:41:30.694 INFO:teuthology.orchestra.run.smithi080.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-05-08T02:41:31.061 INFO:teuthology.orchestra.run.smithi080.stdout:ceph source packages 6.3 kB/s | 2.0 kB 00:00 2024-05-08T02:41:31.262 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-2/4184b4e61afa6555ed712d5225eb247792c31f69/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-2/4184b4e61afa6555ed712d5225eb247792c31f69/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-2/4184b4e61afa6555ed712d5225eb247792c31f69/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T02:41:31.262 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:41:31.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T02:41:31.295 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T02:41:31.296 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4184b4e61afa6555ed712d5225eb247792c31f69/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T02:41:31.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T02:41:31.451 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T02:41:31.519 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-05-08T02:41:31.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-05-08T02:41:31.767 INFO:teuthology.orchestra.run.smithi046.stdout:54 files removed 2024-05-08T02:41:31.778 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-08T02:41:31.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw 2024-05-08T02:41:32.521 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 200 kB/s | 87 kB 00:00 2024-05-08T02:41:33.063 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-05-08T02:41:33.505 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 5.1 kB/s | 2.0 kB 00:00 2024-05-08T02:41:34.088 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.1 MB 00:00 2024-05-08T02:41:35.546 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 19 MB 00:02 2024-05-08T02:41:35.840 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 31 MB/s | 19 MB 00:00 2024-05-08T02:41:39.788 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-05-08T02:41:40.441 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 6.2 MB 00:00 2024-05-08T02:41:41.464 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-05-08T02:41:42.808 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-05-08T02:41:43.076 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-08T02:41:44.271 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-08T02:41:48.266 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-05-08T02:41:49.626 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-08T02:41:50.607 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:41:50.625 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:41:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:41:50.625 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:41:50.625 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:41:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 10 M 2024-05-08T02:41:50.625 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-05-08T02:41:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: librados2 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 3.4 M 2024-05-08T02:41:50.625 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 3.7 M 2024-05-08T02:41:50.625 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 5.9 M 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 19 M 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 25 k 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 796 k 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T02:41:50.626 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 546 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 5.3 M 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 45 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 135 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 160 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 315 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 293 k 2024-05-08T02:41:50.627 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 99 k 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:Installing weak dependencies: 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:Install 30 Packages 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 2 Packages 2024-05-08T02:41:50.628 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:41:50.629 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 59 M 2024-05-08T02:41:50.629 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:41:51.683 INFO:teuthology.orchestra.run.smithi080.stdout:(1/32): ceph-base-19.0.0-3229.g4184b4e6.el9.x86 9.0 MB/s | 5.9 MB 00:00 2024-05-08T02:41:51.734 INFO:teuthology.orchestra.run.smithi080.stdout:(2/32): ceph-selinux-19.0.0-3229.g4184b4e6.el9. 501 kB/s | 25 kB 00:00 2024-05-08T02:41:51.867 INFO:teuthology.orchestra.run.smithi080.stdout:(3/32): libcephfs2-19.0.0-3229.g4184b4e6.el9.x8 5.8 MB/s | 796 kB 00:00 2024-05-08T02:41:51.992 INFO:teuthology.orchestra.run.smithi080.stdout:(4/32): libradosstriper1-19.0.0-3229.g4184b4e6. 4.3 MB/s | 546 kB 00:00 2024-05-08T02:41:52.079 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:41:52.088 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:41:52.088 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:41:52.088 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:41:52.088 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:41:52.088 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 10 M 2024-05-08T02:41:52.088 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 3.4 M 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 3.7 M 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 5.9 M 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 19 M 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 25 k 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 796 k 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T02:41:52.089 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T02:41:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 546 k 2024-05-08T02:41:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T02:41:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 5.3 M 2024-05-08T02:41:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T02:41:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T02:41:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T02:41:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 45 k 2024-05-08T02:41:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 135 k 2024-05-08T02:41:52.090 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 160 k 2024-05-08T02:41:52.091 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T02:41:52.091 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 315 k 2024-05-08T02:41:52.091 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 293 k 2024-05-08T02:41:52.091 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 99 k 2024-05-08T02:41:52.091 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T02:41:52.091 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T02:41:52.091 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T02:41:52.092 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T02:41:52.092 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-05-08T02:41:52.092 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T02:41:52.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:41:52.092 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:41:52.092 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:41:52.093 INFO:teuthology.orchestra.run.smithi046.stdout:Install 30 Packages 2024-05-08T02:41:52.093 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 2 Packages 2024-05-08T02:41:52.093 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:41:52.094 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 59 M 2024-05-08T02:41:52.094 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:41:52.509 INFO:teuthology.orchestra.run.smithi080.stdout:(5/32): librgw2-19.0.0-3229.g4184b4e6.el9.x86_6 10 MB/s | 5.3 MB 00:00 2024-05-08T02:41:52.734 INFO:teuthology.orchestra.run.smithi080.stdout:(6/32): ceph-common-19.0.0-3229.g4184b4e6.el9.x 11 MB/s | 19 MB 00:01 2024-05-08T02:41:52.760 INFO:teuthology.orchestra.run.smithi080.stdout:(7/32): python3-ceph-argparse-19.0.0-3229.g4184 180 kB/s | 45 kB 00:00 2024-05-08T02:41:52.785 INFO:teuthology.orchestra.run.smithi080.stdout:(8/32): python3-ceph-common-19.0.0-3229.g4184b4 2.6 MB/s | 135 kB 00:00 2024-05-08T02:41:52.827 INFO:teuthology.orchestra.run.smithi080.stdout:(9/32): python3-cephfs-19.0.0-3229.g4184b4e6.el 2.3 MB/s | 160 kB 00:00 2024-05-08T02:41:52.903 INFO:teuthology.orchestra.run.smithi080.stdout:(10/32): python3-rados-19.0.0-3229.g4184b4e6.el 2.6 MB/s | 315 kB 00:00 2024-05-08T02:41:52.936 INFO:teuthology.orchestra.run.smithi080.stdout:(11/32): python3-rbd-19.0.0-3229.g4184b4e6.el9. 2.6 MB/s | 293 kB 00:00 2024-05-08T02:41:52.995 INFO:teuthology.orchestra.run.smithi080.stdout:(12/32): python3-rgw-19.0.0-3229.g4184b4e6.el9. 1.1 MB/s | 99 kB 00:00 2024-05-08T02:41:53.253 INFO:teuthology.orchestra.run.smithi080.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 337 kB/s | 107 kB 00:00 2024-05-08T02:41:53.312 INFO:teuthology.orchestra.run.smithi080.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-05-08T02:41:53.337 INFO:teuthology.orchestra.run.smithi080.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 468 kB/s | 160 kB 00:00 2024-05-08T02:41:53.437 INFO:teuthology.orchestra.run.smithi080.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-05-08T02:41:53.613 INFO:teuthology.orchestra.run.smithi080.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 241 kB/s | 42 kB 00:00 2024-05-08T02:41:53.663 INFO:teuthology.orchestra.run.smithi080.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-05-08T02:41:53.713 INFO:teuthology.orchestra.run.smithi080.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-05-08T02:41:53.739 INFO:teuthology.orchestra.run.smithi080.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-05-08T02:41:53.795 INFO:teuthology.orchestra.run.smithi046.stdout:(1/32): ceph-common-19.0.0-3229.g4184b4e6.el9.x 12 MB/s | 19 MB 00:01 2024-05-08T02:41:53.806 INFO:teuthology.orchestra.run.smithi080.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 515 kB/s | 47 kB 00:00 2024-05-08T02:41:53.836 INFO:teuthology.orchestra.run.smithi046.stdout:(2/32): ceph-selinux-19.0.0-3229.g4184b4e6.el9. 611 kB/s | 25 kB 00:00 2024-05-08T02:41:53.912 INFO:teuthology.orchestra.run.smithi046.stdout:(3/32): libcephfs2-19.0.0-3229.g4184b4e6.el9.x8 10 MB/s | 796 kB 00:00 2024-05-08T02:41:53.970 INFO:teuthology.orchestra.run.smithi046.stdout:(4/32): libradosstriper1-19.0.0-3229.g4184b4e6. 9.2 MB/s | 546 kB 00:00 2024-05-08T02:41:54.254 INFO:teuthology.orchestra.run.smithi046.stdout:(5/32): librgw2-19.0.0-3229.g4184b4e6.el9.x86_6 19 MB/s | 5.3 MB 00:00 2024-05-08T02:41:54.296 INFO:teuthology.orchestra.run.smithi046.stdout:(6/32): python3-ceph-argparse-19.0.0-3229.g4184 1.1 MB/s | 45 kB 00:00 2024-05-08T02:41:54.346 INFO:teuthology.orchestra.run.smithi046.stdout:(7/32): python3-ceph-common-19.0.0-3229.g4184b4 2.7 MB/s | 135 kB 00:00 2024-05-08T02:41:54.397 INFO:teuthology.orchestra.run.smithi046.stdout:(8/32): python3-cephfs-19.0.0-3229.g4184b4e6.el 3.1 MB/s | 160 kB 00:00 2024-05-08T02:41:54.414 INFO:teuthology.orchestra.run.smithi080.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 457 kB/s | 309 kB 00:00 2024-05-08T02:41:54.447 INFO:teuthology.orchestra.run.smithi046.stdout:(9/32): python3-rados-19.0.0-3229.g4184b4e6.el9 6.2 MB/s | 315 kB 00:00 2024-05-08T02:41:54.497 INFO:teuthology.orchestra.run.smithi046.stdout:(10/32): python3-rbd-19.0.0-3229.g4184b4e6.el9. 5.7 MB/s | 293 kB 00:00 2024-05-08T02:41:54.547 INFO:teuthology.orchestra.run.smithi046.stdout:(11/32): python3-rgw-19.0.0-3229.g4184b4e6.el9. 1.9 MB/s | 99 kB 00:00 2024-05-08T02:41:54.548 INFO:teuthology.orchestra.run.smithi080.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-05-08T02:41:54.681 INFO:teuthology.orchestra.run.smithi080.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2024-05-08T02:41:54.790 INFO:teuthology.orchestra.run.smithi080.stdout:(25/32): libarrow-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-05-08T02:41:54.824 INFO:teuthology.orchestra.run.smithi080.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 474 kB/s | 67 kB 00:00 2024-05-08T02:41:54.908 INFO:teuthology.orchestra.run.smithi080.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-05-08T02:41:54.974 INFO:teuthology.orchestra.run.smithi080.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-05-08T02:41:55.050 INFO:teuthology.orchestra.run.smithi080.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-08T02:41:55.314 INFO:teuthology.orchestra.run.smithi046.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 139 kB/s | 107 kB 00:00 2024-05-08T02:41:55.383 INFO:teuthology.orchestra.run.smithi080.stdout:(30/32): librados2-19.0.0-3229.g4184b4e6.el9.x8 8.3 MB/s | 3.4 MB 00:00 2024-05-08T02:41:55.492 INFO:teuthology.orchestra.run.smithi080.stdout:(31/32): librbd1-19.0.0-3229.g4184b4e6.el9.x86_ 8.3 MB/s | 3.7 MB 00:00 2024-05-08T02:41:55.532 INFO:teuthology.orchestra.run.smithi046.stdout:(13/32): ceph-base-19.0.0-3229.g4184b4e6.el9.x8 1.8 MB/s | 5.9 MB 00:03 2024-05-08T02:41:56.206 INFO:teuthology.orchestra.run.smithi046.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 67 kB/s | 45 kB 00:00 2024-05-08T02:41:56.232 INFO:teuthology.orchestra.run.smithi046.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 175 kB/s | 160 kB 00:00 2024-05-08T02:41:57.207 INFO:teuthology.orchestra.run.smithi046.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 300 kB/s | 292 kB 00:00 2024-05-08T02:41:57.366 INFO:teuthology.orchestra.run.smithi046.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 572 kB/s | 662 kB 00:01 2024-05-08T02:41:57.949 INFO:teuthology.orchestra.run.smithi046.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 57 kB/s | 42 kB 00:00 2024-05-08T02:41:58.175 INFO:teuthology.orchestra.run.smithi080.stdout:(32/32): ceph-radosgw-19.0.0-3229.g4184b4e6.el9 1.4 MB/s | 10 MB 00:07 2024-05-08T02:41:58.181 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:41:58.181 INFO:teuthology.orchestra.run.smithi080.stdout:Total 7.8 MB/s | 59 MB 00:07 2024-05-08T02:41:58.249 INFO:teuthology.orchestra.run.smithi046.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 250 kB/s | 221 kB 00:00 2024-05-08T02:41:58.285 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:41:58.321 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:41:58.322 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:41:58.583 INFO:teuthology.orchestra.run.smithi046.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 57 kB/s | 36 kB 00:00 2024-05-08T02:41:58.900 INFO:teuthology.orchestra.run.smithi046.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 73 kB/s | 47 kB 00:00 2024-05-08T02:41:58.950 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:41:58.951 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:41:59.300 INFO:teuthology.orchestra.run.smithi046.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 432 kB/s | 309 kB 00:00 2024-05-08T02:41:59.425 INFO:teuthology.orchestra.run.smithi046.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-05-08T02:41:59.559 INFO:teuthology.orchestra.run.smithi046.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2024-05-08T02:41:59.692 INFO:teuthology.orchestra.run.smithi046.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 505 kB/s | 67 kB 00:00 2024-05-08T02:41:59.951 INFO:teuthology.orchestra.run.smithi046.stdout:(26/32): libarrow-9.0.0-11.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-05-08T02:41:59.985 INFO:teuthology.orchestra.run.smithi046.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.8 MB/s | 839 kB 00:00 2024-05-08T02:42:00.060 INFO:teuthology.orchestra.run.smithi046.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-05-08T02:42:00.235 INFO:teuthology.orchestra.run.smithi046.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-05-08T02:42:00.363 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:42:00.769 INFO:teuthology.orchestra.run.smithi046.stdout:(30/32): librbd1-19.0.0-3229.g4184b4e6.el9.x86_ 6.9 MB/s | 3.7 MB 00:00 2024-05-08T02:42:00.888 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-08T02:42:00.936 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/34 2024-05-08T02:42:00.952 INFO:teuthology.orchestra.run.smithi046.stdout:(31/32): ceph-radosgw-19.0.0-3229.g4184b4e6.el9 1.2 MB/s | 10 MB 00:08 2024-05-08T02:42:01.028 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/34 2024-05-08T02:42:01.116 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rados-2:19.0.0-3229.g4184b4e6.el9.x86_64 3/34 2024-05-08T02:42:01.154 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 4/34 2024-05-08T02:42:01.217 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 4/34 2024-05-08T02:42:01.271 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-05-08T02:42:01.300 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-05-08T02:42:01.326 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-05-08T02:42:01.348 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-05-08T02:42:01.372 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-05-08T02:42:01.511 INFO:teuthology.orchestra.run.smithi046.stdout:(32/32): librados2-19.0.0-3229.g4184b4e6.el9.x8 2.3 MB/s | 3.4 MB 00:01 2024-05-08T02:42:01.515 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:42:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:Total 6.3 MB/s | 59 MB 00:09 2024-05-08T02:42:01.567 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-05-08T02:42:01.598 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-05-08T02:42:01.624 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:42:01.665 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:42:01.666 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:42:01.968 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-05-08T02:42:02.019 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 11/34 2024-05-08T02:42:02.086 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 11/34 2024-05-08T02:42:02.130 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-argparse-2:19.0.0-3229.g4184b4e6.el9. 12/34 2024-05-08T02:42:02.185 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cephfs-2:19.0.0-3229.g4184b4e6.el9.x86_64 13/34 2024-05-08T02:42:02.236 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 14/34 2024-05-08T02:42:02.311 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:42:02.311 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:42:02.330 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-05-08T02:42:02.356 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libradosstriper1-2:19.0.0-3229.g4184b4e6.el9.x86_6 16/34 2024-05-08T02:42:02.445 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3229.g4184b4e6.el9.x86_6 16/34 2024-05-08T02:42:02.480 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-05-08T02:42:02.590 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-05-08T02:42:02.630 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/34 2024-05-08T02:42:02.672 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-05-08T02:42:02.704 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-05-08T02:42:02.741 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 22/34 2024-05-08T02:42:02.772 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-05-08T02:42:02.809 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-08T02:42:03.379 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-08T02:42:03.404 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librgw2-2:19.0.0-3229.g4184b4e6.el9.x86_64 26/34 2024-05-08T02:42:03.475 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librgw2-2:19.0.0-3229.g4184b4e6.el9.x86_64 26/34 2024-05-08T02:42:03.552 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 27/34 2024-05-08T02:42:03.581 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ceph-common-2:19.0.0-3229.g4184b4e6.el9.x8 28/34 2024-05-08T02:42:03.739 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:42:04.251 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-08T02:42:04.330 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/34 2024-05-08T02:42:04.423 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/34 2024-05-08T02:42:04.514 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.0.0-3229.g4184b4e6.el9.x86_64 3/34 2024-05-08T02:42:04.548 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 4/34 2024-05-08T02:42:04.611 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 4/34 2024-05-08T02:42:04.649 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-05-08T02:42:04.694 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-05-08T02:42:04.719 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-05-08T02:42:04.742 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-05-08T02:42:04.769 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-05-08T02:42:05.079 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-05-08T02:42:05.109 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-05-08T02:42:05.489 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-05-08T02:42:05.538 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 11/34 2024-05-08T02:42:05.611 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 11/34 2024-05-08T02:42:05.668 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.0.0-3229.g4184b4e6.el9. 12/34 2024-05-08T02:42:05.735 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.0.0-3229.g4184b4e6.el9.x86_64 13/34 2024-05-08T02:42:05.761 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 14/34 2024-05-08T02:42:05.842 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-05-08T02:42:05.874 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.0.0-3229.g4184b4e6.el9.x86_6 16/34 2024-05-08T02:42:05.955 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3229.g4184b4e6.el9.x86_6 16/34 2024-05-08T02:42:05.990 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-05-08T02:42:05.997 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 29/34 2024-05-08T02:42:06.037 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 29/34 2024-05-08T02:42:06.100 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-05-08T02:42:06.136 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/34 2024-05-08T02:42:06.190 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-05-08T02:42:06.222 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-05-08T02:42:06.251 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 22/34 2024-05-08T02:42:06.273 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-05-08T02:42:06.310 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-08T02:42:06.738 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 29/34 2024-05-08T02:42:06.774 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 30/34 2024-05-08T02:42:06.876 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 30/34 2024-05-08T02:42:06.876 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T02:42:06.876 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T02:42:06.876 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:06.910 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-selinux-2:19.0.0-3229.g4184b4e6.el9.x86_64 31/34 2024-05-08T02:42:06.911 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-08T02:42:06.948 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.0.0-3229.g4184b4e6.el9.x86_64 26/34 2024-05-08T02:42:07.018 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.0.0-3229.g4184b4e6.el9.x86_64 26/34 2024-05-08T02:42:07.099 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 27/34 2024-05-08T02:42:07.124 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.0.0-3229.g4184b4e6.el9.x8 28/34 2024-05-08T02:42:09.710 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 29/34 2024-05-08T02:42:09.754 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 29/34 2024-05-08T02:42:10.482 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 29/34 2024-05-08T02:42:10.516 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 30/34 2024-05-08T02:42:10.633 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 30/34 2024-05-08T02:42:10.633 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T02:42:10.633 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T02:42:10.633 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:10.667 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.0.0-3229.g4184b4e6.el9.x86_64 31/34 2024-05-08T02:42:16.859 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3229.g4184b4e6.el9.x86_64 31/34 2024-05-08T02:42:16.859 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /sys 2024-05-08T02:42:16.859 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /proc 2024-05-08T02:42:16.859 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /mnt 2024-05-08T02:42:16.859 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /var/tmp 2024-05-08T02:42:16.859 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /home 2024-05-08T02:42:16.860 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /root 2024-05-08T02:42:16.860 INFO:teuthology.orchestra.run.smithi080.stdout:skipping the directory /tmp 2024-05-08T02:42:16.860 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:17.938 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-radosgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 32/34 2024-05-08T02:42:17.965 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 32/34 2024-05-08T02:42:17.965 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:42:17.965 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T02:42:17.965 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T02:42:17.966 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T02:42:17.966 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:17.967 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T02:42:18.048 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T02:42:18.048 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T02:42:19.353 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T02:42:19.353 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/34 2024-05-08T02:42:19.353 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/34 2024-05-08T02:42:19.353 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-radosgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 3/34 2024-05-08T02:42:19.353 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-selinux-2:19.0.0-3229.g4184b4e6.el9.x86_64 4/34 2024-05-08T02:42:19.353 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 5/34 2024-05-08T02:42:19.353 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libradosstriper1-2:19.0.0-3229.g4184b4e6.el9.x86_6 6/34 2024-05-08T02:42:19.353 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librgw2-2:19.0.0-3229.g4184b4e6.el9.x86_64 7/34 2024-05-08T02:42:19.353 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3229.g4184b4e6.el9. 8/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ceph-common-2:19.0.0-3229.g4184b4e6.el9.x8 9/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cephfs-2:19.0.0-3229.g4184b4e6.el9.x86_64 10/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rados-2:19.0.0-3229.g4184b4e6.el9.x86_64 11/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 12/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 13/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-08T02:42:19.354 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-08T02:42:19.355 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-08T02:42:19.355 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-08T02:42:19.355 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-08T02:42:19.355 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-08T02:42:19.355 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-08T02:42:19.355 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-08T02:42:19.356 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-08T02:42:19.356 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-08T02:42:19.356 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-08T02:42:19.356 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 31/34 2024-05-08T02:42:19.356 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-08T02:42:19.356 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 33/34 2024-05-08T02:42:20.137 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T02:42:20.137 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:20.137 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-05-08T02:42:20.137 INFO:teuthology.orchestra.run.smithi080.stdout: librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.137 INFO:teuthology.orchestra.run.smithi080.stdout: librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.137 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:42:20.137 INFO:teuthology.orchestra.run.smithi080.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T02:42:20.137 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.137 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-radosgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-selinux-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: libradosstriper1-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: librgw2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.138 INFO:teuthology.orchestra.run.smithi080.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-argparse-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cephfs-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rados-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T02:42:20.139 INFO:teuthology.orchestra.run.smithi080.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T02:42:20.140 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:20.140 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:42:20.526 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-test 2024-05-08T02:42:21.081 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3229.g4184b4e6.el9.x86_64 31/34 2024-05-08T02:42:21.081 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-05-08T02:42:21.081 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-05-08T02:42:21.081 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-05-08T02:42:21.081 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-05-08T02:42:21.081 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-05-08T02:42:21.081 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-05-08T02:42:21.081 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-05-08T02:42:21.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:21.100 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:33 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:42:21.220 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:42:21.221 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:42:21.221 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:42:21.221 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:42:21.221 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:42:21.221 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 84 M 2024-05-08T02:42:21.221 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:42:21.221 INFO:teuthology.orchestra.run.smithi080.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 173 k 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout:Install 9 Packages 2024-05-08T02:42:21.222 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:21.223 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 87 M 2024-05-08T02:42:21.223 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 813 M 2024-05-08T02:42:21.223 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:42:21.887 INFO:teuthology.orchestra.run.smithi080.stdout:(1/9): libcephsqlite-19.0.0-3229.g4184b4e6.el9. 496 kB/s | 173 kB 00:00 2024-05-08T02:42:22.062 INFO:teuthology.orchestra.run.smithi080.stdout:(2/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 179 kB/s | 94 kB 00:00 2024-05-08T02:42:22.202 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 32/34 2024-05-08T02:42:22.229 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 32/34 2024-05-08T02:42:22.229 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:42:22.229 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T02:42:22.229 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T02:42:22.229 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T02:42:22.229 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:22.231 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T02:42:22.321 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T02:42:22.321 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T02:42:23.046 INFO:teuthology.orchestra.run.smithi080.stdout:(3/9): libubsan-11.4.1-3.el9.x86_64.rpm 190 kB/s | 187 kB 00:00 2024-05-08T02:42:23.071 INFO:teuthology.orchestra.run.smithi080.stdout:(4/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 396 kB/s | 469 kB 00:01 2024-05-08T02:42:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T02:42:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/34 2024-05-08T02:42:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/34 2024-05-08T02:42:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 3/34 2024-05-08T02:42:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.0.0-3229.g4184b4e6.el9.x86_64 4/34 2024-05-08T02:42:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 5/34 2024-05-08T02:42:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.0.0-3229.g4184b4e6.el9.x86_6 6/34 2024-05-08T02:42:23.530 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.0.0-3229.g4184b4e6.el9.x86_64 7/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3229.g4184b4e6.el9. 8/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.0.0-3229.g4184b4e6.el9.x8 9/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.0.0-3229.g4184b4e6.el9.x86_64 10/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.0.0-3229.g4184b4e6.el9.x86_64 11/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 12/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 13/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-08T02:42:23.531 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-08T02:42:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-08T02:42:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-08T02:42:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-08T02:42:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-08T02:42:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-08T02:42:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-08T02:42:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-08T02:42:23.532 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-08T02:42:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-08T02:42:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 31/34 2024-05-08T02:42:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-08T02:42:23.533 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 33/34 2024-05-08T02:42:24.129 INFO:teuthology.orchestra.run.smithi080.stdout:(5/9): socat-1.7.4.1-5.el9.x86_64.rpm 288 kB/s | 305 kB 00:01 2024-05-08T02:42:24.280 INFO:teuthology.orchestra.run.smithi080.stdout:(6/9): protobuf-3.14.0-13.el9.x86_64.rpm 838 kB/s | 1.0 MB 00:01 2024-05-08T02:42:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T02:42:24.414 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:24.414 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.416 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T02:42:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T02:42:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T02:42:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T02:42:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T02:42:24.417 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:24.417 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:42:24.809 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-test 2024-05-08T02:42:24.905 INFO:teuthology.orchestra.run.smithi080.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 82 kB/s | 64 kB 00:00 2024-05-08T02:42:24.930 INFO:teuthology.orchestra.run.smithi080.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 187 kB/s | 122 kB 00:00 2024-05-08T02:42:25.401 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:36 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:42:25.527 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:42:25.528 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:42:25.528 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:42:25.528 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:42:25.528 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 84 M 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 173 k 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:42:25.529 INFO:teuthology.orchestra.run.smithi046.stdout:Install 9 Packages 2024-05-08T02:42:25.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:25.530 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 87 M 2024-05-08T02:42:25.530 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 813 M 2024-05-08T02:42:25.530 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:42:26.019 INFO:teuthology.orchestra.run.smithi080.stdout:(9/9): ceph-test-19.0.0-3229.g4184b4e6.el9.x86_ 19 MB/s | 84 MB 00:04 2024-05-08T02:42:26.022 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:42:26.022 INFO:teuthology.orchestra.run.smithi080.stdout:Total 18 MB/s | 87 MB 00:04 2024-05-08T02:42:26.104 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:42:26.127 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:42:26.127 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:42:26.483 INFO:teuthology.orchestra.run.smithi046.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-05-08T02:42:26.725 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:42:26.725 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:42:26.808 INFO:teuthology.orchestra.run.smithi046.stdout:(2/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 1.5 MB/s | 469 kB 00:00 2024-05-08T02:42:26.942 INFO:teuthology.orchestra.run.smithi046.stdout:(3/9): libcephsqlite-19.0.0-3229.g4184b4e6.el9. 318 kB/s | 173 kB 00:00 2024-05-08T02:42:26.985 INFO:teuthology.orchestra.run.smithi046.stdout:(4/9): libubsan-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-05-08T02:42:27.117 INFO:teuthology.orchestra.run.smithi046.stdout:(5/9): socat-1.7.4.1-5.el9.x86_64.rpm 2.2 MB/s | 305 kB 00:00 2024-05-08T02:42:27.459 INFO:teuthology.orchestra.run.smithi046.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 186 kB/s | 64 kB 00:00 2024-05-08T02:42:27.526 INFO:teuthology.orchestra.run.smithi046.stdout:(7/9): protobuf-3.14.0-13.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-05-08T02:42:27.658 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:42:27.676 INFO:teuthology.orchestra.run.smithi046.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 648 kB/s | 122 kB 00:00 2024-05-08T02:42:27.721 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-05-08T02:42:27.769 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-05-08T02:42:27.818 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-05-08T02:42:27.847 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-05-08T02:42:27.884 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-05-08T02:42:27.909 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-05-08T02:42:27.967 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-05-08T02:42:28.020 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-05-08T02:42:28.044 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephsqlite-2:19.0.0-3229.g4184b4e6.el9.x86_64 8/9 2024-05-08T02:42:32.552 INFO:teuthology.orchestra.run.smithi046.stdout:(9/9): ceph-test-19.0.0-3229.g4184b4e6.el9.x86_ 14 MB/s | 84 MB 00:06 2024-05-08T02:42:32.554 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:42:32.554 INFO:teuthology.orchestra.run.smithi046.stdout:Total 12 MB/s | 87 MB 00:07 2024-05-08T02:42:32.639 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:42:32.665 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:42:32.665 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:42:33.293 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:42:33.293 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:42:34.209 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:42:34.276 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-05-08T02:42:34.329 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-05-08T02:42:34.383 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-05-08T02:42:34.418 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-05-08T02:42:34.455 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-05-08T02:42:34.480 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-05-08T02:42:34.546 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-05-08T02:42:34.589 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-05-08T02:42:34.615 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.0.0-3229.g4184b4e6.el9.x86_64 8/9 2024-05-08T02:42:39.449 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3229.g4184b4e6.el9.x86_64 8/9 2024-05-08T02:42:39.534 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-test-2:19.0.0-3229.g4184b4e6.el9.x86_64 9/9 2024-05-08T02:42:46.053 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-test-2:19.0.0-3229.g4184b4e6.el9.x86_64 9/9 2024-05-08T02:42:46.053 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-test-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/9 2024-05-08T02:42:46.053 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephsqlite-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/9 2024-05-08T02:42:46.053 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-05-08T02:42:46.053 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-05-08T02:42:46.053 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-05-08T02:42:46.053 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-05-08T02:42:46.054 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-05-08T02:42:46.054 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-05-08T02:42:46.392 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-test-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: libcephsqlite-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: libubsan-11.4.1-3.el9.x86_64 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-05-08T02:42:46.393 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:46.394 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:42:46.613 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3229.g4184b4e6.el9.x86_64 8/9 2024-05-08T02:42:46.699 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.0.0-3229.g4184b4e6.el9.x86_64 9/9 2024-05-08T02:42:46.717 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph 2024-05-08T02:42:47.284 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:00:59 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:42:47.407 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:42:47.410 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:42:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:42:47.410 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:42:47.410 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:42:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: ceph x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 6.5 k 2024-05-08T02:42:47.410 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:42:47.410 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 2.2 M 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 1.6 M 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 249 k 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 5.0 M 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 71 M 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T02:42:47.411 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T02:42:47.412 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout:Install 36 Packages 2024-05-08T02:42:47.413 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:47.414 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 85 M 2024-05-08T02:42:47.414 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 923 M 2024-05-08T02:42:47.414 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:42:47.987 INFO:teuthology.orchestra.run.smithi080.stdout:(1/36): ceph-19.0.0-3229.g4184b4e6.el9.x86_64.r 38 kB/s | 6.5 kB 00:00 2024-05-08T02:42:48.346 INFO:teuthology.orchestra.run.smithi080.stdout:(2/36): ceph-mgr-19.0.0-3229.g4184b4e6.el9.x86_ 2.9 MB/s | 1.6 MB 00:00 2024-05-08T02:42:48.430 INFO:teuthology.orchestra.run.smithi080.stdout:(3/36): ceph-mds-19.0.0-3229.g4184b4e6.el9.x86_ 3.6 MB/s | 2.2 MB 00:00 2024-05-08T02:42:48.538 INFO:teuthology.orchestra.run.smithi080.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3229.g4184 2.2 MB/s | 249 kB 00:00 2024-05-08T02:42:48.755 INFO:teuthology.orchestra.run.smithi080.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-05-08T02:42:48.822 INFO:teuthology.orchestra.run.smithi080.stdout:(6/36): ceph-mon-19.0.0-3229.g4184b4e6.el9.x86_ 6.0 MB/s | 5.0 MB 00:00 2024-05-08T02:42:48.964 INFO:teuthology.orchestra.run.smithi080.stdout:(7/36): python3-cryptography-36.0.1-4.el9.x86_6 5.9 MB/s | 1.2 MB 00:00 2024-05-08T02:42:49.022 INFO:teuthology.orchestra.run.smithi080.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-05-08T02:42:49.048 INFO:teuthology.orchestra.run.smithi080.stdout:(9/36): python3-ply-3.11-14.el9.noarch.rpm 472 kB/s | 106 kB 00:00 2024-05-08T02:42:49.073 INFO:teuthology.orchestra.run.smithi080.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-05-08T02:42:49.165 INFO:teuthology.orchestra.run.smithi080.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.8 MB/s | 215 kB 00:00 2024-05-08T02:42:49.199 INFO:teuthology.orchestra.run.smithi080.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-08T02:42:49.257 INFO:teuthology.orchestra.run.smithi080.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 597 kB/s | 35 kB 00:00 2024-05-08T02:42:49.299 INFO:teuthology.orchestra.run.smithi080.stdout:(14/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-05-08T02:42:49.324 INFO:teuthology.orchestra.run.smithi080.stdout:(15/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-05-08T02:42:49.341 INFO:teuthology.orchestra.run.smithi080.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 995 kB/s | 42 kB 00:00 2024-05-08T02:42:49.475 INFO:teuthology.orchestra.run.smithi080.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-05-08T02:42:49.550 INFO:teuthology.orchestra.run.smithi080.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 724 kB/s | 151 kB 00:00 2024-05-08T02:42:49.609 INFO:teuthology.orchestra.run.smithi080.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 325 kB/s | 43 kB 00:00 2024-05-08T02:42:49.651 INFO:teuthology.orchestra.run.smithi080.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-05-08T02:42:49.693 INFO:teuthology.orchestra.run.smithi080.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 256 kB/s | 11 kB 00:00 2024-05-08T02:42:49.735 INFO:teuthology.orchestra.run.smithi080.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 426 kB/s | 18 kB 00:00 2024-05-08T02:42:49.769 INFO:teuthology.orchestra.run.smithi080.stdout:(23/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-05-08T02:42:49.786 INFO:teuthology.orchestra.run.smithi080.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 456 kB/s | 23 kB 00:00 2024-05-08T02:42:49.821 INFO:teuthology.orchestra.run.smithi080.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 374 kB/s | 19 kB 00:00 2024-05-08T02:42:49.836 INFO:teuthology.orchestra.run.smithi080.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-05-08T02:42:49.878 INFO:teuthology.orchestra.run.smithi080.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 814 kB/s | 46 kB 00:00 2024-05-08T02:42:49.903 INFO:teuthology.orchestra.run.smithi080.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2024-05-08T02:42:49.945 INFO:teuthology.orchestra.run.smithi080.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-08T02:42:49.971 INFO:teuthology.orchestra.run.smithi080.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 245 kB/s | 16 kB 00:00 2024-05-08T02:42:50.004 INFO:teuthology.orchestra.run.smithi080.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-05-08T02:42:50.029 INFO:teuthology.orchestra.run.smithi080.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 612 kB/s | 36 kB 00:00 2024-05-08T02:42:50.072 INFO:teuthology.orchestra.run.smithi080.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-05-08T02:42:50.114 INFO:teuthology.orchestra.run.smithi080.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-05-08T02:42:50.139 INFO:teuthology.orchestra.run.smithi080.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 298 kB/s | 20 kB 00:00 2024-05-08T02:42:52.629 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-test-2:19.0.0-3229.g4184b4e6.el9.x86_64 9/9 2024-05-08T02:42:52.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/9 2024-05-08T02:42:52.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/9 2024-05-08T02:42:52.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-05-08T02:42:52.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-05-08T02:42:52.629 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-05-08T02:42:52.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-05-08T02:42:52.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-05-08T02:42:52.630 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-05-08T02:42:52.979 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-05-08T02:42:52.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:52.979 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:42:52.979 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:52.979 INFO:teuthology.orchestra.run.smithi046.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-05-08T02:42:52.979 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:42:52.980 INFO:teuthology.orchestra.run.smithi046.stdout: libubsan-11.4.1-3.el9.x86_64 2024-05-08T02:42:52.980 INFO:teuthology.orchestra.run.smithi046.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-05-08T02:42:52.980 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T02:42:52.980 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T02:42:52.980 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T02:42:52.980 INFO:teuthology.orchestra.run.smithi046.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-05-08T02:42:52.980 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:52.980 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:42:53.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph 2024-05-08T02:42:53.722 INFO:teuthology.orchestra.run.smithi080.stdout:(36/36): ceph-osd-19.0.0-3229.g4184b4e6.el9.x86 13 MB/s | 71 MB 00:05 2024-05-08T02:42:53.724 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:42:53.724 INFO:teuthology.orchestra.run.smithi080.stdout:Total 13 MB/s | 85 MB 00:06 2024-05-08T02:42:53.862 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:42:53.878 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:04 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:42:53.902 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:42:53.902 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:42:54.008 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:42:54.010 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:42:54.010 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 6.5 k 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 2.2 M 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 1.6 M 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 249 k 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 5.0 M 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 71 M 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T02:42:54.011 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T02:42:54.012 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T02:42:54.013 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:54.014 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:42:54.014 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:42:54.014 INFO:teuthology.orchestra.run.smithi046.stdout:Install 36 Packages 2024-05-08T02:42:54.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:42:54.014 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 85 M 2024-05-08T02:42:54.014 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 923 M 2024-05-08T02:42:54.014 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:42:54.657 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:42:54.658 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:42:55.082 INFO:teuthology.orchestra.run.smithi046.stdout:(1/36): ceph-19.0.0-3229.g4184b4e6.el9.x86_64.r 19 kB/s | 6.5 kB 00:00 2024-05-08T02:42:56.228 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:42:56.283 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-08T02:42:56.324 INFO:teuthology.orchestra.run.smithi046.stdout:(2/36): ceph-mds-19.0.0-3229.g4184b4e6.el9.x86_ 1.4 MB/s | 2.2 MB 00:01 2024-05-08T02:42:56.324 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-08T02:42:56.352 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-08T02:42:56.423 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-08T02:42:56.476 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-08T02:42:56.509 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-08T02:42:56.599 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-08T02:42:56.687 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-08T02:42:56.728 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-08T02:42:56.763 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-08T02:42:56.765 INFO:teuthology.orchestra.run.smithi046.stdout:(3/36): ceph-mgr-19.0.0-3229.g4184b4e6.el9.x86_ 786 kB/s | 1.6 MB 00:02 2024-05-08T02:42:56.793 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-08T02:42:56.828 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-08T02:42:56.861 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-08T02:42:56.918 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-08T02:42:56.953 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-08T02:42:56.987 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-08T02:42:57.026 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-08T02:42:57.099 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-08T02:42:57.099 INFO:teuthology.orchestra.run.smithi046.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3229.g4184 746 kB/s | 249 kB 00:00 2024-05-08T02:42:57.237 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-08T02:42:57.308 INFO:teuthology.orchestra.run.smithi046.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-05-08T02:42:57.316 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-08T02:42:57.370 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-08T02:42:57.409 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-08T02:42:57.466 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-08T02:42:57.475 INFO:teuthology.orchestra.run.smithi046.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 7.4 MB/s | 1.2 MB 00:00 2024-05-08T02:42:57.521 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-08T02:42:57.533 INFO:teuthology.orchestra.run.smithi046.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-08T02:42:57.592 INFO:teuthology.orchestra.run.smithi046.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-05-08T02:42:57.650 INFO:teuthology.orchestra.run.smithi046.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-05-08T02:42:57.718 INFO:teuthology.orchestra.run.smithi046.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-05-08T02:42:57.722 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-08T02:42:57.772 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-08T02:42:57.776 INFO:teuthology.orchestra.run.smithi046.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-05-08T02:42:57.835 INFO:teuthology.orchestra.run.smithi046.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-08T02:42:57.850 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-08T02:42:57.893 INFO:teuthology.orchestra.run.smithi046.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 596 kB/s | 35 kB 00:00 2024-05-08T02:42:57.938 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-08T02:42:57.952 INFO:teuthology.orchestra.run.smithi046.stdout:(14/36): python3-pytz-2021.1-5.el9.noarch.rpm 877 kB/s | 51 kB 00:00 2024-05-08T02:42:57.971 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-08T02:42:58.011 INFO:teuthology.orchestra.run.smithi046.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-05-08T02:42:58.069 INFO:teuthology.orchestra.run.smithi046.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 384 kB/s | 22 kB 00:00 2024-05-08T02:42:58.095 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-08T02:42:58.278 INFO:teuthology.orchestra.run.smithi046.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 726 kB/s | 151 kB 00:00 2024-05-08T02:42:58.298 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3229.g4184b4e6.el9. 31/36 2024-05-08T02:42:58.323 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 32/36 2024-05-08T02:42:58.336 INFO:teuthology.orchestra.run.smithi046.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 746 kB/s | 43 kB 00:00 2024-05-08T02:42:58.349 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 32/36 2024-05-08T02:42:58.349 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:42:58.349 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T02:42:58.349 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T02:42:58.350 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T02:42:58.350 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:42:58.420 INFO:teuthology.orchestra.run.smithi046.stdout:(19/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-05-08T02:42:58.529 INFO:teuthology.orchestra.run.smithi046.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-05-08T02:42:58.579 INFO:teuthology.orchestra.run.smithi046.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 215 kB/s | 11 kB 00:00 2024-05-08T02:42:58.629 INFO:teuthology.orchestra.run.smithi046.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 354 kB/s | 18 kB 00:00 2024-05-08T02:42:58.679 INFO:teuthology.orchestra.run.smithi046.stdout:(23/36): python3-jaraco-collections-3.0.0-8.el9 465 kB/s | 23 kB 00:00 2024-05-08T02:42:58.730 INFO:teuthology.orchestra.run.smithi046.stdout:(24/36): python3-jaraco-functools-3.5.0-2.el9.n 390 kB/s | 19 kB 00:00 2024-05-08T02:42:58.780 INFO:teuthology.orchestra.run.smithi046.stdout:(25/36): python3-jaraco-text-3.2.0-6.el9.noarch 395 kB/s | 20 kB 00:00 2024-05-08T02:42:58.838 INFO:teuthology.orchestra.run.smithi046.stdout:(26/36): python3-logutils-0.3.5-21.el9.noarch.r 796 kB/s | 46 kB 00:00 2024-05-08T02:42:58.897 INFO:teuthology.orchestra.run.smithi046.stdout:(27/36): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-05-08T02:42:58.964 INFO:teuthology.orchestra.run.smithi046.stdout:(28/36): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-08T02:42:59.006 INFO:teuthology.orchestra.run.smithi046.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 395 kB/s | 16 kB 00:00 2024-05-08T02:42:59.064 INFO:teuthology.orchestra.run.smithi046.stdout:(30/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-05-08T02:42:59.106 INFO:teuthology.orchestra.run.smithi046.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 864 kB/s | 36 kB 00:00 2024-05-08T02:42:59.165 INFO:teuthology.orchestra.run.smithi046.stdout:(32/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-05-08T02:42:59.240 INFO:teuthology.orchestra.run.smithi046.stdout:(33/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.6 MB/s | 427 kB 00:00 2024-05-08T02:42:59.282 INFO:teuthology.orchestra.run.smithi046.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 480 kB/s | 20 kB 00:00 2024-05-08T02:43:00.724 INFO:teuthology.orchestra.run.smithi046.stdout:(35/36): ceph-mon-19.0.0-3229.g4184b4e6.el9.x86 912 kB/s | 5.0 MB 00:05 2024-05-08T02:43:09.139 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-osd-2:19.0.0-3229.g4184b4e6.el9.x86_64 33/36 2024-05-08T02:43:09.166 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-osd-2:19.0.0-3229.g4184b4e6.el9.x86_64 33/36 2024-05-08T02:43:09.167 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:43:09.167 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T02:43:09.167 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T02:43:09.167 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T02:43:09.167 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:09.698 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mon-2:19.0.0-3229.g4184b4e6.el9.x86_64 34/36 2024-05-08T02:43:09.723 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mon-2:19.0.0-3229.g4184b4e6.el9.x86_64 34/36 2024-05-08T02:43:09.723 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:43:09.723 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T02:43:09.723 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T02:43:09.724 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T02:43:09.724 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:09.983 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mds-2:19.0.0-3229.g4184b4e6.el9.x86_64 35/36 2024-05-08T02:43:10.005 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mds-2:19.0.0-3229.g4184b4e6.el9.x86_64 35/36 2024-05-08T02:43:10.005 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:43:10.005 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T02:43:10.005 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T02:43:10.005 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T02:43:10.005 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:10.071 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-2:19.0.0-3229.g4184b4e6.el9.x86_64 36/36 2024-05-08T02:43:17.133 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-2:19.0.0-3229.g4184b4e6.el9.x86_64 36/36 2024-05-08T02:43:17.133 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/36 2024-05-08T02:43:17.133 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mds-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/36 2024-05-08T02:43:17.133 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 3/36 2024-05-08T02:43:17.133 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mon-2:19.0.0-3229.g4184b4e6.el9.x86_64 4/36 2024-05-08T02:43:17.133 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-osd-2:19.0.0-3229.g4184b4e6.el9.x86_64 5/36 2024-05-08T02:43:17.133 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3229.g4184b4e6.el9. 6/36 2024-05-08T02:43:17.133 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-08T02:43:17.133 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-08T02:43:17.134 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-08T02:43:17.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-08T02:43:18.019 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-08T02:43:18.019 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mds-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-modules-core-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mon-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-osd-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T02:43:18.020 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T02:43:18.021 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:18.022 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:18.440 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-base 2024-05-08T02:43:19.009 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:31 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:19.090 INFO:teuthology.orchestra.run.smithi080.stdout:Package ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:43:19.133 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:19.134 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T02:43:19.134 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:19.180 INFO:teuthology.orchestra.run.smithi046.stdout:(36/36): ceph-osd-19.0.0-3229.g4184b4e6.el9.x86 3.1 MB/s | 71 MB 00:22 2024-05-08T02:43:19.183 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:19.183 INFO:teuthology.orchestra.run.smithi046.stdout:Total 3.4 MB/s | 85 MB 00:25 2024-05-08T02:43:19.209 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install cephadm 2024-05-08T02:43:19.325 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:43:19.370 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:43:19.370 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:43:19.769 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:31 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:19.892 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:19.892 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:19.892 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 762 k 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 762 k 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 769 k 2024-05-08T02:43:19.893 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:43:20.162 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:43:20.162 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:43:20.191 INFO:teuthology.orchestra.run.smithi080.stdout:cephadm-19.0.0-3229.g4184b4e6.el9.noarch.rpm 2.5 MB/s | 762 kB 00:00 2024-05-08T02:43:20.192 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:20.192 INFO:teuthology.orchestra.run.smithi080.stdout:Total 2.5 MB/s | 762 kB 00:00 2024-05-08T02:43:20.192 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:43:20.198 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:43:20.198 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:43:20.204 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:43:20.204 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:43:20.277 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:43:20.756 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/1 2024-05-08T02:43:20.855 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/1 2024-05-08T02:43:21.204 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/1 2024-05-08T02:43:21.440 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/1 2024-05-08T02:43:21.440 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:21.440 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:43:21.440 INFO:teuthology.orchestra.run.smithi080.stdout: cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:21.440 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:21.440 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:21.671 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T02:43:21.764 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:43:21.833 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-08T02:43:21.894 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-08T02:43:21.919 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-08T02:43:21.987 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-08T02:43:22.035 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-08T02:43:22.067 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-08T02:43:22.165 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-08T02:43:22.244 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:34 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:22.249 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-08T02:43:22.296 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-08T02:43:22.330 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-08T02:43:22.359 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-08T02:43:22.367 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:22.367 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:22.367 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repo Size 2024-05-08T02:43:22.367 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:22.367 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:43:22.367 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 158 k 2024-05-08T02:43:22.368 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:22.368 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:43:22.368 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:22.368 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-05-08T02:43:22.368 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:22.368 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 158 k 2024-05-08T02:43:22.368 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 640 k 2024-05-08T02:43:22.369 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:43:22.394 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-08T02:43:22.419 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-08T02:43:22.452 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-08T02:43:22.495 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-08T02:43:22.529 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-08T02:43:22.685 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-08T02:43:22.761 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-08T02:43:22.912 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-08T02:43:22.917 INFO:teuthology.orchestra.run.smithi080.stdout:ceph-immutable-object-cache-19.0.0-3229.g4184b4 287 kB/s | 158 kB 00:00 2024-05-08T02:43:22.918 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:22.918 INFO:teuthology.orchestra.run.smithi080.stdout:Total 286 kB/s | 158 kB 00:00 2024-05-08T02:43:22.918 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:43:22.928 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:43:22.928 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:43:22.985 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:43:22.985 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:43:22.995 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-08T02:43:23.046 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-08T02:43:23.083 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-08T02:43:23.132 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:43:23.141 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-08T02:43:23.205 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-08T02:43:23.210 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3229.g4184b4e6. 1/1 2024-05-08T02:43:23.236 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3229.g4184b4e6. 1/1 2024-05-08T02:43:23.236 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:43:23.236 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T02:43:23.236 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:23.418 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-08T02:43:23.473 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-08T02:43:23.551 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-08T02:43:23.650 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-08T02:43:23.695 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-08T02:43:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-08T02:43:24.017 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3229.g4184b4e6.el9. 31/36 2024-05-08T02:43:24.046 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 32/36 2024-05-08T02:43:24.073 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 32/36 2024-05-08T02:43:24.073 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:43:24.073 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T02:43:24.073 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T02:43:24.073 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T02:43:24.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:24.155 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3229.g4184b4e6. 1/1 2024-05-08T02:43:24.155 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:24.155 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:43:24.155 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-immutable-object-cache-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:24.155 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:24.155 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:24.426 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr 2024-05-08T02:43:25.000 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:36 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:25.084 INFO:teuthology.orchestra.run.smithi080.stdout:Package ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:43:25.125 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:25.126 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T02:43:25.126 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:25.200 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T02:43:25.760 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:37 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:25.883 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:25.884 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:25.884 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 3.5 M 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 34 k 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 16 k 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T02:43:25.885 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T02:43:25.886 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T02:43:25.886 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:25.886 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:43:25.886 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:25.886 INFO:teuthology.orchestra.run.smithi080.stdout:Install 11 Packages 2024-05-08T02:43:25.886 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:25.887 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 7.6 M 2024-05-08T02:43:25.887 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 100 M 2024-05-08T02:43:25.887 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:43:26.781 INFO:teuthology.orchestra.run.smithi080.stdout:(1/11): ceph-grafana-dashboards-19.0.0-3229.g41 82 kB/s | 34 kB 00:00 2024-05-08T02:43:26.902 INFO:teuthology.orchestra.run.smithi080.stdout:(2/11): ceph-prometheus-alerts-19.0.0-3229.g418 30 kB/s | 16 kB 00:00 2024-05-08T02:43:27.165 INFO:teuthology.orchestra.run.smithi080.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.2 MB/s | 863 kB 00:00 2024-05-08T02:43:27.274 INFO:teuthology.orchestra.run.smithi080.stdout:(4/11): ceph-mgr-dashboard-19.0.0-3229.g4184b4e 3.9 MB/s | 3.5 MB 00:00 2024-05-08T02:43:27.699 INFO:teuthology.orchestra.run.smithi080.stdout:(5/11): python3-protobuf-3.14.0-13.el9.noarch.r 293 kB/s | 269 kB 00:00 2024-05-08T02:43:27.724 INFO:teuthology.orchestra.run.smithi080.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 46 kB/s | 19 kB 00:00 2024-05-08T02:43:27.941 INFO:teuthology.orchestra.run.smithi080.stdout:(7/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 707 kB/s | 548 kB 00:00 2024-05-08T02:43:28.066 INFO:teuthology.orchestra.run.smithi080.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 246 kB/s | 31 kB 00:00 2024-05-08T02:43:28.208 INFO:teuthology.orchestra.run.smithi080.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 1.3 MB/s | 188 kB 00:00 2024-05-08T02:43:28.300 INFO:teuthology.orchestra.run.smithi080.stdout:(10/11): python3-grpcio-tools-1.46.7-10.el9.x86 251 kB/s | 144 kB 00:00 2024-05-08T02:43:28.375 INFO:teuthology.orchestra.run.smithi080.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.0 MB/s | 2.0 MB 00:00 2024-05-08T02:43:28.379 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:28.380 INFO:teuthology.orchestra.run.smithi080.stdout:Total 3.1 MB/s | 7.6 MB 00:02 2024-05-08T02:43:28.410 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:43:28.427 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:43:28.427 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:43:28.604 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:43:28.605 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:43:29.156 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:43:29.249 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-05-08T02:43:29.279 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-05-08T02:43:29.388 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-05-08T02:43:29.514 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-05-08T02:43:29.566 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-05-08T02:43:29.650 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-05-08T02:43:29.710 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-05-08T02:43:29.738 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-05-08T02:43:29.780 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3229.g4184b4e6.el9 9/11 2024-05-08T02:43:30.819 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3229.g4184b4e6.el 10/11 2024-05-08T02:43:30.855 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3229.g4184b4e6.el9.noa 11/11 2024-05-08T02:43:32.037 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3229.g4184b4e6.el9.noa 11/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3229.g4184b4e6.el 1/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3229.g4184b4e6.el9.noa 2/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3229.g4184b4e6.el9 3/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-05-08T02:43:32.038 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-05-08T02:43:32.329 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-05-08T02:43:32.329 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:32.329 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:43:32.329 INFO:teuthology.orchestra.run.smithi080.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T02:43:32.329 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-grafana-dashboards-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:32.329 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-dashboard-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:32.329 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-prometheus-alerts-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:32.330 INFO:teuthology.orchestra.run.smithi080.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T02:43:32.330 INFO:teuthology.orchestra.run.smithi080.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T02:43:32.330 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T02:43:32.330 INFO:teuthology.orchestra.run.smithi080.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T02:43:32.330 INFO:teuthology.orchestra.run.smithi080.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T02:43:32.330 INFO:teuthology.orchestra.run.smithi080.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T02:43:32.330 INFO:teuthology.orchestra.run.smithi080.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T02:43:32.330 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:32.330 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:32.566 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T02:43:33.130 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:45 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:33.252 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:33.253 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 7.4 M 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T02:43:33.254 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T02:43:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T02:43:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T02:43:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T02:43:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:33.255 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:43:33.255 INFO:teuthology.orchestra.run.smithi080.stdout:======================================================================================= 2024-05-08T02:43:33.255 INFO:teuthology.orchestra.run.smithi080.stdout:Install 12 Packages 2024-05-08T02:43:33.255 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:33.256 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 38 M 2024-05-08T02:43:33.256 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 209 M 2024-05-08T02:43:33.256 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:43:34.351 INFO:teuthology.orchestra.run.smithi080.stdout:(1/12): ceph-mgr-diskprediction-local-19.0.0-32 11 MB/s | 7.4 MB 00:00 2024-05-08T02:43:34.551 INFO:teuthology.orchestra.run.smithi080.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 219 kB/s | 195 kB 00:00 2024-05-08T02:43:34.652 INFO:teuthology.orchestra.run.smithi080.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 810 kB/s | 803 kB 00:00 2024-05-08T02:43:34.943 INFO:teuthology.orchestra.run.smithi080.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-05-08T02:43:35.168 INFO:teuthology.orchestra.run.smithi080.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 35 kB/s | 18 kB 00:00 2024-05-08T02:43:35.552 INFO:teuthology.orchestra.run.smithi080.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 58 kB/s | 35 kB 00:00 2024-05-08T02:43:35.572 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.0.0-3229.g4184b4e6.el9.x86_64 33/36 2024-05-08T02:43:35.602 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.0.0-3229.g4184b4e6.el9.x86_64 33/36 2024-05-08T02:43:35.602 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:43:35.603 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T02:43:35.603 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T02:43:35.603 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T02:43:35.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:35.719 INFO:teuthology.orchestra.run.smithi080.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-05-08T02:43:36.165 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.0.0-3229.g4184b4e6.el9.x86_64 34/36 2024-05-08T02:43:36.190 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.0.0-3229.g4184b4e6.el9.x86_64 34/36 2024-05-08T02:43:36.190 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:43:36.191 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T02:43:36.191 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T02:43:36.191 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T02:43:36.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:36.369 INFO:teuthology.orchestra.run.smithi080.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 4.0 MB/s | 4.7 MB 00:01 2024-05-08T02:43:36.394 INFO:teuthology.orchestra.run.smithi080.stdout:(9/12): python3-devel-3.9.18-3.el9.x86_64.rpm 290 kB/s | 244 kB 00:00 2024-05-08T02:43:36.441 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.0.0-3229.g4184b4e6.el9.x86_64 35/36 2024-05-08T02:43:36.465 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.0.0-3229.g4184b4e6.el9.x86_64 35/36 2024-05-08T02:43:36.466 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:43:36.466 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T02:43:36.466 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T02:43:36.466 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T02:43:36.466 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:36.539 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.0.0-3229.g4184b4e6.el9.x86_64 36/36 2024-05-08T02:43:36.978 INFO:teuthology.orchestra.run.smithi080.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-05-08T02:43:37.228 INFO:teuthology.orchestra.run.smithi080.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 292 kB/s | 250 kB 00:00 2024-05-08T02:43:37.936 INFO:teuthology.orchestra.run.smithi080.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-05-08T02:43:37.937 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:37.938 INFO:teuthology.orchestra.run.smithi080.stdout:Total 8.1 MB/s | 38 MB 00:04 2024-05-08T02:43:38.289 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:43:38.316 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:43:38.316 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:43:38.754 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:43:38.754 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:43:39.523 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:43:39.579 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-08T02:43:39.626 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-08T02:43:39.735 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-08T02:43:39.778 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-08T02:43:39.955 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-08T02:43:39.985 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-08T02:43:40.070 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-08T02:43:40.733 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-08T02:43:40.866 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-08T02:43:42.106 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T02:43:43.073 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-2:19.0.0-3229.g4184b4e6.el9.x86_64 36/36 2024-05-08T02:43:43.073 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/36 2024-05-08T02:43:43.073 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/36 2024-05-08T02:43:43.073 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 3/36 2024-05-08T02:43:43.073 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.0.0-3229.g4184b4e6.el9.x86_64 4/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.0.0-3229.g4184b4e6.el9.x86_64 5/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3229.g4184b4e6.el9. 6/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-08T02:43:43.074 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-08T02:43:43.075 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-08T02:43:43.076 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-08T02:43:43.076 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-08T02:43:43.076 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-08T02:43:43.076 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-08T02:43:43.076 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-08T02:43:43.139 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-08T02:43:43.170 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3229.g4184b 12/12 2024-05-08T02:43:44.144 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-08T02:43:44.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:44.144 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:43:44.144 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:44.144 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:44.144 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T02:43:44.145 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T02:43:44.146 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T02:43:44.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T02:43:44.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T02:43:44.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T02:43:44.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T02:43:44.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T02:43:44.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T02:43:44.147 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T02:43:44.147 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:44.147 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:43:44.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-base 2024-05-08T02:43:45.064 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:56 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:43:45.149 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-base-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:43:45.194 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:43:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-08T02:43:45.195 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:43:45.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install cephadm 2024-05-08T02:43:45.855 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:56 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:43:45.981 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:43:45.982 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:43:45.982 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:43:45.982 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 762 k 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 762 k 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 769 k 2024-05-08T02:43:45.983 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:43:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3229.g4184b 12/12 2024-05-08T02:43:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3229.g4184b 1/12 2024-05-08T02:43:46.135 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-08T02:43:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-08T02:43:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-08T02:43:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-08T02:43:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-08T02:43:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-08T02:43:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-08T02:43:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-08T02:43:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T02:43:46.136 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-08T02:43:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-08T02:43:46.564 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:46.564 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:46.565 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm-19.0.0-3229.g4184b4e6.el9.noarch.rpm 865 kB/s | 762 kB 00:00 2024-05-08T02:43:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:46.865 INFO:teuthology.orchestra.run.smithi046.stdout:Total 864 kB/s | 762 kB 00:00 2024-05-08T02:43:46.866 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:43:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:43:46.872 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:43:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:43:46.878 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:43:46.945 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr-rook 2024-05-08T02:43:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:43:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/1 2024-05-08T02:43:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/1 2024-05-08T02:43:47.526 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:59 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:47.649 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:47.650 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:47.650 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:43:47.650 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:47.650 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:43:47.650 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 49 k 2024-05-08T02:43:47.650 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:43:47.650 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:43:47.651 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:47.652 INFO:teuthology.orchestra.run.smithi080.stdout:Install 13 Packages 2024-05-08T02:43:47.652 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:47.652 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 2.2 M 2024-05-08T02:43:47.652 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 26 M 2024-05-08T02:43:47.652 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:43:47.841 INFO:teuthology.orchestra.run.smithi080.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 246 kB/s | 19 kB 00:00 2024-05-08T02:43:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/1 2024-05-08T02:43:47.866 INFO:teuthology.orchestra.run.smithi080.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 248 kB/s | 26 kB 00:00 2024-05-08T02:43:47.933 INFO:teuthology.orchestra.run.smithi080.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-05-08T02:43:47.958 INFO:teuthology.orchestra.run.smithi080.stdout:(4/13): ceph-mgr-rook-19.0.0-3229.g4184b4e6.el9 252 kB/s | 49 kB 00:00 2024-05-08T02:43:47.984 INFO:teuthology.orchestra.run.smithi080.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-05-08T02:43:48.034 INFO:teuthology.orchestra.run.smithi080.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-05-08T02:43:48.051 INFO:teuthology.orchestra.run.smithi080.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 581 kB/s | 54 kB 00:00 2024-05-08T02:43:48.210 INFO:teuthology.orchestra.run.smithi080.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 143 kB/s | 32 kB 00:00 2024-05-08T02:43:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/1 2024-05-08T02:43:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:48.242 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:43:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:48.243 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:43:48.251 INFO:teuthology.orchestra.run.smithi080.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 69 kB/s | 15 kB 00:00 2024-05-08T02:43:48.410 INFO:teuthology.orchestra.run.smithi080.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 373 kB/s | 59 kB 00:00 2024-05-08T02:43:48.444 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T02:43:48.494 INFO:teuthology.orchestra.run.smithi080.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 464 kB/s | 206 kB 00:00 2024-05-08T02:43:48.569 INFO:teuthology.orchestra.run.smithi080.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 565 kB/s | 90 kB 00:00 2024-05-08T02:43:48.603 INFO:teuthology.orchestra.run.smithi080.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.6 MB/s | 1.0 MB 00:00 2024-05-08T02:43:48.603 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:48.604 INFO:teuthology.orchestra.run.smithi080.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-05-08T02:43:48.671 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:43:48.686 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:43:48.687 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:43:48.771 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:43:48.773 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:43:49.036 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:00 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:43:49.164 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:43:49.164 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-05-08T02:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 158 k 2024-05-08T02:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-08T02:43:49.165 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:49.166 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 158 k 2024-05-08T02:43:49.166 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 640 k 2024-05-08T02:43:49.166 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:43:49.270 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:43:49.445 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-08T02:43:49.496 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-08T02:43:49.552 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-08T02:43:49.553 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-immutable-object-cache-19.0.0-3229.g4184b4 407 kB/s | 158 kB 00:00 2024-05-08T02:43:49.554 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:49.554 INFO:teuthology.orchestra.run.smithi046.stdout:Total 405 kB/s | 158 kB 00:00 2024-05-08T02:43:49.554 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:43:49.565 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:43:49.566 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:43:49.589 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-08T02:43:49.626 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:43:49.626 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:43:49.631 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-08T02:43:49.724 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-08T02:43:49.782 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:43:49.834 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-08T02:43:49.846 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3229.g4184b4e6. 1/1 2024-05-08T02:43:49.872 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3229.g4184b4e6. 1/1 2024-05-08T02:43:49.873 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:43:49.873 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T02:43:49.873 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:49.891 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-08T02:43:50.609 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-08T02:43:50.656 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-08T02:43:50.689 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-08T02:43:50.737 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-08T02:43:50.759 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-rook-2:19.0.0-3229.g4184b4e6.el9.noarch 13/13 2024-05-08T02:43:50.963 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3229.g4184b4e6. 1/1 2024-05-08T02:43:50.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:50.963 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:43:50.963 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:43:50.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:50.963 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:43:51.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3229.g4184b4e6.el9.noarch 13/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3229.g4184b4e6.el9.noarch 1/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-08T02:43:51.678 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-08T02:43:51.679 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-08T02:43:51.679 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-08T02:43:51.786 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:02 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:43:51.870 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-mgr-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:43:51.914 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:43:51.915 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-08T02:43:51.915 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:43:51.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T02:43:51.991 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-08T02:43:51.991 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:51.991 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:43:51.991 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-rook-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:51.991 INFO:teuthology.orchestra.run.smithi080.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T02:43:51.991 INFO:teuthology.orchestra.run.smithi080.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T02:43:51.991 INFO:teuthology.orchestra.run.smithi080.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T02:43:51.991 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T02:43:51.991 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T02:43:51.992 INFO:teuthology.orchestra.run.smithi080.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T02:43:51.992 INFO:teuthology.orchestra.run.smithi080.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T02:43:51.992 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T02:43:51.992 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T02:43:51.992 INFO:teuthology.orchestra.run.smithi080.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T02:43:51.992 INFO:teuthology.orchestra.run.smithi080.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T02:43:51.992 INFO:teuthology.orchestra.run.smithi080.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T02:43:51.992 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:51.992 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:52.248 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T02:43:52.569 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:03 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:43:52.698 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:43:52.699 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:43:52.699 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:43:52.699 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:43:52.699 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:43:52.699 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 3.5 M 2024-05-08T02:43:52.699 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:43:52.699 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T02:43:52.699 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 34 k 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 16 k 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout:Install 11 Packages 2024-05-08T02:43:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:43:52.701 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 7.6 M 2024-05-08T02:43:52.701 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 100 M 2024-05-08T02:43:52.701 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:43:52.817 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:04 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:52.940 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:52.941 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:43:52.941 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:52.941 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:43:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 142 k 2024-05-08T02:43:52.941 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:43:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T02:43:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T02:43:52.941 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T02:43:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T02:43:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T02:43:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:52.942 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:43:52.942 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:52.942 INFO:teuthology.orchestra.run.smithi080.stdout:Install 6 Packages 2024-05-08T02:43:52.942 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:52.943 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 7.0 M 2024-05-08T02:43:52.943 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 33 M 2024-05-08T02:43:52.943 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:43:53.233 INFO:teuthology.orchestra.run.smithi080.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 2.5 MB/s | 248 kB 00:00 2024-05-08T02:43:53.350 INFO:teuthology.orchestra.run.smithi080.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3229.g4184b4e6.e 661 kB/s | 142 kB 00:00 2024-05-08T02:43:53.459 INFO:teuthology.orchestra.run.smithi080.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-05-08T02:43:53.475 INFO:teuthology.orchestra.run.smithi080.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 460 kB/s | 58 kB 00:00 2024-05-08T02:43:53.500 INFO:teuthology.orchestra.run.smithi080.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.0 MB/s | 548 kB 00:00 2024-05-08T02:43:53.592 INFO:teuthology.orchestra.run.smithi080.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 382 kB/s | 51 kB 00:00 2024-05-08T02:43:53.593 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:53.593 INFO:teuthology.orchestra.run.smithi080.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-05-08T02:43:53.665 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:43:53.676 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:43:53.676 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:43:53.773 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:43:53.774 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:43:53.832 INFO:teuthology.orchestra.run.smithi046.stdout:(1/11): ceph-grafana-dashboards-19.0.0-3229.g41 171 kB/s | 34 kB 00:00 2024-05-08T02:43:53.849 INFO:teuthology.orchestra.run.smithi046.stdout:(2/11): ceph-prometheus-alerts-19.0.0-3229.g418 76 kB/s | 16 kB 00:00 2024-05-08T02:43:53.957 INFO:teuthology.orchestra.run.smithi046.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 7.8 MB/s | 863 kB 00:00 2024-05-08T02:43:54.049 INFO:teuthology.orchestra.run.smithi046.stdout:(4/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-05-08T02:43:54.072 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:43:54.233 INFO:teuthology.orchestra.run.smithi046.stdout:(5/11): ceph-mgr-dashboard-19.0.0-3229.g4184b4e 5.9 MB/s | 3.5 MB 00:00 2024-05-08T02:43:54.240 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-08T02:43:54.294 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-08T02:43:54.525 INFO:teuthology.orchestra.run.smithi046.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 43 kB/s | 19 kB 00:00 2024-05-08T02:43:54.808 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-08T02:43:54.875 INFO:teuthology.orchestra.run.smithi046.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 413 kB/s | 144 kB 00:00 2024-05-08T02:43:54.889 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-08T02:43:54.952 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-08T02:43:54.967 INFO:teuthology.orchestra.run.smithi046.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 335 kB/s | 31 kB 00:00 2024-05-08T02:43:54.982 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 6/6 2024-05-08T02:43:55.242 INFO:teuthology.orchestra.run.smithi046.stdout:(9/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 427 kB/s | 548 kB 00:01 2024-05-08T02:43:55.309 INFO:teuthology.orchestra.run.smithi046.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 552 kB/s | 188 kB 00:00 2024-05-08T02:43:55.874 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 6/6 2024-05-08T02:43:55.874 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/6 2024-05-08T02:43:55.875 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-08T02:43:55.875 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-08T02:43:55.875 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-08T02:43:55.875 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-08T02:43:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-08T02:43:56.140 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:56.140 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:43:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-mgr-cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:43:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T02:43:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T02:43:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T02:43:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T02:43:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T02:43:56.141 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:56.141 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:56.397 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-fuse 2024-05-08T02:43:56.962 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:08 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:57.084 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 870 k 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:43:57.085 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:57.086 INFO:teuthology.orchestra.run.smithi080.stdout:Install 2 Packages 2024-05-08T02:43:57.086 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:57.086 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 951 k 2024-05-08T02:43:57.086 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 4.0 M 2024-05-08T02:43:57.086 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:43:57.092 INFO:teuthology.orchestra.run.smithi046.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 730 kB/s | 2.0 MB 00:02 2024-05-08T02:43:57.098 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:57.098 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.7 MB/s | 7.6 MB 00:04 2024-05-08T02:43:57.133 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:43:57.154 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:43:57.154 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:43:57.204 INFO:teuthology.orchestra.run.smithi080.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 989 kB/s | 80 kB 00:00 2024-05-08T02:43:57.336 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:43:57.337 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:43:57.587 INFO:teuthology.orchestra.run.smithi080.stdout:(2/2): ceph-fuse-19.0.0-3229.g4184b4e6.el9.x86_ 1.8 MB/s | 870 kB 00:00 2024-05-08T02:43:57.588 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:43:57.588 INFO:teuthology.orchestra.run.smithi080.stdout:Total 1.8 MB/s | 951 kB 00:00 2024-05-08T02:43:57.600 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:43:57.624 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:43:57.624 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:43:57.701 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:43:57.701 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:43:57.879 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:43:57.900 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:43:57.968 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-05-08T02:43:57.996 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-05-08T02:43:58.031 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-08T02:43:58.099 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-05-08T02:43:58.103 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/2 2024-05-08T02:43:58.240 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-05-08T02:43:58.285 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-05-08T02:43:58.374 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-05-08T02:43:58.421 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-05-08T02:43:58.448 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-05-08T02:43:58.481 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3229.g4184b4e6.el9 9/11 2024-05-08T02:43:58.764 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/2 2024-05-08T02:43:58.764 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/2 2024-05-08T02:43:59.032 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-08T02:43:59.033 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:59.033 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:43:59.033 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-08T02:43:59.033 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:59.033 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:43:59.283 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install ceph-volume 2024-05-08T02:43:59.589 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3229.g4184b4e6.el 10/11 2024-05-08T02:43:59.622 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3229.g4184b4e6.el9.noa 11/11 2024-05-08T02:43:59.865 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:11 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:43:59.990 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:43:59.991 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repository Size 2024-05-08T02:43:59.991 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:59.991 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:43:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 273 k 2024-05-08T02:43:59.991 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-05-08T02:43:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T02:43:59.991 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:59.991 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:43:59.992 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:43:59.992 INFO:teuthology.orchestra.run.smithi080.stdout:Install 2 Packages 2024-05-08T02:43:59.992 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:43:59.992 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 350 k 2024-05-08T02:43:59.992 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 1.5 M 2024-05-08T02:43:59.992 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:44:00.228 INFO:teuthology.orchestra.run.smithi080.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 665 kB/s | 77 kB 00:00 2024-05-08T02:44:00.362 INFO:teuthology.orchestra.run.smithi080.stdout:(2/2): ceph-volume-19.0.0-3229.g4184b4e6.el9.no 1.1 MB/s | 273 kB 00:00 2024-05-08T02:44:00.362 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:00.362 INFO:teuthology.orchestra.run.smithi080.stdout:Total 945 kB/s | 350 kB 00:00 2024-05-08T02:44:00.375 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:44:00.385 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:44:00.385 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:44:00.416 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:44:00.416 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:44:00.562 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:44:00.734 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-08T02:44:00.773 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : ceph-volume-2:19.0.0-3229.g4184b4e6.el9.noarch 2/2 2024-05-08T02:44:00.789 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: ceph-volume-2:19.0.0-3229.g4184b4e6.el9.noarch 2/2 2024-05-08T02:44:00.789 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:44:00.789 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T02:44:00.790 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3229.g4184b4e6.el9.noa 11/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3229.g4184b4e6.el 1/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3229.g4184b4e6.el9.noa 2/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3229.g4184b4e6.el9 3/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-05-08T02:44:00.852 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-05-08T02:44:01.150 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-05-08T02:44:01.150 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:01.151 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:01.347 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T02:44:01.490 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : ceph-volume-2:19.0.0-3229.g4184b4e6.el9.noarch 1/2 2024-05-08T02:44:01.781 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-08T02:44:01.781 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:01.781 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:44:01.781 INFO:teuthology.orchestra.run.smithi080.stdout: ceph-volume-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:44:01.781 INFO:teuthology.orchestra.run.smithi080.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T02:44:01.781 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:01.781 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:12 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:02.066 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:02.067 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-05-08T02:44:02.067 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:44:02.067 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 7.4 M 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T02:44:02.068 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T02:44:02.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T02:44:02.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T02:44:02.069 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T02:44:02.069 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:02.069 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:02.069 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-05-08T02:44:02.069 INFO:teuthology.orchestra.run.smithi046.stdout:Install 12 Packages 2024-05-08T02:44:02.069 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:02.070 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 38 M 2024-05-08T02:44:02.070 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 209 M 2024-05-08T02:44:02.070 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:02.079 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install librados-devel 2024-05-08T02:44:02.656 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:14 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:02.780 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:02.780 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:02.780 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repo Size 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 125 k 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 125 k 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 445 k 2024-05-08T02:44:02.781 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:44:02.985 INFO:teuthology.orchestra.run.smithi046.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 322 kB/s | 195 kB 00:00 2024-05-08T02:44:03.177 INFO:teuthology.orchestra.run.smithi046.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-05-08T02:44:03.283 INFO:teuthology.orchestra.run.smithi080.stdout:librados-devel-19.0.0-3229.g4184b4e6.el9.x86_64 249 kB/s | 125 kB 00:00 2024-05-08T02:44:03.284 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:03.284 INFO:teuthology.orchestra.run.smithi080.stdout:Total 248 kB/s | 125 kB 00:00 2024-05-08T02:44:03.284 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:44:03.289 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:44:03.290 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:44:03.352 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:44:03.352 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:44:03.524 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:44:03.577 INFO:teuthology.orchestra.run.smithi046.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-05-08T02:44:03.639 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : librados-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:04.089 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: librados-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:04.110 INFO:teuthology.orchestra.run.smithi046.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 34 kB/s | 18 kB 00:00 2024-05-08T02:44:04.294 INFO:teuthology.orchestra.run.smithi046.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.7 MB/s | 3.0 MB 00:01 2024-05-08T02:44:04.338 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : librados-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:04.339 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:04.339 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:44:04.339 INFO:teuthology.orchestra.run.smithi080.stdout: librados-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:04.339 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:04.339 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:04.638 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install libcephfs2 2024-05-08T02:44:04.728 INFO:teuthology.orchestra.run.smithi046.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-32 3.2 MB/s | 7.4 MB 00:02 2024-05-08T02:44:04.770 INFO:teuthology.orchestra.run.smithi046.stdout:(7/12): openblas-0.3.21-2.el9.x86_64.rpm 53 kB/s | 35 kB 00:00 2024-05-08T02:44:05.214 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:17 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:05.295 INFO:teuthology.orchestra.run.smithi080.stdout:Package libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:05.340 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:05.341 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T02:44:05.341 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:05.411 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install libcephfs-devel 2024-05-08T02:44:05.562 INFO:teuthology.orchestra.run.smithi046.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 293 kB/s | 244 kB 00:00 2024-05-08T02:44:05.637 INFO:teuthology.orchestra.run.smithi046.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 3.5 MB/s | 4.7 MB 00:01 2024-05-08T02:44:05.977 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:17 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:06.020 INFO:teuthology.orchestra.run.smithi046.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-05-08T02:44:06.098 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repo Size 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 32 k 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 32 k 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 142 k 2024-05-08T02:44:06.099 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:44:06.437 INFO:teuthology.orchestra.run.smithi046.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 286 kB/s | 250 kB 00:00 2024-05-08T02:44:06.454 INFO:teuthology.orchestra.run.smithi080.stdout:libcephfs-devel-19.0.0-3229.g4184b4e6.el9.x86_6 89 kB/s | 32 kB 00:00 2024-05-08T02:44:06.454 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:06.455 INFO:teuthology.orchestra.run.smithi080.stdout:Total 89 kB/s | 32 kB 00:00 2024-05-08T02:44:06.455 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:44:06.458 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:44:06.458 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:44:06.479 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:44:06.479 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:44:06.555 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:44:06.659 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : libcephfs-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:07.038 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:07.196 INFO:teuthology.orchestra.run.smithi046.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-08T02:44:07.197 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:07.197 INFO:teuthology.orchestra.run.smithi046.stdout:Total 7.4 MB/s | 38 MB 00:05 2024-05-08T02:44:07.270 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libcephfs-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:07.270 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:07.270 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:44:07.270 INFO:teuthology.orchestra.run.smithi080.stdout: libcephfs-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:07.270 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:07.270 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:07.453 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install librados2 2024-05-08T02:44:07.565 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:07.593 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:07.594 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:08.018 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:20 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:08.046 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:08.046 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:08.099 INFO:teuthology.orchestra.run.smithi080.stdout:Package librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:08.141 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:08.142 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T02:44:08.142 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:08.220 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install librbd1 2024-05-08T02:44:08.788 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:20 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:08.824 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:08.869 INFO:teuthology.orchestra.run.smithi080.stdout:Package librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:08.903 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-08T02:44:08.910 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:08.911 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T02:44:08.911 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:08.945 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-08T02:44:08.985 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install python3-rados 2024-05-08T02:44:09.058 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-08T02:44:09.104 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-08T02:44:09.289 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-08T02:44:09.327 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-08T02:44:09.407 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-08T02:44:09.554 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:21 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:09.635 INFO:teuthology.orchestra.run.smithi080.stdout:Package python3-rados-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:09.676 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:09.677 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T02:44:09.677 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:09.755 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install python3-rgw 2024-05-08T02:44:10.101 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-08T02:44:10.220 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-08T02:44:10.319 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:22 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:10.400 INFO:teuthology.orchestra.run.smithi080.stdout:Package python3-rgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:10.441 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:10.442 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T02:44:10.443 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:10.511 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install python3-cephfs 2024-05-08T02:44:11.074 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:23 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:11.156 INFO:teuthology.orchestra.run.smithi080.stdout:Package python3-cephfs-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:11.198 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:11.199 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T02:44:11.199 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:11.279 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install python3-rbd 2024-05-08T02:44:11.593 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T02:44:11.847 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:23 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:11.928 INFO:teuthology.orchestra.run.smithi080.stdout:Package python3-rbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:11.970 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:11.971 INFO:teuthology.orchestra.run.smithi080.stdout:Nothing to do. 2024-05-08T02:44:11.971 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:12.042 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install rbd-fuse 2024-05-08T02:44:12.616 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:24 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:12.670 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-08T02:44:12.693 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3229.g4184b 12/12 2024-05-08T02:44:12.737 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:12.737 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:12.737 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 90 k 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 90 k 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 313 k 2024-05-08T02:44:12.738 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:44:13.081 INFO:teuthology.orchestra.run.smithi080.stdout:rbd-fuse-19.0.0-3229.g4184b4e6.el9.x86_64.rpm 261 kB/s | 90 kB 00:00 2024-05-08T02:44:13.082 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:13.082 INFO:teuthology.orchestra.run.smithi080.stdout:Total 260 kB/s | 90 kB 00:00 2024-05-08T02:44:13.082 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:44:13.092 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:44:13.092 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:44:13.154 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:44:13.154 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:44:13.308 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:44:13.404 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:13.743 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:14.006 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:14.006 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:14.007 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:44:14.007 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:14.007 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:14.007 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:14.242 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install rbd-mirror 2024-05-08T02:44:14.840 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:26 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:14.971 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:14.972 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:14.972 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repo Size 2024-05-08T02:44:14.972 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:14.972 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:44:14.972 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 3.4 M 2024-05-08T02:44:14.972 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:14.972 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:44:14.972 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:14.973 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-05-08T02:44:14.973 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:14.973 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 3.4 M 2024-05-08T02:44:14.973 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 29 M 2024-05-08T02:44:14.973 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:44:15.524 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3229.g4184b 12/12 2024-05-08T02:44:15.524 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3229.g4184b 1/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T02:44:15.525 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-08T02:44:15.793 INFO:teuthology.orchestra.run.smithi080.stdout:rbd-mirror-19.0.0-3229.g4184b4e6.el9.x86_64.rpm 4.1 MB/s | 3.4 MB 00:00 2024-05-08T02:44:15.794 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:15.794 INFO:teuthology.orchestra.run.smithi080.stdout:Total 4.1 MB/s | 3.4 MB 00:00 2024-05-08T02:44:15.795 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:44:15.806 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:44:15.806 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:44:15.889 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:44:15.889 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:44:15.908 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-08T02:44:15.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T02:44:15.909 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:15.910 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:16.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-rook 2024-05-08T02:44:16.477 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:44:16.536 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-mirror-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:16.562 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:16.562 INFO:teuthology.orchestra.run.smithi080.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:44:16.562 INFO:teuthology.orchestra.run.smithi080.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T02:44:16.562 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T02:44:16.562 INFO:teuthology.orchestra.run.smithi080.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T02:44:16.562 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:16.856 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:27 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:16.985 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 49 k 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T02:44:16.987 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout:Install 13 Packages 2024-05-08T02:44:16.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:16.989 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.2 M 2024-05-08T02:44:16.989 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 26 M 2024-05-08T02:44:16.989 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:17.327 INFO:teuthology.orchestra.run.smithi046.stdout:(1/13): ceph-mgr-rook-19.0.0-3229.g4184b4e6.el9 266 kB/s | 49 kB 00:00 2024-05-08T02:44:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 36 kB/s | 19 kB 00:00 2024-05-08T02:44:17.735 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-mirror-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:17.735 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:17.735 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:44:17.736 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-mirror-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:17.736 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:17.736 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:17.777 INFO:teuthology.orchestra.run.smithi046.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 40 kB/s | 26 kB 00:00 2024-05-08T02:44:17.997 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum -y install rbd-nbd 2024-05-08T02:44:18.136 INFO:teuthology.orchestra.run.smithi046.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 275 kB/s | 222 kB 00:00 2024-05-08T02:44:18.428 INFO:teuthology.orchestra.run.smithi046.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 209 kB/s | 159 kB 00:00 2024-05-08T02:44:18.495 INFO:teuthology.orchestra.run.smithi046.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 484 kB/s | 32 kB 00:00 2024-05-08T02:44:18.528 INFO:teuthology.orchestra.run.smithi046.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 451 kB/s | 15 kB 00:00 2024-05-08T02:44:18.580 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:02:30 ago on Wed 08 May 2024 02:41:48 AM UTC. 2024-05-08T02:44:18.603 INFO:teuthology.orchestra.run.smithi046.stdout:(8/13): python3-google-auth-2.29.0-1.el9.noarch 2.7 MB/s | 206 kB 00:00 2024-05-08T02:44:18.654 INFO:teuthology.orchestra.run.smithi046.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 318 kB/s | 279 kB 00:00 2024-05-08T02:44:18.687 INFO:teuthology.orchestra.run.smithi046.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 12 MB/s | 1.0 MB 00:00 2024-05-08T02:44:18.701 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-05-08T02:44:18.701 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 176 k 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout:Install 1 Package 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 176 k 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 673 k 2024-05-08T02:44:18.702 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-05-08T02:44:18.721 INFO:teuthology.orchestra.run.smithi046.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-05-08T02:44:18.754 INFO:teuthology.orchestra.run.smithi046.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 592 kB/s | 59 kB 00:00 2024-05-08T02:44:18.804 INFO:teuthology.orchestra.run.smithi046.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 80 kB/s | 54 kB 00:00 2024-05-08T02:44:18.806 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:18.806 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-05-08T02:44:18.881 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:18.898 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:18.898 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:18.993 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:18.994 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:19.147 INFO:teuthology.orchestra.run.smithi080.stdout:rbd-nbd-19.0.0-3229.g4184b4e6.el9.x86_64.rpm 395 kB/s | 176 kB 00:00 2024-05-08T02:44:19.148 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:19.148 INFO:teuthology.orchestra.run.smithi080.stdout:Total 394 kB/s | 176 kB 00:00 2024-05-08T02:44:19.148 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-05-08T02:44:19.157 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-05-08T02:44:19.157 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-05-08T02:44:19.221 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-05-08T02:44:19.221 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-05-08T02:44:19.376 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-05-08T02:44:19.485 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : rbd-nbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:19.557 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:19.738 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-08T02:44:19.810 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-08T02:44:19.872 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-08T02:44:19.905 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:19.916 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-08T02:44:19.958 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-08T02:44:20.058 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-08T02:44:20.167 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-08T02:44:20.170 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : rbd-nbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:20.170 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:20.170 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-05-08T02:44:20.170 INFO:teuthology.orchestra.run.smithi080.stdout: rbd-nbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:20.170 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:20.170 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-05-08T02:44:20.226 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-08T02:44:20.434 DEBUG:teuthology.parallel:result is None 2024-05-08T02:44:20.993 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-08T02:44:21.048 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-08T02:44:21.081 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-08T02:44:21.131 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-08T02:44:21.159 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.0.0-3229.g4184b4e6.el9.noarch 13/13 2024-05-08T02:44:22.076 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3229.g4184b4e6.el9.noarch 13/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3229.g4184b4e6.el9.noarch 1/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-08T02:44:22.077 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-08T02:44:22.389 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T02:44:22.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T02:44:22.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T02:44:22.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:22.391 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:22.662 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T02:44:23.257 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:34 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:23.385 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:23.385 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:23.385 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 142 k 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:23.386 INFO:teuthology.orchestra.run.smithi046.stdout:Install 6 Packages 2024-05-08T02:44:23.387 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:23.387 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 7.0 M 2024-05-08T02:44:23.387 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 33 M 2024-05-08T02:44:23.387 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:24.023 INFO:teuthology.orchestra.run.smithi046.stdout:(1/6): ceph-mgr-cephadm-19.0.0-3229.g4184b4e6.e 390 kB/s | 142 kB 00:00 2024-05-08T02:44:24.282 INFO:teuthology.orchestra.run.smithi046.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.1 MB/s | 548 kB 00:00 2024-05-08T02:44:24.324 INFO:teuthology.orchestra.run.smithi046.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2024-05-08T02:44:24.365 INFO:teuthology.orchestra.run.smithi046.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 1.2 MB/s | 51 kB 00:00 2024-05-08T02:44:24.541 INFO:teuthology.orchestra.run.smithi046.stdout:(5/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 281 kB/s | 248 kB 00:00 2024-05-08T02:44:24.949 INFO:teuthology.orchestra.run.smithi046.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-05-08T02:44:24.951 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:24.951 INFO:teuthology.orchestra.run.smithi046.stdout:Total 4.5 MB/s | 7.0 MB 00:01 2024-05-08T02:44:25.026 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:25.039 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:25.039 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:25.143 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:25.143 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:25.463 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:25.630 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-08T02:44:25.694 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-08T02:44:26.247 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-08T02:44:26.340 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-08T02:44:26.411 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-08T02:44:26.446 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 6/6 2024-05-08T02:44:27.464 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 6/6 2024-05-08T02:44:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 1/6 2024-05-08T02:44:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-08T02:44:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-08T02:44:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-08T02:44:27.465 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:27.730 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:27.939 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-fuse 2024-05-08T02:44:28.531 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:39 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:28.658 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:28.658 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:28.658 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:44:28.658 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:28.658 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:28.659 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 870 k 2024-05-08T02:44:28.659 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:44:28.659 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T02:44:28.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:28.659 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:28.659 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:28.659 INFO:teuthology.orchestra.run.smithi046.stdout:Install 2 Packages 2024-05-08T02:44:28.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:28.660 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 951 k 2024-05-08T02:44:28.660 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 4.0 M 2024-05-08T02:44:28.660 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:29.234 INFO:teuthology.orchestra.run.smithi046.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 185 kB/s | 80 kB 00:00 2024-05-08T02:44:29.352 INFO:teuthology.orchestra.run.smithi046.stdout:(2/2): ceph-fuse-19.0.0-3229.g4184b4e6.el9.x86_ 1.5 MB/s | 870 kB 00:00 2024-05-08T02:44:29.352 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:29.352 INFO:teuthology.orchestra.run.smithi046.stdout:Total 1.3 MB/s | 951 kB 00:00 2024-05-08T02:44:29.364 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:29.390 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:29.390 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:29.473 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:29.474 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:29.673 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:29.825 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-08T02:44:29.903 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/2 2024-05-08T02:44:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 2/2 2024-05-08T02:44:30.620 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/2 2024-05-08T02:44:30.922 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-08T02:44:30.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:30.922 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:30.922 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-08T02:44:30.922 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:30.922 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:31.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-volume 2024-05-08T02:44:31.802 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:42 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:31.927 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.0.0-3229.g4184b4e6.el9 ceph-noarch 273 k 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:31.929 INFO:teuthology.orchestra.run.smithi046.stdout:Install 2 Packages 2024-05-08T02:44:31.930 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:31.930 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 350 k 2024-05-08T02:44:31.930 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 1.5 M 2024-05-08T02:44:31.930 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:32.182 INFO:teuthology.orchestra.run.smithi046.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 705 kB/s | 77 kB 00:00 2024-05-08T02:44:33.582 INFO:teuthology.orchestra.run.smithi046.stdout:(2/2): ceph-volume-19.0.0-3229.g4184b4e6.el9.no 181 kB/s | 273 kB 00:01 2024-05-08T02:44:33.582 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:33.583 INFO:teuthology.orchestra.run.smithi046.stdout:Total 212 kB/s | 350 kB 00:01 2024-05-08T02:44:33.598 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:33.610 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:33.610 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:33.652 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:33.653 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:33.810 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:34.006 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-08T02:44:34.042 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.0.0-3229.g4184b4e6.el9.noarch 2/2 2024-05-08T02:44:34.060 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.0.0-3229.g4184b4e6.el9.noarch 2/2 2024-05-08T02:44:34.060 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:44:34.061 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T02:44:34.061 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:34.791 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.0.0-3229.g4184b4e6.el9.noarch 1/2 2024-05-08T02:44:35.079 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-08T02:44:35.079 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:35.079 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:35.079 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.0.0-3229.g4184b4e6.el9.noarch 2024-05-08T02:44:35.079 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T02:44:35.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:35.080 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:35.409 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados-devel 2024-05-08T02:44:36.006 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:47 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:36.134 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:36.135 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:36.135 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-05-08T02:44:36.135 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 125 k 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 125 k 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 445 k 2024-05-08T02:44:36.136 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:36.358 INFO:teuthology.orchestra.run.smithi046.stdout:librados-devel-19.0.0-3229.g4184b4e6.el9.x86_64 563 kB/s | 125 kB 00:00 2024-05-08T02:44:36.359 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:36.359 INFO:teuthology.orchestra.run.smithi046.stdout:Total 559 kB/s | 125 kB 00:00 2024-05-08T02:44:36.359 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:36.366 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:36.366 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:36.432 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:36.432 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:36.597 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:36.693 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:37.101 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:37.342 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:37.342 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:37.342 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:37.342 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:37.342 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:37.342 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:37.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs2 2024-05-08T02:44:38.218 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:49 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:38.303 INFO:teuthology.orchestra.run.smithi046.stdout:Package libcephfs2-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-08T02:44:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:38.422 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs-devel 2024-05-08T02:44:39.018 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:50 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:39.143 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:39.143 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 32 k 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 32 k 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 142 k 2024-05-08T02:44:39.144 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:39.320 INFO:teuthology.orchestra.run.smithi046.stdout:libcephfs-devel-19.0.0-3229.g4184b4e6.el9.x86_6 181 kB/s | 32 kB 00:00 2024-05-08T02:44:39.321 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:39.321 INFO:teuthology.orchestra.run.smithi046.stdout:Total 179 kB/s | 32 kB 00:00 2024-05-08T02:44:39.321 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:39.325 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:39.325 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:39.342 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:39.342 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:39.423 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:39.538 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:39.936 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:40.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:40.169 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:40.169 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:40.169 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:40.169 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:40.169 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:40.356 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados2 2024-05-08T02:44:40.950 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:51 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:41.033 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:41.077 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:41.078 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-08T02:44:41.079 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:41.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librbd1 2024-05-08T02:44:41.737 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:52 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:41.819 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:41.863 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:41.864 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-08T02:44:41.864 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:41.938 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rados 2024-05-08T02:44:42.530 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:53 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:42.613 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rados-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:42.657 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:42.658 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-08T02:44:42.658 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:42.733 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rgw 2024-05-08T02:44:43.331 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:54 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:43.416 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rgw-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:43.460 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:43.461 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-08T02:44:43.461 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:43.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-cephfs 2024-05-08T02:44:44.132 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:55 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:44.217 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-cephfs-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:44.262 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:44.263 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-08T02:44:44.264 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:44.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rbd 2024-05-08T02:44:44.932 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:55 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:45.015 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 is already installed. 2024-05-08T02:44:45.059 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:45.060 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-05-08T02:44:45.060 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:45.131 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-fuse 2024-05-08T02:44:45.724 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:02:56 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:45.852 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 90 k 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:45.853 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 90 k 2024-05-08T02:44:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 313 k 2024-05-08T02:44:45.854 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:47.324 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-fuse-19.0.0-3229.g4184b4e6.el9.x86_64.rpm 61 kB/s | 90 kB 00:01 2024-05-08T02:44:47.324 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:47.325 INFO:teuthology.orchestra.run.smithi046.stdout:Total 61 kB/s | 90 kB 00:01 2024-05-08T02:44:47.325 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:47.337 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:47.337 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:47.409 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:47.409 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:48.294 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:48.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:48.294 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:48.294 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:48.294 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:48.294 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:48.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-mirror 2024-05-08T02:44:49.175 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:03:00 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:49.306 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:49.306 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 3.4 M 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 3.4 M 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 29 M 2024-05-08T02:44:49.307 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:49.810 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-mirror-19.0.0-3229.g4184b4e6.el9.x86_64.rpm 6.8 MB/s | 3.4 MB 00:00 2024-05-08T02:44:49.811 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:49.811 INFO:teuthology.orchestra.run.smithi046.stdout:Total 6.7 MB/s | 3.4 MB 00:00 2024-05-08T02:44:49.811 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:49.824 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:49.824 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:49.912 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:49.912 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:50.509 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:50.561 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:50.588 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:50.588 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T02:44:50.588 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T02:44:50.588 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T02:44:50.589 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T02:44:50.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:51.719 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:51.719 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:51.719 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:51.719 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:51.719 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:51.719 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:51.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-nbd 2024-05-08T02:44:52.571 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:03:03 ago on Wed 08 May 2024 02:41:49 AM UTC. 2024-05-08T02:44:52.699 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-05-08T02:44:52.700 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-05-08T02:44:52.700 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:52.700 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-05-08T02:44:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.0.0-3229.g4184b4e6.el9 ceph 176 k 2024-05-08T02:44:52.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:52.700 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-05-08T02:44:52.700 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-05-08T02:44:52.701 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-05-08T02:44:52.701 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:52.701 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 176 k 2024-05-08T02:44:52.701 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 673 k 2024-05-08T02:44:52.701 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-05-08T02:44:53.039 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-nbd-19.0.0-3229.g4184b4e6.el9.x86_64.rpm 519 kB/s | 176 kB 00:00 2024-05-08T02:44:53.040 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-05-08T02:44:53.040 INFO:teuthology.orchestra.run.smithi046.stdout:Total 517 kB/s | 176 kB 00:00 2024-05-08T02:44:53.040 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-05-08T02:44:53.051 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-05-08T02:44:53.051 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-05-08T02:44:53.118 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-05-08T02:44:53.118 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-05-08T02:44:53.276 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-05-08T02:44:53.382 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:53.813 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:54.048 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 1/1 2024-05-08T02:44:54.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:54.048 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-05-08T02:44:54.048 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.0.0-3229.g4184b4e6.el9.x86_64 2024-05-08T02:44:54.048 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:54.048 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-05-08T02:44:54.336 DEBUG:teuthology.parallel:result is None 2024-05-08T02:44:54.337 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4184b4e61afa6555ed712d5225eb247792c31f69 2024-05-08T02:44:54.574 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T02:44:54.597 INFO:teuthology.orchestra.run.smithi046.stdout:19.0.0-3229.g4184b4e6.el9 2024-05-08T02:44:54.598 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3229.g4184b4e6.el9 2024-05-08T02:44:54.598 INFO:teuthology.task.install:The correct ceph version 19.0.0-3229.g4184b4e6 is installed. 2024-05-08T02:44:54.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4184b4e61afa6555ed712d5225eb247792c31f69 2024-05-08T02:44:54.752 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T02:44:54.777 INFO:teuthology.orchestra.run.smithi080.stdout:19.0.0-3229.g4184b4e6.el9 2024-05-08T02:44:54.777 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3229.g4184b4e6.el9 2024-05-08T02:44:54.777 INFO:teuthology.task.install:The correct ceph version 19.0.0-3229.g4184b4e6 is installed. 2024-05-08T02:44:54.781 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T02:44:54.782 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:54.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T02:44:54.810 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:44:54.810 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T02:44:54.847 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T02:44:54.847 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:54.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T02:44:54.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T02:44:54.944 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:44:54.944 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T02:44:54.972 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T02:44:55.037 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T02:44:55.038 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:55.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T02:44:55.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T02:44:55.154 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:44:55.154 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T02:44:55.180 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T02:44:55.245 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T02:44:55.245 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:55.245 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T02:44:55.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T02:44:55.337 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:44:55.337 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T02:44:55.363 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T02:44:55.430 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T02:44:55.515 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T02:44:55.515 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-05-08T02:44:55.518 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /var/log/ceph 2024-05-08T02:44:55.542 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T02:44:55.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T02:44:55.583 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T02:44:55.608 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T02:44:55.608 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T02:44:55.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T02:44:55.686 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T02:44:55.686 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T02:44:55.686 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180', 'branch': 'ci-yingxin-crimson-load-obc-new-2', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': 'yingxin.cheng@intel.com', 'first_in_suite': False, 'job_id': '7697180', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'ci-yingxin-crimson-load-obc-new-2'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '4184b4e61afa6555ed712d5225eb247792c31f69'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '4184b4e61afa6555ed712d5225eb247792c31f69'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'ci-yingxin-crimson-load-obc-new-2', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '4184b4e61afa6555ed712d5225eb247792c31f69'}}, 'owner': 'scheduled_yingxin@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '4184b4e61afa6555ed712d5225eb247792c31f69', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'ci-yingxin-crimson-load-obc-new-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4184b4e61afa6555ed712d5225eb247792c31f69/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4184b4e61afa6555ed712d5225eb247792c31f69', 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFmkAdeXW+sNVEnWFfEVQLl1TJDGaQagcC4ub5MhBeQTIBTjWzQjNWMjpL2HKiTnAeldwnTHMBRoyQKBfqN/Hqw=', 'smithi080.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBms0g3VmRsExDQpVWWeccQc1ghvHhJMVRQyKVoNNuuyOojuqkrQhwhwF5tZEZUqlU2yWAil6Ntydq50SWvFiN0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '4184b4e61afa6555ed712d5225eb247792c31f69', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_02:24:47', 'tube': 'smithi', 'user': 'yingxin', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T02:44:55.687 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T02:44:55.717 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T02:44:55.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T02:44:55.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T02:44:55.798 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:55.798 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T02:44:55.851 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T02:44:55.851 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-05-08T02:44:55.907 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T02:44:55.908 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T02:44:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-08T02:44:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T02:44:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T02:44:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-08 02:44:50.842175216 +0000 2024-05-08T02:44:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-08 02:41:08.293604567 +0000 2024-05-08T02:44:55.908 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-08 02:41:08.293604567 +0000 2024-05-08T02:44:55.908 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-08 02:41:08.293604567 +0000 2024-05-08T02:44:55.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T02:44:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-08T02:44:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-08T02:44:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.7766e-05 s, 5.2 MB/s 2024-05-08T02:44:55.973 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T02:44:56.030 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-05-08T02:44:56.087 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T02:44:56.087 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T02:44:56.087 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-08T02:44:56.087 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T02:44:56.087 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T02:44:56.087 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-08 02:44:50.843175206 +0000 2024-05-08T02:44:56.087 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-08 02:41:08.638601021 +0000 2024-05-08T02:44:56.087 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-08 02:41:08.638601021 +0000 2024-05-08T02:44:56.087 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-08 02:41:08.638601021 +0000 2024-05-08T02:44:56.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T02:44:56.150 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-08T02:44:56.151 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-08T02:44:56.151 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 8.4619e-05 s, 6.1 MB/s 2024-05-08T02:44:56.152 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T02:44:56.208 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-05-08T02:44:56.264 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T02:44:56.265 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T02:44:56.265 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-08T02:44:56.265 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T02:44:56.265 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T02:44:56.265 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-08 02:44:50.844175195 +0000 2024-05-08T02:44:56.265 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-08 02:41:08.981597496 +0000 2024-05-08T02:44:56.265 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-08 02:41:08.981597496 +0000 2024-05-08T02:44:56.265 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-08 02:41:08.981597496 +0000 2024-05-08T02:44:56.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T02:44:56.328 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-08T02:44:56.328 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-08T02:44:56.328 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000103336 s, 5.0 MB/s 2024-05-08T02:44:56.330 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T02:44:56.386 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-05-08T02:44:56.441 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T02:44:56.441 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T02:44:56.441 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-08T02:44:56.441 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T02:44:56.441 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T02:44:56.441 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-05-08 02:44:50.844175195 +0000 2024-05-08T02:44:56.441 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-05-08 02:41:09.327593940 +0000 2024-05-08T02:44:56.441 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-05-08 02:41:09.327593940 +0000 2024-05-08T02:44:56.442 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-05-08 02:41:09.327593940 +0000 2024-05-08T02:44:56.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T02:44:56.505 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-05-08T02:44:56.505 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-05-08T02:44:56.505 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.9329e-05 s, 5.2 MB/s 2024-05-08T02:44:56.507 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T02:44:56.563 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-05-08T02:44:56.563 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:44:56.563 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T02:44:56.580 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T02:44:56.580 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-05-08T02:44:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T02:44:56.636 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T02:44:56.636 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-08T02:44:56.636 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T02:44:56.636 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T02:44:56.636 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 02:44:16.811624636 +0000 2024-05-08T02:44:56.637 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 02:41:08.314299364 +0000 2024-05-08T02:44:56.637 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 02:41:08.314299364 +0000 2024-05-08T02:44:56.637 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-08 02:41:08.314299364 +0000 2024-05-08T02:44:56.637 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T02:44:56.700 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T02:44:56.700 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T02:44:56.700 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000207898 s, 2.5 MB/s 2024-05-08T02:44:56.702 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T02:44:56.758 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-05-08T02:44:56.814 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T02:44:56.814 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T02:44:56.814 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-08T02:44:56.814 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T02:44:56.814 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T02:44:56.814 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 02:44:16.811624636 +0000 2024-05-08T02:44:56.814 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 02:41:08.659291604 +0000 2024-05-08T02:44:56.814 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 02:41:08.659291604 +0000 2024-05-08T02:44:56.814 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-08 02:41:08.659291604 +0000 2024-05-08T02:44:56.815 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T02:44:56.877 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T02:44:56.877 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T02:44:56.877 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000191077 s, 2.7 MB/s 2024-05-08T02:44:56.878 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T02:44:56.935 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-05-08T02:44:56.990 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T02:44:56.990 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T02:44:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-08T02:44:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T02:44:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T02:44:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 02:44:16.812624615 +0000 2024-05-08T02:44:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 02:41:08.989284183 +0000 2024-05-08T02:44:56.990 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 02:41:08.989284183 +0000 2024-05-08T02:44:56.991 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-08 02:41:08.989284183 +0000 2024-05-08T02:44:56.991 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T02:44:57.052 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T02:44:57.053 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T02:44:57.053 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000205134 s, 2.5 MB/s 2024-05-08T02:44:57.054 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T02:44:57.110 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-05-08T02:44:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T02:44:57.166 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T02:44:57.166 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-08T02:44:57.166 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T02:44:57.166 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T02:44:57.166 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-05-08 02:44:16.812624615 +0000 2024-05-08T02:44:57.166 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-05-08 02:41:09.328276559 +0000 2024-05-08T02:44:57.167 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-05-08 02:41:09.328276559 +0000 2024-05-08T02:44:57.167 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: 2024-05-08 02:41:09.328276559 +0000 2024-05-08T02:44:57.167 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T02:44:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-05-08T02:44:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-05-08T02:44:57.229 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000170761 s, 3.0 MB/s 2024-05-08T02:44:57.230 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T02:44:57.286 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-05-08T02:44:57.286 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-05-08T02:44:57.286 INFO:tasks.ceph:Generating config... 2024-05-08T02:44:57.287 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-05-08T02:44:57.287 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-05-08T02:44:57.287 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-05-08T02:44:57.287 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-05-08T02:44:57.288 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-05-08T02:44:57.288 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T02:44:57.288 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T02:44:57.288 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T02:44:57.288 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-05-08T02:44:57.288 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-05-08T02:44:57.288 INFO:tasks.ceph:[osd] debug monc = 20 2024-05-08T02:44:57.288 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-05-08T02:44:57.288 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-05-08T02:44:57.288 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T02:44:57.288 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T02:44:57.288 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-08T02:44:57.288 INFO:tasks.ceph:[osd] osd class default list = * 2024-05-08T02:44:57.288 INFO:tasks.ceph:[osd] osd class load list = * 2024-05-08T02:44:57.288 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-08T02:44:57.289 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T02:44:57.289 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-05-08T02:44:57.289 INFO:tasks.ceph:[global] ms client mode = crc 2024-05-08T02:44:57.289 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-05-08T02:44:57.289 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-05-08T02:44:57.289 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-05-08T02:44:57.289 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-05-08T02:44:57.289 INFO:tasks.ceph:[global] ms service mode = crc 2024-05-08T02:44:57.289 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T02:44:57.289 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T02:44:57.289 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-05-08T02:44:57.290 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-05-08T02:44:57.290 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-05-08T02:44:57.290 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-05-08T02:44:57.290 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T02:44:57.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T02:44:57.354 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T02:44:57.357 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T02:44:57.411 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T02:44:57.438 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46')] 2024-05-08T02:44:57.439 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-05-08T02:44:57.439 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:57.440 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T02:44:57.495 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T02:44:57.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:44:57.583+0000 7fc7b2e8bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:44:57.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:44:57.583+0000 7fc7b2e8bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:44:57.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:44:57.583+0000 7fc7b2e8bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:44:57.588 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T02:44:57.588 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:44:57.588 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-05-08T02:44:57.588 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-05-08T02:44:57.588 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:44:57.589 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-05-08T02:44:57.584828+0000 2024-05-08T02:44:57.589 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-05-08T02:44:57.584828+0000 2024-05-08T02:44:57.589 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 17 (quincy) 2024-05-08T02:44:57.589 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-05-08T02:44:57.589 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-05-08T02:44:57.589 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-05-08T02:44:57.590 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T02:44:57.606 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3c41076c-82d6-4569-8543-dcb021c14d35... 2024-05-08T02:44:57.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T02:44:57.649 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T02:44:57.691 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-05-08T02:44:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-05-08T02:44:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T02:44:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-05-08T02:44:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T02:44:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = 172.21.15.46 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: ms client mode = crc 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: ms cluster mode = crc 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: ms mon client mode = crc 2024-05-08T02:44:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: ms mon cluster mode = crc 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: ms mon service mode = crc 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: ms service mode = crc 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-05-08T02:44:57.696 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: debug monc = 20 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: crimson alien thread cpu cores = 6-7 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: crimson osd obc lru size = 10 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: osd blocked scrub grace period = 3600 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: osd class default list = * 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: osd class load list = * 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: osd shutdown pgref assert = True 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-05-08T02:44:57.697 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-05-08T02:44:57.698 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-05-08T02:44:57.699 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: mon min osdmap epochs = 50 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: mon osdmap full prune interval = 2 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: mon osdmap full prune min = 15 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: mon osdmap full prune txsize = 2 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: paxos service trim min = 10 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on pool no app = False 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default crimson = True 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-05-08T02:44:57.700 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout: crimson seastar cpu cores = 0-2 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout: crimson seastar cpu cores = 3-5 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout: crimson seastar cpu cores = 0-2 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-05-08T02:44:57.701 INFO:teuthology.orchestra.run.smithi046.stdout: crimson seastar cpu cores = 3-5 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout:[global] 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: chdir = "" 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: auth supported = cephx 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: filestore xattr use omap = true 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: mon clock drift allowed = 1.000 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: osd crush chooseleaf type = 0 2024-05-08T02:44:57.702 INFO:teuthology.orchestra.run.smithi080.stdout: auth debug = true 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on old message = true 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: ms die on bug = true 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: mon pg warn max object skew = 0 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default size = 2 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow primary affinity = true 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd allow pg remap = true 2024-05-08T02:44:57.703 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on legacy crush tunables = false 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on crush straw calc version zero = false 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on no sortbitwise = false 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on osd down out interval zero = false 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on too few osds = false 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: mon_allow_pool_size_one = true 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: osd default data pool replay window = 5 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: mon allow pool delete = true 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.704 INFO:teuthology.orchestra.run.smithi080.stdout: mon cluster log file level = debug 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: debug asserts on shutdown = true 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: mon health detail to clog = false 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: mon host = 172.21.15.46 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: ms client mode = crc 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: ms cluster mode = crc 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: ms mon client mode = crc 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: ms mon cluster mode = crc 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: ms mon service mode = crc 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: ms service mode = crc 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: fsid = 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout:[osd] 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: osd journal size = 100 2024-05-08T02:44:57.705 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub load threshold = 5.0 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: osd scrub max interval = 600 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: osd mclock profile = high_recovery_ops 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: osd recover clone overlap = true 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: osd recovery max chunk = 1048576 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug shutdown = true 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug op order = true 2024-05-08T02:44:57.706 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug verify stray on activate = true 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug trim objects = true 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: osd open classes on start = true 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug pg log writeout = true 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: osd deep scrub update digest min age = 30 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: osd map max advance = 10 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: journal zero on create = true 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: filestore ondisk finisher threads = 3 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: filestore apply finisher threads = 3 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.707 INFO:teuthology.orchestra.run.smithi080.stdout: bdev debug aio = true 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: osd debug misdirected ops = true 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: debug monc = 20 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: crimson alien thread cpu cores = 6-7 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: crimson osd obc lru size = 10 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: debug osd = 20 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: osd blocked scrub grace period = 3600 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: osd class default list = * 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: osd class load list = * 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: osd shutdown pgref assert = True 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout:[mgr] 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T02:44:57.708 INFO:teuthology.orchestra.run.smithi080.stdout: debug mgr = 20 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: mgr/telemetry/nag = false 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout:[mon] 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: debug mon = 20 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: debug paxos = 20 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: debug auth = 20 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: mon data avail warn = 5 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: mon mgr mkfs grace = 240 2024-05-08T02:44:57.709 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min pgs per osd = 4 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd reporter subtree level = osd 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: mon osd prime pg temp = true 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: mon reweight min bytes per osd = 10 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: # 1m isn't quite enough 2024-05-08T02:44:57.710 INFO:teuthology.orchestra.run.smithi080.stdout: mon_down_mkfs_grace = 2m 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: mon_warn_on_filestore_osds = false 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: mon min osdmap epochs = 50 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: mon osdmap full prune interval = 2 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: mon osdmap full prune min = 15 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: mon osdmap full prune txsize = 2 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: paxos service trim min = 10 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: mon warn on pool no app = False 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: osd pool default crimson = True 2024-05-08T02:44:57.711 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout:[client] 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout: rgw cache enabled = true 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable ops log = true 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout: rgw enable usage log = true 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout: debug ms = 1 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout:[mon.a] 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.0] 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout: crimson seastar cpu cores = 0-2 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.1] 2024-05-08T02:44:57.712 INFO:teuthology.orchestra.run.smithi080.stdout: crimson seastar cpu cores = 3-5 2024-05-08T02:44:57.713 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.2] 2024-05-08T02:44:57.713 INFO:teuthology.orchestra.run.smithi080.stdout: crimson seastar cpu cores = 0-2 2024-05-08T02:44:57.713 INFO:teuthology.orchestra.run.smithi080.stdout:[osd.3] 2024-05-08T02:44:57.713 INFO:teuthology.orchestra.run.smithi080.stdout: crimson seastar cpu cores = 3-5 2024-05-08T02:44:57.714 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T02:44:57.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T02:44:57.821 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T02:44:57.821 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:57.821 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T02:44:57.837 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:57.838 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T02:44:57.894 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-05-08T02:44:57.894 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:57.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T02:44:57.894 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T02:44:57.969 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:44:57.969 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T02:44:58.026 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T02:44:58.026 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:44:58.026 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T02:44:58.026 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T02:44:58.061 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:44:58.061 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T02:44:58.116 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T02:44:58.116 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T02:44:58.116 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T02:44:58.221 INFO:teuthology.orchestra.run.smithi080.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T02:44:58.225 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T02:44:58.225 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T02:44:58.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T02:44:58.276 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T02:44:58.289 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-08T02:44:58.338 INFO:teuthology.orchestra.run.smithi080.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-08T02:44:58.351 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T02:44:58.351 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi080.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-05-08T02:44:58.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T02:44:58.377 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-05-08T02:44:58.377 INFO:tasks.ceph:role: osd.0 2024-05-08T02:44:58.377 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-08T02:44:58.377 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T02:44:58.443 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T02:44:58.475 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-05-08T02:44:58.477 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-05-08T02:44:58.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T02:44:58.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T02:44:58.623 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T02:44:58.691 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-05-08T02:44:58.691 INFO:tasks.ceph:role: osd.1 2024-05-08T02:44:58.691 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-08T02:44:58.691 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T02:44:58.757 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T02:44:58.757 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T02:44:58.757 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T02:44:58.757 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T02:44:58.757 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T02:44:58.758 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-05-08T02:44:58.758 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T02:44:58.758 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T02:44:58.758 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T02:44:58.758 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T02:44:58.790 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-05-08T02:44:58.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-05-08T02:44:58.792 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T02:44:58.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T02:44:58.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T02:44:59.283 INFO:teuthology.orchestra.run.smithi046.stderr:WARNING: debug mode. Not for benchmarking or production 2024-05-08T02:44:59.284 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-05-08 02:44:59,281 seastar - Reactor backend: linux-aio 2024-05-08T02:44:59.297 INFO:teuthology.orchestra.run.smithi046.stderr:==26919==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-05-08T02:44:59.417 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-05-08 02:44:59,414 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-05-08T02:44:59.417 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-05-08 02:44:59,414 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-05-08T02:44:59.418 INFO:teuthology.orchestra.run.smithi046.stderr:DEBUG 2024-05-08 02:44:59,415 [shard 0:main] seastar - reactor::drain 2024-05-08T02:44:59.995 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-05-08T02:44:59.995 INFO:teuthology.orchestra.run.smithi046.stderr:Suppressions used: 2024-05-08T02:44:59.995 INFO:teuthology.orchestra.run.smithi046.stderr: count bytes template 2024-05-08T02:44:59.995 INFO:teuthology.orchestra.run.smithi046.stderr: 1 8 MallocExtension::Register 2024-05-08T02:44:59.995 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-05-08T02:44:59.995 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-08T02:45:00.078 INFO:teuthology.orchestra.run.smithi046.stderr:WARNING: debug mode. Not for benchmarking or production 2024-05-08T02:45:00.082 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-05-08 02:45:00,079 seastar - Reactor backend: linux-aio 2024-05-08T02:45:00.091 INFO:teuthology.orchestra.run.smithi046.stderr:==26915==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-05-08T02:45:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9ac1f9 0xb87ecc0 0xb88023c 0xb880452 0xb8805a8 0xb880a71 0x3e6ef 0x36939 0x361c5e8 0x5da4ba3 0x5da4ff4 0x5da53d6 0x5e01364 0x5d7fee0 0x5d800ba 0x5d80646 0x5bc517f 0x5be0243 0x6eb8bb4 0x6eca387 0x6ecb824 0x6ecb8a9 0x6ecb9ab 0x6ecbaa3 0x6ecbcb0 0x6ecbe96 0x6ecc1e5 0x6ecc589 0x6ecc7b9 0x6ecca23 0x6ecccf0 0x6eccf0e 0x6eccfc6 0x6ecd08c 0x6ecd16d 0x5a2da78 0x5a2db82 0x5a2dc3e 0x5a2dcfa 0x5a2ddb6 0x5a2df03 0x5a2e08e 0x5a2e44f 0x5a4a390 0xb891945 0xb8abbdf 0xb94cbdd 0xb94e22b 0xb62aa11 0xb62b38d 0x360658a 0x2958f 0x2963f 0x33f2444 2024-05-08T02:45:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-05-08T02:45:03.592 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-05-08T02:45:03.592 INFO:teuthology.orchestra.run.smithi046.stderr:Suppressions used: 2024-05-08T02:45:03.592 INFO:teuthology.orchestra.run.smithi046.stderr: count bytes template 2024-05-08T02:45:03.592 INFO:teuthology.orchestra.run.smithi046.stderr: 1 8 MallocExtension::Register 2024-05-08T02:45:03.592 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-05-08T02:45:03.592 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-08T02:45:03.593 INFO:teuthology.orchestra.run.smithi046.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:45:03.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T02:45:03.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T02:45:03.962 INFO:teuthology.orchestra.run.smithi046.stderr:WARNING: debug mode. Not for benchmarking or production 2024-05-08T02:45:03.963 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-05-08 02:45:03,960 seastar - Reactor backend: linux-aio 2024-05-08T02:45:03.968 INFO:teuthology.orchestra.run.smithi046.stderr:==27736==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-05-08T02:45:04.094 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-05-08 02:45:04,091 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-05-08T02:45:04.095 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-05-08 02:45:04,091 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-05-08T02:45:04.095 INFO:teuthology.orchestra.run.smithi046.stderr:DEBUG 2024-05-08 02:45:04,092 [shard 0:main] seastar - reactor::drain 2024-05-08T02:45:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-05-08T02:45:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:Suppressions used: 2024-05-08T02:45:04.651 INFO:teuthology.orchestra.run.smithi046.stderr: count bytes template 2024-05-08T02:45:04.651 INFO:teuthology.orchestra.run.smithi046.stderr: 1 8 MallocExtension::Register 2024-05-08T02:45:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-05-08T02:45:04.651 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-08T02:45:04.708 INFO:teuthology.orchestra.run.smithi046.stderr:WARNING: debug mode. Not for benchmarking or production 2024-05-08T02:45:04.712 INFO:teuthology.orchestra.run.smithi046.stderr:INFO 2024-05-08 02:45:04,709 seastar - Reactor backend: linux-aio 2024-05-08T02:45:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:==27734==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-05-08T02:45:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9ac1f9 0xb87ecc0 0xb88023c 0xb880452 0xb8805a8 0xb880a71 0x3e6ef 0x155df 0x4a09d 0x35b7c 0x3689e 0x342a31e 0x342a4c4 0x5d781db 0x5d9a1a4 0x5d9a43e 0x5d80826 0x5bc517f 0x5be0243 0x6eb8bb4 0x6eca387 0x6ecb824 0x6ecb8a9 0x6ecb9ab 0x6ecbaa3 0x6ecbcb0 0x6ecbe96 0x6ecc1e5 0x6ecc589 0x6ecc7b9 0x6ecca23 0x6ecccf0 0x6eccf0e 0x6eccfc6 0x6ecd08c 0x6ecd16d 0x5a2da78 0x5a2db82 0x5a2dc3e 0x5a2dcfa 0x5a2ddb6 0x5a2df03 0x5a2e08e 0x5a2e44f 0x5a4a390 0xb891945 0xb8abbdf 0xb94cbdd 0xb94e22b 0xb62aa11 0xb62b38d 0x360658a 0x2958f 0x2963f 0x33f2444 2024-05-08T02:45:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:kernel callstack: 2024-05-08T02:45:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-05-08T02:45:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:Suppressions used: 2024-05-08T02:45:08.213 INFO:teuthology.orchestra.run.smithi046.stderr: count bytes template 2024-05-08T02:45:08.213 INFO:teuthology.orchestra.run.smithi046.stderr: 1 8 MallocExtension::Register 2024-05-08T02:45:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:----------------------------------------------------- 2024-05-08T02:45:08.213 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-08T02:45:08.214 INFO:teuthology.orchestra.run.smithi046.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:45:08.239 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T02:45:08.265 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T02:45:08.295 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-05-08T02:45:08.295 INFO:tasks.ceph:role: osd.2 2024-05-08T02:45:08.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T02:45:08.295 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T02:45:08.369 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T02:45:08.369 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T02:45:08.369 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T02:45:08.370 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T02:45:08.370 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T02:45:08.370 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T02:45:08.370 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T02:45:08.370 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T02:45:08.370 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T02:45:08.370 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T02:45:08.881 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T02:45:08.884 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T02:45:08.884 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-05-08T02:45:09.019 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T02:45:09.056 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T02:45:09.126 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-05-08T02:45:09.126 INFO:tasks.ceph:role: osd.3 2024-05-08T02:45:09.126 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T02:45:09.126 DEBUG:teuthology.orchestra.run.smithi080:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: = sunit=0 swidth=0 blks 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T02:45:09.203 INFO:teuthology.orchestra.run.smithi080.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T02:45:09.648 INFO:teuthology.orchestra.run.smithi080.stdout:Discarding blocks...Done. 2024-05-08T02:45:09.650 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi080.front.sepia.ceph.com -o noatime 2024-05-08T02:45:09.650 DEBUG:teuthology.orchestra.run.smithi080:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-05-08T02:45:09.744 DEBUG:teuthology.orchestra.run.smithi080:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T02:45:09.772 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T02:45:10.114 INFO:teuthology.orchestra.run.smithi080.stderr:WARNING: debug mode. Not for benchmarking or production 2024-05-08T02:45:10.114 INFO:teuthology.orchestra.run.smithi080.stderr:INFO 2024-05-08 02:45:10,112 seastar - Reactor backend: linux-aio 2024-05-08T02:45:10.130 INFO:teuthology.orchestra.run.smithi080.stderr:==26578==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-05-08T02:45:10.242 INFO:teuthology.orchestra.run.smithi080.stderr:INFO 2024-05-08 02:45:10,238 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-05-08T02:45:10.242 INFO:teuthology.orchestra.run.smithi080.stderr:INFO 2024-05-08 02:45:10,238 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-05-08T02:45:10.242 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG 2024-05-08 02:45:10,239 [shard 0:main] seastar - reactor::drain 2024-05-08T02:45:10.809 INFO:teuthology.orchestra.run.smithi080.stderr:----------------------------------------------------- 2024-05-08T02:45:10.809 INFO:teuthology.orchestra.run.smithi080.stderr:Suppressions used: 2024-05-08T02:45:10.809 INFO:teuthology.orchestra.run.smithi080.stderr: count bytes template 2024-05-08T02:45:10.809 INFO:teuthology.orchestra.run.smithi080.stderr: 1 8 MallocExtension::Register 2024-05-08T02:45:10.809 INFO:teuthology.orchestra.run.smithi080.stderr:----------------------------------------------------- 2024-05-08T02:45:10.809 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T02:45:10.867 INFO:teuthology.orchestra.run.smithi080.stderr:WARNING: debug mode. Not for benchmarking or production 2024-05-08T02:45:10.871 INFO:teuthology.orchestra.run.smithi080.stderr:INFO 2024-05-08 02:45:10,868 seastar - Reactor backend: linux-aio 2024-05-08T02:45:10.880 INFO:teuthology.orchestra.run.smithi080.stderr:==26574==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-05-08T02:45:10.945 INFO:teuthology.orchestra.run.smithi080.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9ac1f9 0xb87ecc0 0xb88023c 0xb880452 0xb8805a8 0xb880a71 0x3e6ef 0x26513 0xef7ec 0x4a0a5 0x35b7c 0x3689e 0x361c880 0x5da51f7 0x5da53e1 0x5e01364 0x5d7fee0 0x5d800ba 0x5d80646 0x5bc517f 0x5be0243 0x6eb8bb4 0x6eca387 0x6ecb824 0x6ecb8a9 0x6ecb9ab 0x6ecbaa3 0x6ecbcb0 0x6ecbe96 0x6ecc1e5 0x6ecc589 0x6ecc7b9 0x6ecca23 0x6ecccf0 0x6eccf0e 0x6eccfc6 0x6ecd08c 0x6ecd16d 0x5a2da78 0x5a2db82 0x5a2dc3e 0x5a2dcfa 0x5a2ddb6 0x5a2df03 0x5a2e08e 0x5a2e44f 0x5a4a390 0xb891945 0xb8abbdf 0xb94cbdd 0xb94e22b 0xb62aa11 0xb62b38d 0x360658a 0x2958f 0x2963f 0x33f2444 2024-05-08T02:45:10.945 INFO:teuthology.orchestra.run.smithi080.stderr:kernel callstack: 2024-05-08T02:45:14.325 INFO:teuthology.orchestra.run.smithi080.stderr:----------------------------------------------------- 2024-05-08T02:45:14.325 INFO:teuthology.orchestra.run.smithi080.stderr:Suppressions used: 2024-05-08T02:45:14.325 INFO:teuthology.orchestra.run.smithi080.stderr: count bytes template 2024-05-08T02:45:14.325 INFO:teuthology.orchestra.run.smithi080.stderr: 1 8 MallocExtension::Register 2024-05-08T02:45:14.325 INFO:teuthology.orchestra.run.smithi080.stderr:----------------------------------------------------- 2024-05-08T02:45:14.325 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T02:45:14.325 INFO:teuthology.orchestra.run.smithi080.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:45:14.351 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T02:45:14.376 DEBUG:teuthology.orchestra.run.smithi080:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T02:45:14.673 INFO:teuthology.orchestra.run.smithi080.stderr:WARNING: debug mode. Not for benchmarking or production 2024-05-08T02:45:14.673 INFO:teuthology.orchestra.run.smithi080.stderr:INFO 2024-05-08 02:45:14,671 seastar - Reactor backend: linux-aio 2024-05-08T02:45:14.679 INFO:teuthology.orchestra.run.smithi080.stderr:==27387==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-05-08T02:45:14.786 INFO:teuthology.orchestra.run.smithi080.stderr:INFO 2024-05-08 02:45:14,783 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-05-08T02:45:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:INFO 2024-05-08 02:45:14,783 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-05-08T02:45:14.787 INFO:teuthology.orchestra.run.smithi080.stderr:DEBUG 2024-05-08 02:45:14,784 [shard 0:main] seastar - reactor::drain 2024-05-08T02:45:15.322 INFO:teuthology.orchestra.run.smithi080.stderr:----------------------------------------------------- 2024-05-08T02:45:15.322 INFO:teuthology.orchestra.run.smithi080.stderr:Suppressions used: 2024-05-08T02:45:15.322 INFO:teuthology.orchestra.run.smithi080.stderr: count bytes template 2024-05-08T02:45:15.322 INFO:teuthology.orchestra.run.smithi080.stderr: 1 8 MallocExtension::Register 2024-05-08T02:45:15.323 INFO:teuthology.orchestra.run.smithi080.stderr:----------------------------------------------------- 2024-05-08T02:45:15.323 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T02:45:15.379 INFO:teuthology.orchestra.run.smithi080.stderr:WARNING: debug mode. Not for benchmarking or production 2024-05-08T02:45:15.383 INFO:teuthology.orchestra.run.smithi080.stderr:INFO 2024-05-08 02:45:15,380 seastar - Reactor backend: linux-aio 2024-05-08T02:45:15.392 INFO:teuthology.orchestra.run.smithi080.stderr:==27385==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-05-08T02:45:18.823 INFO:teuthology.orchestra.run.smithi080.stderr:----------------------------------------------------- 2024-05-08T02:45:18.824 INFO:teuthology.orchestra.run.smithi080.stderr:Suppressions used: 2024-05-08T02:45:18.824 INFO:teuthology.orchestra.run.smithi080.stderr: count bytes template 2024-05-08T02:45:18.824 INFO:teuthology.orchestra.run.smithi080.stderr: 1 8 MallocExtension::Register 2024-05-08T02:45:18.824 INFO:teuthology.orchestra.run.smithi080.stderr:----------------------------------------------------- 2024-05-08T02:45:18.824 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T02:45:18.824 INFO:teuthology.orchestra.run.smithi080.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:45:18.848 DEBUG:teuthology.orchestra.run.smithi080:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T02:45:18.872 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T02:45:18.872 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:45:18.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T02:45:18.904 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:45:18.904 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T02:45:18.976 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:45:18.976 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T02:45:19.000 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:45:19.000 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T02:45:19.065 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:45:19.065 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T02:45:19.129 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:45:19.129 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T02:45:19.148 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:45:19.148 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-08T02:45:19.183 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T02:45:19.184 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAs5zpmw/9MDxAAOKt9Fr2UKAxC4xQf5gyEMA== 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAw5zpmRjiIMxAA39Ixmim40tSBVBS4zHMbTg== 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAq5zpmopEJDRAAvCzzbqLm2NBg/5fQ8WvpzA== 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQA35zpmE/SVABAArQRRp0M93UZLhjfaSAM+TQ== 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQA75zpmelVHHxAA2HJfCAFFWxUVDE2BEsSVeA== 2024-05-08T02:45:19.217 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-05-08T02:45:19.218 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAq5zpmeltFEBAA1yOySFqtH49oPlbRrXgQLA== 2024-05-08T02:45:19.218 INFO:teuthology.orchestra.run.smithi046.stdout:[client.1] 2024-05-08T02:45:19.218 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAq5zpmMNkAFBAAHnrxaizfxJ2/2le/xTce4g== 2024-05-08T02:45:19.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T02:45:19.332 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T02:45:19.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T02:45:19.459 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T02:45:19.522 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T02:45:19.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T02:45:19.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T02:45:19.713 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T02:45:19.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T02:45:19.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T02:45:19.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:19.847+0000 7f3287a4ea80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:19.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:19.847+0000 7f3287a4ea80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:19.864 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T02:45:19.889 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T02:45:19.945 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T02:45:19.946 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T02:45:19.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T02:45:19.988 INFO:tasks.ceph.mon.a:Started 2024-05-08T02:45:19.988 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T02:45:19.988 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T02:45:19.988 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T02:45:19.991 INFO:tasks.ceph.mgr.x:Started 2024-05-08T02:45:19.991 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T02:45:19.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T02:45:20.071 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-05-08T02:45:20.067+0000 7f086f08aa80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.072 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-05-08T02:45:20.067+0000 7f086f08aa80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.072 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-05-08T02:45:20.068+0000 7f086f08aa80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.080 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:20.076+0000 7f528e82e000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.096+0000 7f6707b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.103+0000 7f6707b5d640 1 Processor -- start 2024-05-08T02:45:20.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.103+0000 7f6707b5d640 1 -- start start 2024-05-08T02:45:20.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.105+0000 7f6707b5d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6700137c30 0x7f670013a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:20.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.105+0000 7f6707b5d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67000a10c0 con 0x7f67001318a0 2024-05-08T02:45:20.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.105+0000 7f6707b5d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f670009aa90 con 0x7f6700137c30 2024-05-08T02:45:20.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.105+0000 7f67050f8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6700137c30 0x7f670013a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:20.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.105+0000 7f67058f9640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f67001318a0 0x7f6700131cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38204/0 (socket says 172.21.15.46:38204) 2024-05-08T02:45:20.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.105+0000 7f67058f9640 1 -- 172.21.15.46:0/3196985092 learned_addr learned my addr 172.21.15.46:0/3196985092 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:20.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.105+0000 7f67050f8640 1 -- 172.21.15.46:0/3196985092 >> v1:172.21.15.46:6789/0 conn(0x7f67001318a0 legacy=0x7f6700131cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:20.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.105+0000 7f67050f8640 1 -- 172.21.15.46:0/3196985092 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67001323c0 con 0x7f6700137c30 2024-05-08T02:45:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.106+0000 7f67050f8640 1 --2- 172.21.15.46:0/3196985092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6700137c30 0x7f670013a050 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392da4a16270f922 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.106+0000 7f67048f7640 1 -- 172.21.15.46:0/3196985092 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f66fc009d90 con 0x7f6700137c30 2024-05-08T02:45:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.106+0000 7f67048f7640 1 -- 172.21.15.46:0/3196985092 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f66fc00e230 con 0x7f6700137c30 2024-05-08T02:45:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.107+0000 7f67048f7640 1 -- 172.21.15.46:0/3196985092 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f66fc00e4d0 con 0x7f6700137c30 2024-05-08T02:45:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.107+0000 7f6707b5d640 1 -- 172.21.15.46:0/3196985092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6700137c30 msgr2=0x7f670013a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.107+0000 7f6707b5d640 1 --2- 172.21.15.46:0/3196985092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6700137c30 0x7f670013a050 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.107+0000 7f6707b5d640 1 -- 172.21.15.46:0/3196985092 shutdown_connections 2024-05-08T02:45:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.107+0000 7f6707b5d640 1 --2- 172.21.15.46:0/3196985092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6700137c30 0x7f670013a050 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.107+0000 7f6707b5d640 1 -- 172.21.15.46:0/3196985092 >> 172.21.15.46:0/3196985092 conn(0x7f67000a3c60 msgr2=0x7f67000a4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.107+0000 7f6707b5d640 1 -- 172.21.15.46:0/3196985092 shutdown_connections 2024-05-08T02:45:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.107+0000 7f6707b5d640 1 -- 172.21.15.46:0/3196985092 wait complete. 2024-05-08T02:45:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.108+0000 7f6707b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.109+0000 7f6707b5d640 1 Processor -- start 2024-05-08T02:45:20.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.109+0000 7f6707b5d640 1 -- start start 2024-05-08T02:45:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.111+0000 7f6707b5d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67001318a0 0x7f670011d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.111+0000 7f6707b5d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f67001210f0 con 0x7f67001318a0 2024-05-08T02:45:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.111+0000 7f67058f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67001318a0 0x7f670011d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.111+0000 7f67058f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67001318a0 0x7f670011d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46166/0 (socket says 172.21.15.46:46166) 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.111+0000 7f67058f9640 1 -- 172.21.15.46:0/963222365 learned_addr learned my addr 172.21.15.46:0/963222365 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.111+0000 7f67058f9640 1 -- 172.21.15.46:0/963222365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6700120b50 con 0x7f67001318a0 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.112+0000 7f67058f9640 1 --2- 172.21.15.46:0/963222365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67001318a0 0x7f670011d410 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.112+0000 7f66f27fc640 1 -- 172.21.15.46:0/963222365 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f66f4005a60 con 0x7f67001318a0 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.112+0000 7f66f27fc640 1 -- 172.21.15.46:0/963222365 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f66f4005bc0 con 0x7f67001318a0 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.112+0000 7f6707b5d640 1 -- 172.21.15.46:0/963222365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670011f4c0 con 0x7f67001318a0 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.112+0000 7f66f27fc640 1 -- 172.21.15.46:0/963222365 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f66f4005e60 con 0x7f67001318a0 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.112+0000 7f6707b5d640 1 -- 172.21.15.46:0/963222365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67001205f0 con 0x7f67001318a0 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.112+0000 7f66f27fc640 1 -- 172.21.15.46:0/963222365 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f66f400cb10 con 0x7f67001318a0 2024-05-08T02:45:20.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.112+0000 7f66f27fc640 1 -- 172.21.15.46:0/963222365 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7f66f400f9d0 con 0x7f67001318a0 2024-05-08T02:45:20.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.113+0000 7f6707b5d640 1 -- 172.21.15.46:0/963222365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670009c650 con 0x7f67001318a0 2024-05-08T02:45:20.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.115+0000 7f66f27fc640 1 -- 172.21.15.46:0/963222365 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f66f400fc30 con 0x7f67001318a0 2024-05-08T02:45:20.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.182+0000 7f6707b5d640 1 -- 172.21.15.46:0/963222365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f670011f8a0 con 0x7f67001318a0 2024-05-08T02:45:20.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.183+0000 7f66f27fc640 1 -- 172.21.15.46:0/963222365 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7f66f400fe50 con 0x7f67001318a0 2024-05-08T02:45:20.187 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-05-08T02:45:20.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.183+0000 7f6707b5d640 1 -- 172.21.15.46:0/963222365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67001318a0 msgr2=0x7f670011d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:20.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.183+0000 7f6707b5d640 1 --2- 172.21.15.46:0/963222365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67001318a0 0x7f670011d410 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:20.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.183+0000 7f6707b5d640 1 -- 172.21.15.46:0/963222365 shutdown_connections 2024-05-08T02:45:20.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.183+0000 7f6707b5d640 1 --2- 172.21.15.46:0/963222365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67001318a0 0x7f670011d410 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:20.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.184+0000 7f6707b5d640 1 -- 172.21.15.46:0/963222365 >> 172.21.15.46:0/963222365 conn(0x7f67000a3c60 msgr2=0x7f67001bcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:20.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.184+0000 7f6707b5d640 1 -- 172.21.15.46:0/963222365 shutdown_connections 2024-05-08T02:45:20.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.184+0000 7f6707b5d640 1 -- 172.21.15.46:0/963222365 wait complete. 2024-05-08T02:45:20.198 INFO:tasks.ceph:check_enable_crimson: True 2024-05-08T02:45:20.198 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-05-08T02:45:20.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-05-08T02:45:20.284 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:20.280+0000 7f528e82e000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.284 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:20.281+0000 7f528e82e000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.300+0000 7fef4b4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.306+0000 7fef4b4ed640 1 Processor -- start 2024-05-08T02:45:20.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.307+0000 7fef4b4ed640 1 -- start start 2024-05-08T02:45:20.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.308+0000 7fef4b4ed640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fef4409cbc0 0x7fef44133200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:20.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.308+0000 7fef4b4ed640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4409c190 con 0x7fef4409b5b0 2024-05-08T02:45:20.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.308+0000 7fef4b4ed640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fef441327e0 con 0x7fef4409cbc0 2024-05-08T02:45:20.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.308+0000 7fef48a88640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fef4409cbc0 0x7fef44133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:20.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.308+0000 7fef49289640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fef4409b5b0 0x7fef44132af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38216/0 (socket says 172.21.15.46:38216) 2024-05-08T02:45:20.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.308+0000 7fef48a88640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fef4409cbc0 0x7fef44133200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46182/0 (socket says 172.21.15.46:46182) 2024-05-08T02:45:20.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.308+0000 7fef49289640 1 -- 172.21.15.46:0/3539996716 learned_addr learned my addr 172.21.15.46:0/3539996716 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:20.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.309+0000 7fef48a88640 1 -- 172.21.15.46:0/3539996716 >> v1:172.21.15.46:6789/0 conn(0x7fef4409b5b0 legacy=0x7fef44132af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:20.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.309+0000 7fef48a88640 1 -- 172.21.15.46:0/3539996716 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4409d9a0 con 0x7fef4409cbc0 2024-05-08T02:45:20.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.309+0000 7fef48a88640 1 --2- 172.21.15.46:0/3539996716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409cbc0 0x7fef44133200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27651e6221f22bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:20.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.309+0000 7fef43fff640 1 -- 172.21.15.46:0/3539996716 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fef38009d90 con 0x7fef4409cbc0 2024-05-08T02:45:20.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.309+0000 7fef43fff640 1 -- 172.21.15.46:0/3539996716 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fef3800e230 con 0x7fef4409cbc0 2024-05-08T02:45:20.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.309+0000 7fef43fff640 1 -- 172.21.15.46:0/3539996716 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fef3800e4d0 con 0x7fef4409cbc0 2024-05-08T02:45:20.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.310+0000 7fef4b4ed640 1 -- 172.21.15.46:0/3539996716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409cbc0 msgr2=0x7fef44133200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:20.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.310+0000 7fef4b4ed640 1 --2- 172.21.15.46:0/3539996716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409cbc0 0x7fef44133200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:20.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.310+0000 7fef4b4ed640 1 -- 172.21.15.46:0/3539996716 shutdown_connections 2024-05-08T02:45:20.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.310+0000 7fef4b4ed640 1 --2- 172.21.15.46:0/3539996716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409cbc0 0x7fef44133200 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:20.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.310+0000 7fef4b4ed640 1 -- 172.21.15.46:0/3539996716 >> 172.21.15.46:0/3539996716 conn(0x7fef4409aa00 msgr2=0x7fef4409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:20.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.310+0000 7fef4b4ed640 1 -- 172.21.15.46:0/3539996716 shutdown_connections 2024-05-08T02:45:20.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.310+0000 7fef4b4ed640 1 -- 172.21.15.46:0/3539996716 wait complete. 2024-05-08T02:45:20.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.310+0000 7fef4b4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:20.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.312+0000 7fef4b4ed640 1 Processor -- start 2024-05-08T02:45:20.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.312+0000 7fef4b4ed640 1 -- start start 2024-05-08T02:45:20.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.313+0000 7fef4b4ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409b5b0 0x7fef441c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:20.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.313+0000 7fef4b4ed640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fef441373c0 con 0x7fef4409b5b0 2024-05-08T02:45:20.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.313+0000 7fef49289640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409b5b0 0x7fef441c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:20.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef49289640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409b5b0 0x7fef441c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46186/0 (socket says 172.21.15.46:46186) 2024-05-08T02:45:20.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef49289640 1 -- 172.21.15.46:0/4022886021 learned_addr learned my addr 172.21.15.46:0/4022886021 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:20.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef49289640 1 -- 172.21.15.46:0/4022886021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef441375f0 con 0x7fef4409b5b0 2024-05-08T02:45:20.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef49289640 1 --2- 172.21.15.46:0/4022886021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409b5b0 0x7fef441c78c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef41ffb640 1 -- 172.21.15.46:0/4022886021 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fef340070b0 con 0x7fef4409b5b0 2024-05-08T02:45:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef41ffb640 1 -- 172.21.15.46:0/4022886021 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fef34007210 con 0x7fef4409b5b0 2024-05-08T02:45:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef4b4ed640 1 -- 172.21.15.46:0/4022886021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4411ecd0 con 0x7fef4409b5b0 2024-05-08T02:45:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef41ffb640 1 -- 172.21.15.46:0/4022886021 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fef340074b0 con 0x7fef4409b5b0 2024-05-08T02:45:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef4b4ed640 1 -- 172.21.15.46:0/4022886021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4411d790 con 0x7fef4409b5b0 2024-05-08T02:45:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.314+0000 7fef41ffb640 1 -- 172.21.15.46:0/4022886021 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fef3400e1c0 con 0x7fef4409b5b0 2024-05-08T02:45:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.315+0000 7fef41ffb640 1 -- 172.21.15.46:0/4022886021 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7fef3400f570 con 0x7fef4409b5b0 2024-05-08T02:45:20.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.315+0000 7fef4b4ed640 1 -- 172.21.15.46:0/4022886021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4411d260 con 0x7fef4409b5b0 2024-05-08T02:45:20.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.318+0000 7fef41ffb640 1 -- 172.21.15.46:0/4022886021 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7fef3400e7a0 con 0x7fef4409b5b0 2024-05-08T02:45:20.381 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:20.377+0000 7f528e82e000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T02:45:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:20.395+0000 7fef4b4ed640 1 -- 172.21.15.46:0/4022886021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7fef441377e0 con 0x7fef4409b5b0 2024-05-08T02:45:20.399 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-05-08T02:45:20.395+0000 7f0865df4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-05-08T02:45:20.399 INFO:tasks.ceph.mon.a.smithi046.stderr:Please be aware that this feature is experimental, untested, 2024-05-08T02:45:20.399 INFO:tasks.ceph.mon.a.smithi046.stderr:unsupported, and may result in data corruption, data loss, 2024-05-08T02:45:20.399 INFO:tasks.ceph.mon.a.smithi046.stderr:and/or irreparable damage to your cluster. Do not use 2024-05-08T02:45:20.400 INFO:tasks.ceph.mon.a.smithi046.stderr:feature with important data. 2024-05-08T02:45:20.400 INFO:tasks.ceph.mon.a.smithi046.stderr: 2024-05-08T02:45:20.536 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:20.532+0000 7f528e82e000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T02:45:20.588 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:20.584+0000 7f528e82e000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T02:45:20.835 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:20.831+0000 7f528e82e000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T02:45:20.879 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:20.875+0000 7f528e82e000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T02:45:21.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:21.183+0000 7fef41ffb640 1 -- 172.21.15.46:0/4022886021 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7fef3400ea10 con 0x7fef4409b5b0 2024-05-08T02:45:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:21.185+0000 7fef4b4ed640 1 -- 172.21.15.46:0/4022886021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409b5b0 msgr2=0x7fef441c78c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:21.185+0000 7fef4b4ed640 1 --2- 172.21.15.46:0/4022886021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409b5b0 0x7fef441c78c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:21.185+0000 7fef4b4ed640 1 -- 172.21.15.46:0/4022886021 shutdown_connections 2024-05-08T02:45:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:21.185+0000 7fef4b4ed640 1 --2- 172.21.15.46:0/4022886021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef4409b5b0 0x7fef441c78c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:21.185+0000 7fef4b4ed640 1 -- 172.21.15.46:0/4022886021 >> 172.21.15.46:0/4022886021 conn(0x7fef4409aa00 msgr2=0x7fef44070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:21.185+0000 7fef4b4ed640 1 -- 172.21.15.46:0/4022886021 shutdown_connections 2024-05-08T02:45:21.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:21.185+0000 7fef4b4ed640 1 -- 172.21.15.46:0/4022886021 wait complete. 2024-05-08T02:45:21.203 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T02:45:21.203 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:45:21.203 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T02:45:21.232 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:45:21.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T02:45:21.300 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:45:21.301 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T02:45:21.325 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-05-08T02:45:21.325 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T02:45:21.390 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new b109fb80-69d6-4e98-b5a0-5244abc7c70a 0 2024-05-08T02:45:21.538 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.529+0000 7f5d13f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.535+0000 7f5d13f9d640 1 Processor -- start 2024-05-08T02:45:21.539 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.535+0000 7f5d13f9d640 1 -- start start 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.536+0000 7f5d13f9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5d0c113a10 0x7f5d0c113e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.536+0000 7f5d13f9d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d0c1145e0 con 0x7f5d0c1183e0 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.536+0000 7f5d13f9d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f5d0c118f20 con 0x7f5d0c113a10 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.536+0000 7f5d11d39640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5d0c113a10 0x7f5d0c113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.536+0000 7f5d11d39640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5d0c113a10 0x7f5d0c113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.80:40620/0 (socket says 172.21.15.80:40620) 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.536+0000 7f5d11538640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5d0c1183e0 0x7f5d0c1187f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.80:41170/0 (socket says 172.21.15.80:41170) 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.536+0000 7f5d11d39640 1 -- 172.21.15.80:0/576956783 learned_addr learned my addr 172.21.15.80:0/576956783 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.536+0000 7f5d11d39640 1 -- 172.21.15.80:0/576956783 >> v1:172.21.15.46:6789/0 conn(0x7f5d0c1183e0 legacy=0x7f5d0c1187f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.536+0000 7f5d11d39640 1 -- 172.21.15.80:0/576956783 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0c119090 con 0x7f5d0c113a10 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.537+0000 7f5d11d39640 1 --2- 172.21.15.80:0/576956783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 0x7f5d0c113e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87de755f9c602304 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.537+0000 7f5d10d37640 1 -- 172.21.15.80:0/576956783 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d08009e50 con 0x7f5d0c113a10 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.537+0000 7f5d10d37640 1 -- 172.21.15.80:0/576956783 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d0800e230 con 0x7f5d0c113a10 2024-05-08T02:45:21.541 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.537+0000 7f5d10d37640 1 -- 172.21.15.80:0/576956783 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d0800e4d0 con 0x7f5d0c113a10 2024-05-08T02:45:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.537+0000 7f5d13f9d640 1 -- 172.21.15.80:0/576956783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 msgr2=0x7f5d0c113e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.537+0000 7f5d13f9d640 1 --2- 172.21.15.80:0/576956783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 0x7f5d0c113e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.538+0000 7f5d13f9d640 1 -- 172.21.15.80:0/576956783 shutdown_connections 2024-05-08T02:45:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.538+0000 7f5d13f9d640 1 --2- 172.21.15.80:0/576956783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 0x7f5d0c113e20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.538+0000 7f5d13f9d640 1 -- 172.21.15.80:0/576956783 >> 172.21.15.80:0/576956783 conn(0x7f5d0c06ef30 msgr2=0x7f5d0c111d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.538+0000 7f5d13f9d640 1 -- 172.21.15.80:0/576956783 shutdown_connections 2024-05-08T02:45:21.544 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.538+0000 7f5d13f9d640 1 -- 172.21.15.80:0/576956783 wait complete. 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.538+0000 7f5d13f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.538+0000 7f5d13f9d640 1 Processor -- start 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.538+0000 7f5d13f9d640 1 -- start start 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.539+0000 7f5d13f9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 0x7f5d0c1ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.539+0000 7f5d13f9d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0c1ae770 con 0x7f5d0c113a10 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.539+0000 7f5d11d39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 0x7f5d0c1ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.539+0000 7f5d11d39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 0x7f5d0c1ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.80:40630/0 (socket says 172.21.15.80:40630) 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.539+0000 7f5d11d39640 1 -- 172.21.15.80:0/238106485 learned_addr learned my addr 172.21.15.80:0/238106485 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.539+0000 7f5d11d39640 1 -- 172.21.15.80:0/238106485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0c1ae8b0 con 0x7f5d0c113a10 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.540+0000 7f5d11d39640 1 --2- 172.21.15.80:0/238106485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 0x7f5d0c1ae1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.540+0000 7f5d027fc640 1 -- 172.21.15.80:0/238106485 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d0800ee80 con 0x7f5d0c113a10 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.540+0000 7f5d027fc640 1 -- 172.21.15.80:0/238106485 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d08015420 con 0x7f5d0c113a10 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.540+0000 7f5d13f9d640 1 -- 172.21.15.80:0/238106485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0c1aeaa0 con 0x7f5d0c113a10 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.540+0000 7f5d027fc640 1 -- 172.21.15.80:0/238106485 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d080156c0 con 0x7f5d0c113a10 2024-05-08T02:45:21.545 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.540+0000 7f5d13f9d640 1 -- 172.21.15.80:0/238106485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0c1a8500 con 0x7f5d0c113a10 2024-05-08T02:45:21.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.540+0000 7f5d027fc640 1 -- 172.21.15.80:0/238106485 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f5d08015c00 con 0x7f5d0c113a10 2024-05-08T02:45:21.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.540+0000 7f5d027fc640 1 -- 172.21.15.80:0/238106485 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f5d080116d0 con 0x7f5d0c113a10 2024-05-08T02:45:21.546 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.541+0000 7f5d13f9d640 1 -- 172.21.15.80:0/238106485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0c1aec90 con 0x7f5d0c113a10 2024-05-08T02:45:21.547 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.543+0000 7f5d027fc640 1 -- 172.21.15.80:0/238106485 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f5d08011930 con 0x7f5d0c113a10 2024-05-08T02:45:21.617 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:21.613+0000 7f528e82e000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T02:45:21.620 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.616+0000 7f5d13f9d640 1 -- 172.21.15.80:0/238106485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b109fb80-69d6-4e98-b5a0-5244abc7c70a", "id": 0} v 0) -- 0x7f5d0c0008d0 con 0x7f5d0c113a10 2024-05-08T02:45:21.622 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.618+0000 7f5d027fc640 1 -- 172.21.15.80:0/238106485 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b109fb80-69d6-4e98-b5a0-5244abc7c70a", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f5d08011ad0 con 0x7f5d0c113a10 2024-05-08T02:45:21.622 INFO:teuthology.orchestra.run.smithi080.stdout:0 2024-05-08T02:45:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.619+0000 7f5d13f9d640 1 -- 172.21.15.80:0/238106485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 msgr2=0x7f5d0c1ae1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.619+0000 7f5d13f9d640 1 --2- 172.21.15.80:0/238106485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 0x7f5d0c1ae1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.619+0000 7f5d13f9d640 1 -- 172.21.15.80:0/238106485 shutdown_connections 2024-05-08T02:45:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.619+0000 7f5d13f9d640 1 --2- 172.21.15.80:0/238106485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5d0c113a10 0x7f5d0c1ae1a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.619+0000 7f5d13f9d640 1 -- 172.21.15.80:0/238106485 >> 172.21.15.80:0/238106485 conn(0x7f5d0c06ef30 msgr2=0x7f5d0c111e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.619+0000 7f5d13f9d640 1 -- 172.21.15.80:0/238106485 shutdown_connections 2024-05-08T02:45:21.623 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.619+0000 7f5d13f9d640 1 -- 172.21.15.80:0/238106485 wait complete. 2024-05-08T02:45:21.633 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 2d6fc267-c018-4cfd-b873-7f310b704694 1 2024-05-08T02:45:21.711 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:21.708+0000 7f528e82e000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T02:45:21.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.731+0000 7fc31286d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:21.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.737+0000 7fc31286d640 1 Processor -- start 2024-05-08T02:45:21.741 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.737+0000 7fc31286d640 1 -- start start 2024-05-08T02:45:21.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.738+0000 7fc31286d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc30c11c6b0 0x7fc30c11ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:21.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.738+0000 7fc31286d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc30c11f0a0 con 0x7fc30c113a10 2024-05-08T02:45:21.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.738+0000 7fc31286d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc30c120240 con 0x7fc30c11c6b0 2024-05-08T02:45:21.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.738+0000 7fc30b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc30c11c6b0 0x7fc30c11ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:21.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.738+0000 7fc30bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc30c113a10 0x7fc30c113e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.80:41180/0 (socket says 172.21.15.80:41180) 2024-05-08T02:45:21.743 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.738+0000 7fc30b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc30c11c6b0 0x7fc30c11ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.80:40646/0 (socket says 172.21.15.80:40646) 2024-05-08T02:45:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.738+0000 7fc30bfff640 1 -- 172.21.15.80:0/2349926368 learned_addr learned my addr 172.21.15.80:0/2349926368 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T02:45:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.739+0000 7fc30b7fe640 1 -- 172.21.15.80:0/2349926368 >> v1:172.21.15.46:6789/0 conn(0x7fc30c113a10 legacy=0x7fc30c113e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.739+0000 7fc30b7fe640 1 -- 172.21.15.80:0/2349926368 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c120380 con 0x7fc30c11c6b0 2024-05-08T02:45:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.739+0000 7fc30affd640 1 -- 172.21.15.80:0/2349926368 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3938378604 0 0) 0x7fc30c11f0a0 con 0x7fc30c113a10 2024-05-08T02:45:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.739+0000 7fc30b7fe640 1 --2- 172.21.15.80:0/2349926368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c11c6b0 0x7fc30c11ead0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f530c6fcd5f0c9c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.739+0000 7fc30affd640 1 -- 172.21.15.80:0/2349926368 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc2fc009d90 con 0x7fc30c11c6b0 2024-05-08T02:45:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.739+0000 7fc30affd640 1 -- 172.21.15.80:0/2349926368 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc2fc00e230 con 0x7fc30c11c6b0 2024-05-08T02:45:21.744 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.739+0000 7fc30affd640 1 -- 172.21.15.80:0/2349926368 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc2fc00e4d0 con 0x7fc30c11c6b0 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.740+0000 7fc31286d640 1 -- 172.21.15.80:0/2349926368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c11c6b0 msgr2=0x7fc30c11ead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.740+0000 7fc31286d640 1 --2- 172.21.15.80:0/2349926368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c11c6b0 0x7fc30c11ead0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.740+0000 7fc31286d640 1 -- 172.21.15.80:0/2349926368 shutdown_connections 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.740+0000 7fc31286d640 1 --2- 172.21.15.80:0/2349926368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c11c6b0 0x7fc30c11ead0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.740+0000 7fc31286d640 1 -- 172.21.15.80:0/2349926368 >> 172.21.15.80:0/2349926368 conn(0x7fc30c06ef30 msgr2=0x7fc30c111d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.740+0000 7fc31286d640 1 -- 172.21.15.80:0/2349926368 shutdown_connections 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.740+0000 7fc31286d640 1 -- 172.21.15.80:0/2349926368 wait complete. 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.740+0000 7fc31286d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.741+0000 7fc31286d640 1 Processor -- start 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.741+0000 7fc31286d640 1 -- start start 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.741+0000 7fc31286d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c113a10 0x7fc30c1adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.741+0000 7fc31286d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c1ae5b0 con 0x7fc30c113a10 2024-05-08T02:45:21.747 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc30bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c113a10 0x7fc30c1adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc30bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c113a10 0x7fc30c1adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.80:40660/0 (socket says 172.21.15.80:40660) 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc30bfff640 1 -- 172.21.15.80:0/2347552645 learned_addr learned my addr 172.21.15.80:0/2347552645 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc30bfff640 1 -- 172.21.15.80:0/2347552645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c1ae6f0 con 0x7fc30c113a10 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc30bfff640 1 --2- 172.21.15.80:0/2347552645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c113a10 0x7fc30c1adfe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc308ff9640 1 -- 172.21.15.80:0/2347552645 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc2f4004b80 con 0x7fc30c113a10 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc308ff9640 1 -- 172.21.15.80:0/2347552645 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc2f4004ce0 con 0x7fc30c113a10 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc31286d640 1 -- 172.21.15.80:0/2347552645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30c1ae940 con 0x7fc30c113a10 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc308ff9640 1 -- 172.21.15.80:0/2347552645 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc2f4007120 con 0x7fc30c113a10 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.742+0000 7fc31286d640 1 -- 172.21.15.80:0/2347552645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30c1a8340 con 0x7fc30c113a10 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.743+0000 7fc308ff9640 1 -- 172.21.15.80:0/2347552645 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fc2f400c610 con 0x7fc30c113a10 2024-05-08T02:45:21.748 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.743+0000 7fc308ff9640 1 -- 172.21.15.80:0/2347552645 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7fc2f400fb90 con 0x7fc30c113a10 2024-05-08T02:45:21.749 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.743+0000 7fc31286d640 1 -- 172.21.15.80:0/2347552645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30c1aeb30 con 0x7fc30c113a10 2024-05-08T02:45:21.750 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.746+0000 7fc308ff9640 1 -- 172.21.15.80:0/2347552645 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7fc2f4007660 con 0x7fc30c113a10 2024-05-08T02:45:21.756 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:21.752+0000 7f528e82e000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T02:45:21.822 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.818+0000 7fc31286d640 1 -- 172.21.15.80:0/2347552645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d6fc267-c018-4cfd-b873-7f310b704694", "id": 1} v 0) -- 0x7fc30c11c750 con 0x7fc30c113a10 2024-05-08T02:45:21.823 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.820+0000 7fc308ff9640 1 -- 172.21.15.80:0/2347552645 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d6fc267-c018-4cfd-b873-7f310b704694", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7fc2f400f230 con 0x7fc30c113a10 2024-05-08T02:45:21.824 INFO:teuthology.orchestra.run.smithi080.stdout:1 2024-05-08T02:45:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.820+0000 7fc31286d640 1 -- 172.21.15.80:0/2347552645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c113a10 msgr2=0x7fc30c1adfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.820+0000 7fc31286d640 1 --2- 172.21.15.80:0/2347552645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c113a10 0x7fc30c1adfe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.820+0000 7fc31286d640 1 -- 172.21.15.80:0/2347552645 shutdown_connections 2024-05-08T02:45:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.820+0000 7fc31286d640 1 --2- 172.21.15.80:0/2347552645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc30c113a10 0x7fc30c1adfe0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.821+0000 7fc31286d640 1 -- 172.21.15.80:0/2347552645 >> 172.21.15.80:0/2347552645 conn(0x7fc30c06ef30 msgr2=0x7fc30c11cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.821+0000 7fc31286d640 1 -- 172.21.15.80:0/2347552645 shutdown_connections 2024-05-08T02:45:21.825 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.821+0000 7fc31286d640 1 -- 172.21.15.80:0/2347552645 wait complete. 2024-05-08T02:45:21.835 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new d39b74fe-9bab-4194-8443-20462cbf2445 2 2024-05-08T02:45:21.932 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:21.928+0000 7f528e82e000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T02:45:21.943 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.934+0000 7fe673b1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:21.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.940+0000 7fe673b1d640 1 Processor -- start 2024-05-08T02:45:21.944 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.940+0000 7fe673b1d640 1 -- start start 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.941+0000 7fe673b1d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe66c113a10 0x7fe66c113e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.941+0000 7fe673b1d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe66c1145e0 con 0x7fe66c1183e0 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.941+0000 7fe673b1d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fe66c118f20 con 0x7fe66c113a10 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.941+0000 7fe6718b9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe66c113a10 0x7fe66c113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.941+0000 7fe6710b8640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe66c1183e0 0x7fe66c1187f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.80:41192/0 (socket says 172.21.15.80:41192) 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.941+0000 7fe6710b8640 1 -- 172.21.15.80:0/2181658189 learned_addr learned my addr 172.21.15.80:0/2181658189 (peer_addr_for_me v1:172.21.15.80:0/0) 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.941+0000 7fe6718b9640 1 -- 172.21.15.80:0/2181658189 >> v1:172.21.15.46:6789/0 conn(0x7fe66c1183e0 legacy=0x7fe66c1187f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.941+0000 7fe6718b9640 1 -- 172.21.15.80:0/2181658189 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c119090 con 0x7fe66c113a10 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.941+0000 7fe6718b9640 1 --2- 172.21.15.80:0/2181658189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 0x7fe66c113e20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6a4001a977e76e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.942+0000 7fe6708b7640 1 -- 172.21.15.80:0/2181658189 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe65c009d90 con 0x7fe66c113a10 2024-05-08T02:45:21.946 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.942+0000 7fe6708b7640 1 -- 172.21.15.80:0/2181658189 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe65c00e230 con 0x7fe66c113a10 2024-05-08T02:45:21.947 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.942+0000 7fe6708b7640 1 -- 172.21.15.80:0/2181658189 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe65c00e4d0 con 0x7fe66c113a10 2024-05-08T02:45:21.949 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.942+0000 7fe673b1d640 1 -- 172.21.15.80:0/2181658189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 msgr2=0x7fe66c113e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.942+0000 7fe673b1d640 1 --2- 172.21.15.80:0/2181658189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 0x7fe66c113e20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.942+0000 7fe673b1d640 1 -- 172.21.15.80:0/2181658189 shutdown_connections 2024-05-08T02:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.942+0000 7fe673b1d640 1 --2- 172.21.15.80:0/2181658189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 0x7fe66c113e20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.942+0000 7fe673b1d640 1 -- 172.21.15.80:0/2181658189 >> 172.21.15.80:0/2181658189 conn(0x7fe66c06ef30 msgr2=0x7fe66c111d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.943+0000 7fe673b1d640 1 -- 172.21.15.80:0/2181658189 shutdown_connections 2024-05-08T02:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.943+0000 7fe673b1d640 1 -- 172.21.15.80:0/2181658189 wait complete. 2024-05-08T02:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.943+0000 7fe673b1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.943+0000 7fe673b1d640 1 Processor -- start 2024-05-08T02:45:21.950 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.943+0000 7fe673b1d640 1 -- start start 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.944+0000 7fe673b1d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 0x7fe66c1ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.944+0000 7fe673b1d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1ae770 con 0x7fe66c113a10 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.944+0000 7fe6718b9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 0x7fe66c1ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.944+0000 7fe6718b9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 0x7fe66c1ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.80:40686/0 (socket says 172.21.15.80:40686) 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.944+0000 7fe6718b9640 1 -- 172.21.15.80:0/1137179448 learned_addr learned my addr 172.21.15.80:0/1137179448 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.944+0000 7fe6718b9640 1 -- 172.21.15.80:0/1137179448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c1ae8b0 con 0x7fe66c113a10 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.945+0000 7fe6718b9640 1 --2- 172.21.15.80:0/1137179448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 0x7fe66c1ae1a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.945+0000 7fe6627fc640 1 -- 172.21.15.80:0/1137179448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe65c014750 con 0x7fe66c113a10 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.945+0000 7fe6627fc640 1 -- 172.21.15.80:0/1137179448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe65c0148b0 con 0x7fe66c113a10 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.945+0000 7fe6627fc640 1 -- 172.21.15.80:0/1137179448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe65c014b50 con 0x7fe66c113a10 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.945+0000 7fe673b1d640 1 -- 172.21.15.80:0/1137179448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66c1aeaa0 con 0x7fe66c113a10 2024-05-08T02:45:21.951 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.945+0000 7fe673b1d640 1 -- 172.21.15.80:0/1137179448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66c1a8500 con 0x7fe66c113a10 2024-05-08T02:45:21.953 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.945+0000 7fe6627fc640 1 -- 172.21.15.80:0/1137179448 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fe65c013790 con 0x7fe66c113a10 2024-05-08T02:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.945+0000 7fe6627fc640 1 -- 172.21.15.80:0/1137179448 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7fe65c019040 con 0x7fe66c113a10 2024-05-08T02:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.946+0000 7fe673b1d640 1 -- 172.21.15.80:0/1137179448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66c1aec90 con 0x7fe66c113a10 2024-05-08T02:45:21.954 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:21.948+0000 7fe6627fc640 1 -- 172.21.15.80:0/1137179448 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7fe65c014d00 con 0x7fe66c113a10 2024-05-08T02:45:21.993 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:21.989+0000 7f528e82e000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T02:45:22.024 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.020+0000 7fe673b1d640 1 -- 172.21.15.80:0/1137179448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d39b74fe-9bab-4194-8443-20462cbf2445", "id": 2} v 0) -- 0x7fe66c0008d0 con 0x7fe66c113a10 2024-05-08T02:45:22.026 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.022+0000 7fe6627fc640 1 -- 172.21.15.80:0/1137179448 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d39b74fe-9bab-4194-8443-20462cbf2445", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7fe65c013c20 con 0x7fe66c113a10 2024-05-08T02:45:22.026 INFO:teuthology.orchestra.run.smithi080.stdout:2 2024-05-08T02:45:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.023+0000 7fe673b1d640 1 -- 172.21.15.80:0/1137179448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 msgr2=0x7fe66c1ae1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.023+0000 7fe673b1d640 1 --2- 172.21.15.80:0/1137179448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 0x7fe66c1ae1a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.023+0000 7fe673b1d640 1 -- 172.21.15.80:0/1137179448 shutdown_connections 2024-05-08T02:45:22.027 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.023+0000 7fe673b1d640 1 --2- 172.21.15.80:0/1137179448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe66c113a10 0x7fe66c1ae1a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.023+0000 7fe673b1d640 1 -- 172.21.15.80:0/1137179448 >> 172.21.15.80:0/1137179448 conn(0x7fe66c06ef30 msgr2=0x7fe66c111e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:22.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.023+0000 7fe673b1d640 1 -- 172.21.15.80:0/1137179448 shutdown_connections 2024-05-08T02:45:22.028 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.023+0000 7fe673b1d640 1 -- 172.21.15.80:0/1137179448 wait complete. 2024-05-08T02:45:22.037 DEBUG:teuthology.orchestra.run.smithi080:> sudo ceph --cluster ceph osd new 9c4e5819-7dd8-4be4-bc0a-74351c97b323 3 2024-05-08T02:45:22.052 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:22.048+0000 7f528e82e000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T02:45:22.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.136+0000 7ff2322ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:22.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.142+0000 7ff2322ad640 1 Processor -- start 2024-05-08T02:45:22.146 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.143+0000 7ff2322ad640 1 -- start start 2024-05-08T02:45:22.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.143+0000 7ff2322ad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff22c113a10 0x7ff22c113e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:22.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.143+0000 7ff2322ad640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22c1145e0 con 0x7ff22c1183e0 2024-05-08T02:45:22.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.143+0000 7ff2322ad640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ff22c118f20 con 0x7ff22c113a10 2024-05-08T02:45:22.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.143+0000 7ff22bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff22c113a10 0x7ff22c113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:22.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.143+0000 7ff22bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff22c113a10 0x7ff22c113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.80:40694/0 (socket says 172.21.15.80:40694) 2024-05-08T02:45:22.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.143+0000 7ff22bfff640 1 -- 172.21.15.80:0/2331325994 learned_addr learned my addr 172.21.15.80:0/2331325994 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T02:45:22.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.143+0000 7ff22b7fe640 1 --1- 172.21.15.80:0/2331325994 >> v1:172.21.15.46:6789/0 conn(0x7ff22c1183e0 0x7ff22c1187f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.80:41204/0 (socket says 172.21.15.80:41204) 2024-05-08T02:45:22.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.144+0000 7ff22bfff640 1 -- 172.21.15.80:0/2331325994 >> v1:172.21.15.46:6789/0 conn(0x7ff22c1183e0 legacy=0x7ff22c1187f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:22.148 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.144+0000 7ff22bfff640 1 -- 172.21.15.80:0/2331325994 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c119090 con 0x7ff22c113a10 2024-05-08T02:45:22.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.144+0000 7ff22bfff640 1 --2- 172.21.15.80:0/2331325994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 0x7ff22c113e20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f596d9053211af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:22.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.144+0000 7ff22affd640 1 -- 172.21.15.80:0/2331325994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff220009e50 con 0x7ff22c113a10 2024-05-08T02:45:22.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.144+0000 7ff22affd640 1 -- 172.21.15.80:0/2331325994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff22000e230 con 0x7ff22c113a10 2024-05-08T02:45:22.149 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.144+0000 7ff22affd640 1 -- 172.21.15.80:0/2331325994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff22000e4d0 con 0x7ff22c113a10 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.145+0000 7ff2322ad640 1 -- 172.21.15.80:0/2331325994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 msgr2=0x7ff22c113e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.145+0000 7ff2322ad640 1 --2- 172.21.15.80:0/2331325994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 0x7ff22c113e20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.145+0000 7ff2322ad640 1 -- 172.21.15.80:0/2331325994 shutdown_connections 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.145+0000 7ff2322ad640 1 --2- 172.21.15.80:0/2331325994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 0x7ff22c113e20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.145+0000 7ff2322ad640 1 -- 172.21.15.80:0/2331325994 >> 172.21.15.80:0/2331325994 conn(0x7ff22c06ef30 msgr2=0x7ff22c111d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.145+0000 7ff2322ad640 1 -- 172.21.15.80:0/2331325994 shutdown_connections 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.145+0000 7ff2322ad640 1 -- 172.21.15.80:0/2331325994 wait complete. 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.145+0000 7ff2322ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.146+0000 7ff2322ad640 1 Processor -- start 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.146+0000 7ff2322ad640 1 -- start start 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.146+0000 7ff2322ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 0x7ff22c1ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:22.151 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.146+0000 7ff2322ad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c1ae770 con 0x7ff22c113a10 2024-05-08T02:45:22.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff22bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 0x7ff22c1ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:22.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff22bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 0x7ff22c1ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.80:40696/0 (socket says 172.21.15.80:40696) 2024-05-08T02:45:22.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff22bfff640 1 -- 172.21.15.80:0/2875589776 learned_addr learned my addr 172.21.15.80:0/2875589776 (peer_addr_for_me v2:172.21.15.80:0/0) 2024-05-08T02:45:22.152 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff22bfff640 1 -- 172.21.15.80:0/2875589776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c1ae8b0 con 0x7ff22c113a10 2024-05-08T02:45:22.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff22bfff640 1 --2- 172.21.15.80:0/2875589776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 0x7ff22c1ae1a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:22.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff228ff9640 1 -- 172.21.15.80:0/2875589776 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff22000eea0 con 0x7ff22c113a10 2024-05-08T02:45:22.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff228ff9640 1 -- 172.21.15.80:0/2875589776 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff220015420 con 0x7ff22c113a10 2024-05-08T02:45:22.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff2322ad640 1 -- 172.21.15.80:0/2875589776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22c1aeaa0 con 0x7ff22c113a10 2024-05-08T02:45:22.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff228ff9640 1 -- 172.21.15.80:0/2875589776 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2200156c0 con 0x7ff22c113a10 2024-05-08T02:45:22.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.147+0000 7ff2322ad640 1 -- 172.21.15.80:0/2875589776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22c1a8500 con 0x7ff22c113a10 2024-05-08T02:45:22.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.148+0000 7ff228ff9640 1 -- 172.21.15.80:0/2875589776 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7ff220015c00 con 0x7ff22c113a10 2024-05-08T02:45:22.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.148+0000 7ff228ff9640 1 -- 172.21.15.80:0/2875589776 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7ff220011830 con 0x7ff22c113a10 2024-05-08T02:45:22.153 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.149+0000 7ff2322ad640 1 -- 172.21.15.80:0/2875589776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22c1aec90 con 0x7ff22c113a10 2024-05-08T02:45:22.155 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.151+0000 7ff228ff9640 1 -- 172.21.15.80:0/2875589776 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7ff220011380 con 0x7ff22c113a10 2024-05-08T02:45:22.172 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:22.167+0000 7f528e82e000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T02:45:22.228 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.224+0000 7ff2322ad640 1 -- 172.21.15.80:0/2875589776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9c4e5819-7dd8-4be4-bc0a-74351c97b323", "id": 3} v 0) -- 0x7ff22c0008d0 con 0x7ff22c113a10 2024-05-08T02:45:22.229 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.225+0000 7ff228ff9640 1 -- 172.21.15.80:0/2875589776 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c4e5819-7dd8-4be4-bc0a-74351c97b323", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7ff220011520 con 0x7ff22c113a10 2024-05-08T02:45:22.229 INFO:teuthology.orchestra.run.smithi080.stdout:3 2024-05-08T02:45:22.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.226+0000 7ff2322ad640 1 -- 172.21.15.80:0/2875589776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 msgr2=0x7ff22c1ae1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:22.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.226+0000 7ff2322ad640 1 --2- 172.21.15.80:0/2875589776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 0x7ff22c1ae1a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.230 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.226+0000 7ff2322ad640 1 -- 172.21.15.80:0/2875589776 shutdown_connections 2024-05-08T02:45:22.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.226+0000 7ff2322ad640 1 --2- 172.21.15.80:0/2875589776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff22c113a10 0x7ff22c1ae1a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.226+0000 7ff2322ad640 1 -- 172.21.15.80:0/2875589776 >> 172.21.15.80:0/2875589776 conn(0x7ff22c06ef30 msgr2=0x7ff22c111e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:22.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.226+0000 7ff2322ad640 1 -- 172.21.15.80:0/2875589776 shutdown_connections 2024-05-08T02:45:22.231 INFO:teuthology.orchestra.run.smithi080.stderr:2024-05-08T02:45:22.226+0000 7ff2322ad640 1 -- 172.21.15.80:0/2875589776 wait complete. 2024-05-08T02:45:22.240 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-05-08T02:45:22.277 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T02:45:22.278 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-05-08T02:45:22.320 INFO:tasks.ceph.osd.0:Started 2024-05-08T02:45:22.321 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-05-08T02:45:22.355 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T02:45:22.355 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-05-08T02:45:22.397 INFO:tasks.ceph.osd.1:Started 2024-05-08T02:45:22.397 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-05-08T02:45:22.429 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T02:45:22.429 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-05-08T02:45:22.471 INFO:tasks.ceph.osd.2:Started 2024-05-08T02:45:22.472 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-05-08T02:45:22.501 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T02:45:22.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-05-08T02:45:22.543 INFO:tasks.ceph.osd.3:Started 2024-05-08T02:45:22.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T02:45:22.569 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:22.565+0000 7f528e82e000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T02:45:22.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.654+0000 7fed4c02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.660+0000 7fed4c02d640 1 Processor -- start 2024-05-08T02:45:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.660+0000 7fed4c02d640 1 -- start start 2024-05-08T02:45:22.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed4c02d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed440a0e00 0x7fed44139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed4c02d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed440a1210 con 0x7fed4409f630 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed4c02d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fed4409ddd0 con 0x7fed440a0e00 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed495c8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed440a0e00 0x7fed44139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed49dc9640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fed4409f630 0x7fed440a06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38228/0 (socket says 172.21.15.46:38228) 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed49dc9640 1 -- 172.21.15.46:0/2317781070 learned_addr learned my addr 172.21.15.46:0/2317781070 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed495c8640 1 -- 172.21.15.46:0/2317781070 >> v1:172.21.15.46:6789/0 conn(0x7fed4409f630 legacy=0x7fed440a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed495c8640 1 -- 172.21.15.46:0/2317781070 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4409fa40 con 0x7fed440a0e00 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed495c8640 1 --2- 172.21.15.46:0/2317781070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed440a0e00 0x7fed44139c60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb896060220a5d04 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed48dc7640 1 -- 172.21.15.46:0/2317781070 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed34009d90 con 0x7fed440a0e00 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed48dc7640 1 -- 172.21.15.46:0/2317781070 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed3400e230 con 0x7fed440a0e00 2024-05-08T02:45:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.662+0000 7fed48dc7640 1 -- 172.21.15.46:0/2317781070 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed3400e4d0 con 0x7fed440a0e00 2024-05-08T02:45:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.663+0000 7fed4c02d640 1 -- 172.21.15.46:0/2317781070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed440a0e00 msgr2=0x7fed44139c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.663+0000 7fed4c02d640 1 --2- 172.21.15.46:0/2317781070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed440a0e00 0x7fed44139c60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.663+0000 7fed4c02d640 1 -- 172.21.15.46:0/2317781070 shutdown_connections 2024-05-08T02:45:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.663+0000 7fed4c02d640 1 --2- 172.21.15.46:0/2317781070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed440a0e00 0x7fed44139c60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.663+0000 7fed4c02d640 1 -- 172.21.15.46:0/2317781070 >> 172.21.15.46:0/2317781070 conn(0x7fed440a3950 msgr2=0x7fed440a3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.663+0000 7fed4c02d640 1 -- 172.21.15.46:0/2317781070 shutdown_connections 2024-05-08T02:45:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.664+0000 7fed4c02d640 1 -- 172.21.15.46:0/2317781070 wait complete. 2024-05-08T02:45:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.664+0000 7fed4c02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.665+0000 7fed4c02d640 1 Processor -- start 2024-05-08T02:45:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.666+0000 7fed4c02d640 1 -- start start 2024-05-08T02:45:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.667+0000 7fed4c02d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed4409f630 0x7fed4411de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.667+0000 7fed4c02d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fed44121f80 con 0x7fed4409f630 2024-05-08T02:45:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.667+0000 7fed49dc9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed4409f630 0x7fed4411de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.667+0000 7fed49dc9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed4409f630 0x7fed4411de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46194/0 (socket says 172.21.15.46:46194) 2024-05-08T02:45:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.667+0000 7fed49dc9640 1 -- 172.21.15.46:0/1848448581 learned_addr learned my addr 172.21.15.46:0/1848448581 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.667+0000 7fed49dc9640 1 -- 172.21.15.46:0/1848448581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed44121450 con 0x7fed4409f630 2024-05-08T02:45:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.668+0000 7fed49dc9640 1 --2- 172.21.15.46:0/1848448581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed4409f630 0x7fed4411de70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.668+0000 7fed3a7fc640 1 -- 172.21.15.46:0/1848448581 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed40005a60 con 0x7fed4409f630 2024-05-08T02:45:22.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.668+0000 7fed3a7fc640 1 -- 172.21.15.46:0/1848448581 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed40005bc0 con 0x7fed4409f630 2024-05-08T02:45:22.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.668+0000 7fed4c02d640 1 -- 172.21.15.46:0/1848448581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed44132160 con 0x7fed4409f630 2024-05-08T02:45:22.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.668+0000 7fed3a7fc640 1 -- 172.21.15.46:0/1848448581 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed40005e60 con 0x7fed4409f630 2024-05-08T02:45:22.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.668+0000 7fed4c02d640 1 -- 172.21.15.46:0/1848448581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed44131e90 con 0x7fed4409f630 2024-05-08T02:45:22.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.668+0000 7fed3a7fc640 1 -- 172.21.15.46:0/1848448581 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fed4000cb10 con 0x7fed4409f630 2024-05-08T02:45:22.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.668+0000 7fed3a7fc640 1 -- 172.21.15.46:0/1848448581 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7fed4000fb60 con 0x7fed4409f630 2024-05-08T02:45:22.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.669+0000 7fed4c02d640 1 -- 172.21.15.46:0/1848448581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed44063900 con 0x7fed4409f630 2024-05-08T02:45:22.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.671+0000 7fed3a7fc640 1 -- 172.21.15.46:0/1848448581 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7fed4000fdc0 con 0x7fed4409f630 2024-05-08T02:45:22.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.735+0000 7fed4c02d640 1 -- 172.21.15.46:0/1848448581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed44073f10 con 0x7fed4409f630 2024-05-08T02:45:22.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.735+0000 7fed3a7fc640 1 -- 172.21.15.46:0/1848448581 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7fed4000f640 con 0x7fed4409f630 2024-05-08T02:45:22.739 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:45:22.740 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"fsid":"3c41076c-82d6-4569-8543-dcb021c14d35","created":"2024-05-08T02:45:20.092180+0000","modified":"2024-05-08T02:45:22.225801+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T02:45:22.225801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"b109fb80-69d6-4e98-b5a0-5244abc7c70a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d6fc267-c018-4cfd-b873-7f310b704694","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d39b74fe-9bab-4194-8443-20462cbf2445","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c4e5819-7dd8-4be4-bc0a-74351c97b323","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T02:45:22.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.736+0000 7fed4c02d640 1 -- 172.21.15.46:0/1848448581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed4409f630 msgr2=0x7fed4411de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:22.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.736+0000 7fed4c02d640 1 --2- 172.21.15.46:0/1848448581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed4409f630 0x7fed4411de70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.736+0000 7fed4c02d640 1 -- 172.21.15.46:0/1848448581 shutdown_connections 2024-05-08T02:45:22.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.736+0000 7fed4c02d640 1 --2- 172.21.15.46:0/1848448581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed4409f630 0x7fed4411de70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:22.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.736+0000 7fed4c02d640 1 -- 172.21.15.46:0/1848448581 >> 172.21.15.46:0/1848448581 conn(0x7fed440a3950 msgr2=0x7fed441bcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:22.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.736+0000 7fed4c02d640 1 -- 172.21.15.46:0/1848448581 shutdown_connections 2024-05-08T02:45:22.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:22.736+0000 7fed4c02d640 1 -- 172.21.15.46:0/1848448581 wait complete. 2024-05-08T02:45:22.751 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T02:45:22.751 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T02:45:22.856 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:22.853+0000 7f528e82e000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T02:45:22.912 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:22.908+0000 7f528e82e000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T02:45:23.036 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:23.032+0000 7f528e82e000 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T02:45:23.154 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T02:45:23.262 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.254+0000 7ff57319d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:23.264 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.260+0000 7ff57319d640 1 Processor -- start 2024-05-08T02:45:23.264 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.260+0000 7ff57319d640 1 -- start start 2024-05-08T02:45:23.266 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.261+0000 7ff57319d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff56c09fb70 0x7ff56c09ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:23.266 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.261+0000 7ff57319d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff56c06e620 con 0x7ff56c134a50 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.261+0000 7ff57319d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ff56c06f590 con 0x7ff56c09fb70 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.262+0000 7ff570f39640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff56c09fb70 0x7ff56c09ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.262+0000 7ff56bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff56c134a50 0x7ff56c134e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42182/0 (socket says 172.21.15.46:42182) 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.262+0000 7ff56bfff640 1 -- 172.21.15.46:0/2601499480 learned_addr learned my addr 172.21.15.46:0/2601499480 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.262+0000 7ff570f39640 1 -- 172.21.15.46:0/2601499480 >> v1:172.21.15.46:6789/0 conn(0x7ff56c134a50 legacy=0x7ff56c134e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.262+0000 7ff570f39640 1 -- 172.21.15.46:0/2601499480 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c06e850 con 0x7ff56c09fb70 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.262+0000 7ff570f39640 1 --2- 172.21.15.46:0/2601499480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 0x7ff56c09ff80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8688183e87c466f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.262+0000 7ff56b7fe640 1 -- 172.21.15.46:0/2601499480 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff560009d90 con 0x7ff56c09fb70 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.262+0000 7ff56b7fe640 1 -- 172.21.15.46:0/2601499480 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff56000e230 con 0x7ff56c09fb70 2024-05-08T02:45:23.267 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.262+0000 7ff56b7fe640 1 -- 172.21.15.46:0/2601499480 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff56000e4d0 con 0x7ff56c09fb70 2024-05-08T02:45:23.269 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.263+0000 7ff57319d640 1 -- 172.21.15.46:0/2601499480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 msgr2=0x7ff56c09ff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:23.269 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.263+0000 7ff57319d640 1 --2- 172.21.15.46:0/2601499480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 0x7ff56c09ff80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:23.269 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.263+0000 7ff57319d640 1 -- 172.21.15.46:0/2601499480 shutdown_connections 2024-05-08T02:45:23.269 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.263+0000 7ff57319d640 1 --2- 172.21.15.46:0/2601499480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 0x7ff56c09ff80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:23.269 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.263+0000 7ff57319d640 1 -- 172.21.15.46:0/2601499480 >> 172.21.15.46:0/2601499480 conn(0x7ff56c0a5140 msgr2=0x7ff56c0a5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:23.269 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.263+0000 7ff57319d640 1 -- 172.21.15.46:0/2601499480 shutdown_connections 2024-05-08T02:45:23.269 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.263+0000 7ff57319d640 1 -- 172.21.15.46:0/2601499480 wait complete. 2024-05-08T02:45:23.269 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.264+0000 7ff57319d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:23.270 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.265+0000 7ff57319d640 1 Processor -- start 2024-05-08T02:45:23.270 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.265+0000 7ff57319d640 1 -- start start 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.267+0000 7ff57319d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 0x7ff56c1c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.267+0000 7ff57319d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c1208b0 con 0x7ff56c09fb70 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.267+0000 7ff570f39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 0x7ff56c1c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.267+0000 7ff570f39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 0x7ff56c1c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55276/0 (socket says 172.21.15.46:55276) 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.267+0000 7ff570f39640 1 -- 172.21.15.46:0/3240113533 learned_addr learned my addr 172.21.15.46:0/3240113533 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.268+0000 7ff570f39640 1 -- 172.21.15.46:0/3240113533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c11f500 con 0x7ff56c09fb70 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.268+0000 7ff570f39640 1 --2- 172.21.15.46:0/3240113533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 0x7ff56c1c9fe0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.268+0000 7ff5697fa640 1 -- 172.21.15.46:0/3240113533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff560014540 con 0x7ff56c09fb70 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.268+0000 7ff5697fa640 1 -- 172.21.15.46:0/3240113533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff5600146a0 con 0x7ff56c09fb70 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.268+0000 7ff57319d640 1 -- 172.21.15.46:0/3240113533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56c122360 con 0x7ff56c09fb70 2024-05-08T02:45:23.273 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.268+0000 7ff5697fa640 1 -- 172.21.15.46:0/3240113533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff560014940 con 0x7ff56c09fb70 2024-05-08T02:45:23.274 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.268+0000 7ff57319d640 1 -- 172.21.15.46:0/3240113533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56c121810 con 0x7ff56c09fb70 2024-05-08T02:45:23.274 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.268+0000 7ff5697fa640 1 -- 172.21.15.46:0/3240113533 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7ff560013400 con 0x7ff56c09fb70 2024-05-08T02:45:23.274 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.268+0000 7ff5697fa640 1 -- 172.21.15.46:0/3240113533 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7ff560019040 con 0x7ff56c09fb70 2024-05-08T02:45:23.274 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.269+0000 7ff57319d640 1 -- 172.21.15.46:0/3240113533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff56c063900 con 0x7ff56c09fb70 2024-05-08T02:45:23.276 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.272+0000 7ff5697fa640 1 -- 172.21.15.46:0/3240113533 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7ff5600136b0 con 0x7ff56c09fb70 2024-05-08T02:45:23.338 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.334+0000 7ff57319d640 1 -- 172.21.15.46:0/3240113533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff56c06de00 con 0x7ff56c09fb70 2024-05-08T02:45:23.339 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.335+0000 7ff5697fa640 1 -- 172.21.15.46:0/3240113533 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7ff56c06de00 con 0x7ff56c09fb70 2024-05-08T02:45:23.339 INFO:teuthology.misc.health.smithi046.stdout: 2024-05-08T02:45:23.339 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":7,"fsid":"3c41076c-82d6-4569-8543-dcb021c14d35","created":"2024-05-08T02:45:20.092180+0000","modified":"2024-05-08T02:45:22.225801+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T02:45:22.225801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"b109fb80-69d6-4e98-b5a0-5244abc7c70a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2d6fc267-c018-4cfd-b873-7f310b704694","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d39b74fe-9bab-4194-8443-20462cbf2445","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9c4e5819-7dd8-4be4-bc0a-74351c97b323","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T02:45:23.340 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.336+0000 7ff57319d640 1 -- 172.21.15.46:0/3240113533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 msgr2=0x7ff56c1c9fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:23.340 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.336+0000 7ff57319d640 1 --2- 172.21.15.46:0/3240113533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 0x7ff56c1c9fe0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:23.341 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.336+0000 7ff57319d640 1 -- 172.21.15.46:0/3240113533 shutdown_connections 2024-05-08T02:45:23.341 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.336+0000 7ff57319d640 1 --2- 172.21.15.46:0/3240113533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff56c09fb70 0x7ff56c1c9fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:23.341 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.336+0000 7ff57319d640 1 -- 172.21.15.46:0/3240113533 >> 172.21.15.46:0/3240113533 conn(0x7ff56c0a5140 msgr2=0x7ff56c1bcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:23.341 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.336+0000 7ff57319d640 1 -- 172.21.15.46:0/3240113533 shutdown_connections 2024-05-08T02:45:23.341 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:23.336+0000 7ff57319d640 1 -- 172.21.15.46:0/3240113533 wait complete. 2024-05-08T02:45:23.343 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:23.339+0000 7f528e82e000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T02:45:23.350 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-08T02:45:23.395 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:23.391+0000 7f528e82e000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T02:45:23.564 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:23.560+0000 7f528e82e000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T02:45:23.700 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:23.696+0000 7f528e82e000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T02:45:23.752 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:23.748+0000 7f528e82e000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T02:45:23.824 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:23.820+0000 7f528e82e000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T02:45:23.871 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:23.867+0000 7f528e82e000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T02:45:24.395 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:24.391+0000 7f528e82e000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T02:45:24.517 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:24.513+0000 7f528e82e000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T02:45:25.527 INFO:tasks.ceph.mgr.x.smithi080.stderr:2024-05-08T02:45:25.523+0000 7f522d67b640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-08T02:45:29.754 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T02:45:29.867 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.858+0000 7f0ab179d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:29.868 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.864+0000 7f0ab179d640 1 Processor -- start 2024-05-08T02:45:29.868 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.864+0000 7f0ab179d640 1 -- start start 2024-05-08T02:45:29.870 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.866+0000 7f0ab179d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0aac138050 0x7f0aac13a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:29.870 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.866+0000 7f0ab179d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aac134de0 con 0x7f0aac135250 2024-05-08T02:45:29.870 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.866+0000 7f0ab179d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f0aac0a1270 con 0x7f0aac138050 2024-05-08T02:45:29.870 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.866+0000 7f0aaa7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0aac138050 0x7f0aac13a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:29.871 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.866+0000 7f0aaaffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0aac135250 0x7f0aac135660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42192/0 (socket says 172.21.15.46:42192) 2024-05-08T02:45:29.871 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.866+0000 7f0aaaffd640 1 -- 172.21.15.46:0/3304986108 learned_addr learned my addr 172.21.15.46:0/3304986108 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:29.871 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.866+0000 7f0aaa7fc640 1 -- 172.21.15.46:0/3304986108 >> v1:172.21.15.46:6789/0 conn(0x7f0aac135250 legacy=0x7f0aac135660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:29.871 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.866+0000 7f0aaa7fc640 1 -- 172.21.15.46:0/3304986108 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac06d960 con 0x7f0aac138050 2024-05-08T02:45:29.871 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.867+0000 7f0aaa7fc640 1 --2- 172.21.15.46:0/3304986108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac138050 0x7f0aac13a470 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f8b18bdec16fc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:29.872 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.867+0000 7f0aa9ffb640 1 -- 172.21.15.46:0/3304986108 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aa0009d90 con 0x7f0aac138050 2024-05-08T02:45:29.872 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.867+0000 7f0aa9ffb640 1 -- 172.21.15.46:0/3304986108 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0aa000e230 con 0x7f0aac138050 2024-05-08T02:45:29.872 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.867+0000 7f0aa9ffb640 1 -- 172.21.15.46:0/3304986108 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aa000e4d0 con 0x7f0aac138050 2024-05-08T02:45:29.872 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.868+0000 7f0ab179d640 1 -- 172.21.15.46:0/3304986108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac138050 msgr2=0x7f0aac13a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:29.872 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.868+0000 7f0ab179d640 1 --2- 172.21.15.46:0/3304986108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac138050 0x7f0aac13a470 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:29.872 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.868+0000 7f0ab179d640 1 -- 172.21.15.46:0/3304986108 shutdown_connections 2024-05-08T02:45:29.873 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.868+0000 7f0ab179d640 1 --2- 172.21.15.46:0/3304986108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac138050 0x7f0aac13a470 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:29.873 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.868+0000 7f0ab179d640 1 -- 172.21.15.46:0/3304986108 >> 172.21.15.46:0/3304986108 conn(0x7f0aac0a5c00 msgr2=0x7f0aac0a6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:29.873 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.868+0000 7f0ab179d640 1 -- 172.21.15.46:0/3304986108 shutdown_connections 2024-05-08T02:45:29.873 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.868+0000 7f0ab179d640 1 -- 172.21.15.46:0/3304986108 wait complete. 2024-05-08T02:45:29.873 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.868+0000 7f0ab179d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:29.874 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.870+0000 7f0ab179d640 1 Processor -- start 2024-05-08T02:45:29.874 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.870+0000 7f0ab179d640 1 -- start start 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.872+0000 7f0ab179d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac135250 0x7f0aac1c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.872+0000 7f0ab179d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac11d850 con 0x7f0aac135250 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.872+0000 7f0aaaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac135250 0x7f0aac1c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.872+0000 7f0aaaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac135250 0x7f0aac1c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55298/0 (socket says 172.21.15.46:55298) 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.872+0000 7f0aaaffd640 1 -- 172.21.15.46:0/4215569671 learned_addr learned my addr 172.21.15.46:0/4215569671 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.872+0000 7f0aaaffd640 1 -- 172.21.15.46:0/4215569671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac135e30 con 0x7f0aac135250 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.872+0000 7f0aaaffd640 1 --2- 172.21.15.46:0/4215569671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac135250 0x7f0aac1c6b30 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.873+0000 7f0a937fe640 1 -- 172.21.15.46:0/4215569671 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a9c005930 con 0x7f0aac135250 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.873+0000 7f0a937fe640 1 -- 172.21.15.46:0/4215569671 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0a9c005a90 con 0x7f0aac135250 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.873+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac072a50 con 0x7f0aac135250 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.873+0000 7f0a937fe640 1 -- 172.21.15.46:0/4215569671 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a9c005d30 con 0x7f0aac135250 2024-05-08T02:45:29.877 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.873+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac11e060 con 0x7f0aac135250 2024-05-08T02:45:29.878 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.874+0000 7f0a937fe640 1 -- 172.21.15.46:0/4215569671 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7f0a9c00c7b0 con 0x7f0aac135250 2024-05-08T02:45:29.878 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.874+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac1c6940 con 0x7f0aac135250 2024-05-08T02:45:29.878 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.874+0000 7f0a937fe640 1 --2- 172.21.15.46:0/4215569671 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0a980388f0 0x7f0a9803ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:29.879 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.874+0000 7f0a937fe640 1 -- 172.21.15.46:0/4215569671 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f0a9c047d60 con 0x7f0aac135250 2024-05-08T02:45:29.879 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.874+0000 7f0aaa7fc640 1 --2- 172.21.15.46:0/4215569671 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0a980388f0 0x7f0a9803ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:29.879 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.875+0000 7f0aaa7fc640 1 --2- 172.21.15.46:0/4215569671 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0a980388f0 0x7f0a9803ae00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:29.883 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:29.880+0000 7f0a937fe640 1 -- 172.21.15.46:0/4215569671 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f0a9c00d330 con 0x7f0aac135250 2024-05-08T02:45:30.071 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.067+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0aac072330 con 0x7f0aac135250 2024-05-08T02:45:30.072 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.068+0000 7f0a937fe640 1 -- 172.21.15.46:0/4215569671 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6931 (crc 0 0 0) 0x7f0a9c00d150 con 0x7f0aac135250 2024-05-08T02:45:30.072 INFO:teuthology.misc.health.smithi046.stdout: 2024-05-08T02:45:30.072 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":11,"fsid":"3c41076c-82d6-4569-8543-dcb021c14d35","created":"2024-05-08T02:45:20.092180+0000","modified":"2024-05-08T02:45:29.556654+0000","last_up_change":"2024-05-08T02:45:26.547871+0000","last_in_change":"2024-05-08T02:45:22.225801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T02:45:28.537086+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b109fb80-69d6-4e98-b5a0-5244abc7c70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6801","nonce":3562168766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3562168766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3562168766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3562168766}]},"public_addr":"172.21.15.46:6801/3562168766","cluster_addr":"172.21.15.46:6802/3562168766","heartbeat_back_addr":"172.21.15.46:6811/3562168766","heartbeat_front_addr":"172.21.15.46:6812/3562168766","state":["exists","up"]},{"osd":1,"uuid":"2d6fc267-c018-4cfd-b873-7f310b704694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2291706666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":2291706666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":2291706666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":2291706666}]},"public_addr":"172.21.15.46:6806/2291706666","cluster_addr":"172.21.15.46:6805/2291706666","heartbeat_back_addr":"172.21.15.46:6807/2291706666","heartbeat_front_addr":"172.21.15.46:6803/2291706666","state":["exists","up"]},{"osd":2,"uuid":"d39b74fe-9bab-4194-8443-20462cbf2445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":1892248062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1892248062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1892248062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":1892248062}]},"public_addr":"172.21.15.80:6805/1892248062","cluster_addr":"172.21.15.80:6804/1892248062","heartbeat_back_addr":"172.21.15.80:6808/1892248062","heartbeat_front_addr":"172.21.15.80:6809/1892248062","state":["exists","up"]},{"osd":3,"uuid":"9c4e5819-7dd8-4be4-bc0a-74351c97b323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6807","nonce":3216858417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3216858417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3216858417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6803","nonce":3216858417}]},"public_addr":"172.21.15.80:6807/3216858417","cluster_addr":"172.21.15.80:6806/3216858417","heartbeat_back_addr":"172.21.15.80:6802/3216858417","heartbeat_front_addr":"172.21.15.80:6803/3216858417","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.070+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0a980388f0 msgr2=0x7f0a9803ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.070+0000 7f0ab179d640 1 --2- 172.21.15.46:0/4215569671 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0a980388f0 0x7f0a9803ae00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.070+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac135250 msgr2=0x7f0aac1c6b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.070+0000 7f0ab179d640 1 --2- 172.21.15.46:0/4215569671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac135250 0x7f0aac1c6b30 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.070+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 shutdown_connections 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.070+0000 7f0ab179d640 1 --2- 172.21.15.46:0/4215569671 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0a980388f0 0x7f0a9803ae00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.070+0000 7f0ab179d640 1 --2- 172.21.15.46:0/4215569671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0aac135250 0x7f0aac1c6b30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.070+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 >> 172.21.15.46:0/4215569671 conn(0x7f0aac0a5c00 msgr2=0x7f0aac1bd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.070+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 shutdown_connections 2024-05-08T02:45:30.075 INFO:teuthology.misc.health.smithi046.stderr:2024-05-08T02:45:30.071+0000 7f0ab179d640 1 -- 172.21.15.46:0/4215569671 wait complete. 2024-05-08T02:45:30.085 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-05-08T02:45:30.085 INFO:tasks.ceph:Creating RBD pool 2024-05-08T02:45:30.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-08T02:45:30.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.190+0000 7f856ac6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:30.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.199+0000 7f856ac6d640 1 Processor -- start 2024-05-08T02:45:30.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.199+0000 7f856ac6d640 1 -- start start 2024-05-08T02:45:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.200+0000 7f856ac6d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f85640a0e10 0x7f8564139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.200+0000 7f856ac6d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f856409de40 con 0x7f856409ef30 2024-05-08T02:45:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.200+0000 7f856ac6d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f85640a1220 con 0x7f85640a0e10 2024-05-08T02:45:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.200+0000 7f8563fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f85640a0e10 0x7f8564139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.200+0000 7f8568a09640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f856409ef30 0x7f85640a0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42194/0 (socket says 172.21.15.46:42194) 2024-05-08T02:45:30.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.200+0000 7f8568a09640 1 -- 172.21.15.46:0/3263504877 learned_addr learned my addr 172.21.15.46:0/3263504877 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.201+0000 7f8563fff640 1 -- 172.21.15.46:0/3263504877 >> v1:172.21.15.46:6789/0 conn(0x7f856409ef30 legacy=0x7f85640a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.201+0000 7f8563fff640 1 -- 172.21.15.46:0/3263504877 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85640a03f0 con 0x7f85640a0e10 2024-05-08T02:45:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.201+0000 7f8563fff640 1 --2- 172.21.15.46:0/3263504877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85640a0e10 0x7f8564139bf0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e084e49ee95e75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.201+0000 7f85637fe640 1 -- 172.21.15.46:0/3263504877 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8550009d90 con 0x7f85640a0e10 2024-05-08T02:45:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.201+0000 7f85637fe640 1 -- 172.21.15.46:0/3263504877 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f855000e230 con 0x7f85640a0e10 2024-05-08T02:45:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.201+0000 7f85637fe640 1 -- 172.21.15.46:0/3263504877 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f855000e4d0 con 0x7f85640a0e10 2024-05-08T02:45:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.202+0000 7f856ac6d640 1 -- 172.21.15.46:0/3263504877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85640a0e10 msgr2=0x7f8564139bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.202+0000 7f856ac6d640 1 --2- 172.21.15.46:0/3263504877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85640a0e10 0x7f8564139bf0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.202+0000 7f856ac6d640 1 -- 172.21.15.46:0/3263504877 shutdown_connections 2024-05-08T02:45:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.202+0000 7f856ac6d640 1 --2- 172.21.15.46:0/3263504877 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85640a0e10 0x7f8564139bf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.202+0000 7f856ac6d640 1 -- 172.21.15.46:0/3263504877 >> 172.21.15.46:0/3263504877 conn(0x7f856406be40 msgr2=0x7f856406c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.202+0000 7f856ac6d640 1 -- 172.21.15.46:0/3263504877 shutdown_connections 2024-05-08T02:45:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.202+0000 7f856ac6d640 1 -- 172.21.15.46:0/3263504877 wait complete. 2024-05-08T02:45:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.202+0000 7f856ac6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:30.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.204+0000 7f856ac6d640 1 Processor -- start 2024-05-08T02:45:30.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.204+0000 7f856ac6d640 1 -- start start 2024-05-08T02:45:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.206+0000 7f856ac6d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856409ef30 0x7f85641c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.206+0000 7f856ac6d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f856411f1b0 con 0x7f856409ef30 2024-05-08T02:45:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.206+0000 7f8568a09640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856409ef30 0x7f85641c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.206+0000 7f8568a09640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856409ef30 0x7f85641c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55318/0 (socket says 172.21.15.46:55318) 2024-05-08T02:45:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.206+0000 7f8568a09640 1 -- 172.21.15.46:0/1056932993 learned_addr learned my addr 172.21.15.46:0/1056932993 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.207+0000 7f8568a09640 1 -- 172.21.15.46:0/1056932993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85641395c0 con 0x7f856409ef30 2024-05-08T02:45:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.207+0000 7f8568a09640 1 --2- 172.21.15.46:0/1056932993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856409ef30 0x7f85641c96d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.207+0000 7f85617fa640 1 -- 172.21.15.46:0/1056932993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8558005a60 con 0x7f856409ef30 2024-05-08T02:45:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.207+0000 7f85617fa640 1 -- 172.21.15.46:0/1056932993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8558005bc0 con 0x7f856409ef30 2024-05-08T02:45:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.207+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85641398d0 con 0x7f856409ef30 2024-05-08T02:45:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.207+0000 7f85617fa640 1 -- 172.21.15.46:0/1056932993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8558005e60 con 0x7f856409ef30 2024-05-08T02:45:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.207+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856411f8e0 con 0x7f856409ef30 2024-05-08T02:45:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.208+0000 7f85617fa640 1 -- 172.21.15.46:0/1056932993 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7f855800c780 con 0x7f856409ef30 2024-05-08T02:45:30.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.208+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8564063900 con 0x7f856409ef30 2024-05-08T02:45:30.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.208+0000 7f85617fa640 1 --2- 172.21.15.46:0/1056932993 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f85480388f0 0x7f854803ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:30.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.208+0000 7f85617fa640 1 -- 172.21.15.46:0/1056932993 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f8558047f80 con 0x7f856409ef30 2024-05-08T02:45:30.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.208+0000 7f8563fff640 1 --2- 172.21.15.46:0/1056932993 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f85480388f0 0x7f854803ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:30.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.209+0000 7f8563fff640 1 --2- 172.21.15.46:0/1056932993 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f85480388f0 0x7f854803ae00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:30.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.214+0000 7f85617fa640 1 -- 172.21.15.46:0/1056932993 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f855800d330 con 0x7f856409ef30 2024-05-08T02:45:30.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.401+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f8564073f10 con 0x7f856409ef30 2024-05-08T02:45:30.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.560+0000 7f85617fa640 1 -- 172.21.15.46:0/1056932993 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7f855800d150 con 0x7f856409ef30 2024-05-08T02:45:30.564 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'rbd' created 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.562+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f85480388f0 msgr2=0x7f854803ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.562+0000 7f856ac6d640 1 --2- 172.21.15.46:0/1056932993 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f85480388f0 0x7f854803ae00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.562+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856409ef30 msgr2=0x7f85641c96d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.562+0000 7f856ac6d640 1 --2- 172.21.15.46:0/1056932993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856409ef30 0x7f85641c96d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.563+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 shutdown_connections 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.563+0000 7f856ac6d640 1 --2- 172.21.15.46:0/1056932993 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f85480388f0 0x7f854803ae00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.563+0000 7f856ac6d640 1 --2- 172.21.15.46:0/1056932993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f856409ef30 0x7f85641c96d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.563+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 >> 172.21.15.46:0/1056932993 conn(0x7f856406be40 msgr2=0x7f856409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.563+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 shutdown_connections 2024-05-08T02:45:30.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.563+0000 7f856ac6d640 1 -- 172.21.15.46:0/1056932993 wait complete. 2024-05-08T02:45:30.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-08T02:45:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.698+0000 7ff79946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:30.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.709+0000 7ff79946d640 1 Processor -- start 2024-05-08T02:45:30.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.709+0000 7ff79946d640 1 -- start start 2024-05-08T02:45:30.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.710+0000 7ff79946d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff79409ea00 0x7ff794132de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:30.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.710+0000 7ff79946d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff794073ea0 con 0x7ff79409e5f0 2024-05-08T02:45:30.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.710+0000 7ff79946d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ff7940a15a0 con 0x7ff79409ea00 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.710+0000 7ff78a7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff79409ea00 0x7ff794132de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.710+0000 7ff792ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff79409e5f0 0x7ff7941326d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42200/0 (socket says 172.21.15.46:42200) 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.710+0000 7ff792ffd640 1 -- 172.21.15.46:0/3313178039 learned_addr learned my addr 172.21.15.46:0/3313178039 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.711+0000 7ff78a7fc640 1 -- 172.21.15.46:0/3313178039 >> v1:172.21.15.46:6789/0 conn(0x7ff79409e5f0 legacy=0x7ff7941326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.711+0000 7ff7927fc640 1 -- 172.21.15.46:0/3313178039 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1573148999 0 0) 0x7ff794073ea0 con 0x7ff79409e5f0 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.711+0000 7ff78a7fc640 1 -- 172.21.15.46:0/3313178039 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79409e1c0 con 0x7ff79409ea00 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.711+0000 7ff78a7fc640 1 --2- 172.21.15.46:0/3313178039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409ea00 0x7ff794132de0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68c526472bcfd2c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.711+0000 7ff7927fc640 1 -- 172.21.15.46:0/3313178039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff77c009d90 con 0x7ff79409ea00 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.711+0000 7ff7927fc640 1 -- 172.21.15.46:0/3313178039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff77c00e230 con 0x7ff79409ea00 2024-05-08T02:45:30.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.711+0000 7ff7927fc640 1 -- 172.21.15.46:0/3313178039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff77c00e4d0 con 0x7ff79409ea00 2024-05-08T02:45:30.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.712+0000 7ff79946d640 1 -- 172.21.15.46:0/3313178039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409ea00 msgr2=0x7ff794132de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:30.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.712+0000 7ff79946d640 1 --2- 172.21.15.46:0/3313178039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409ea00 0x7ff794132de0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.712+0000 7ff79946d640 1 -- 172.21.15.46:0/3313178039 shutdown_connections 2024-05-08T02:45:30.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.712+0000 7ff79946d640 1 --2- 172.21.15.46:0/3313178039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409ea00 0x7ff794132de0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:30.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.712+0000 7ff79946d640 1 -- 172.21.15.46:0/3313178039 >> 172.21.15.46:0/3313178039 conn(0x7ff7940a1b30 msgr2=0x7ff7940a1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:30.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.712+0000 7ff79946d640 1 -- 172.21.15.46:0/3313178039 shutdown_connections 2024-05-08T02:45:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.712+0000 7ff79946d640 1 -- 172.21.15.46:0/3313178039 wait complete. 2024-05-08T02:45:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.712+0000 7ff79946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.714+0000 7ff79946d640 1 Processor -- start 2024-05-08T02:45:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.714+0000 7ff79946d640 1 -- start start 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff79946d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409e5f0 0x7ff79411bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff79946d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff7941302f0 con 0x7ff79409e5f0 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff792ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409e5f0 0x7ff79411bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff792ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409e5f0 0x7ff79411bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55344/0 (socket says 172.21.15.46:55344) 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff792ffd640 1 -- 172.21.15.46:0/3394826979 learned_addr learned my addr 172.21.15.46:0/3394826979 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff792ffd640 1 -- 172.21.15.46:0/3394826979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79411fef0 con 0x7ff79409e5f0 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff792ffd640 1 --2- 172.21.15.46:0/3394826979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409e5f0 0x7ff79411bdb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff78bfff640 1 -- 172.21.15.46:0/3394826979 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff784004b80 con 0x7ff79409e5f0 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff78bfff640 1 -- 172.21.15.46:0/3394826979 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff784004ce0 con 0x7ff79409e5f0 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79411cf40 con 0x7ff79409e5f0 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff78bfff640 1 -- 172.21.15.46:0/3394826979 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff784007120 con 0x7ff79409e5f0 2024-05-08T02:45:30.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.716+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff79411f230 con 0x7ff79409e5f0 2024-05-08T02:45:30.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.717+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff79406d6c0 con 0x7ff79409e5f0 2024-05-08T02:45:30.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.717+0000 7ff78bfff640 1 -- 172.21.15.46:0/3394826979 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7ff7840072d0 con 0x7ff79409e5f0 2024-05-08T02:45:30.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.718+0000 7ff78bfff640 1 --2- 172.21.15.46:0/3394826979 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff7740388f0 0x7ff77403ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:30.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.718+0000 7ff78bfff640 1 -- 172.21.15.46:0/3394826979 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7ff7840481f0 con 0x7ff79409e5f0 2024-05-08T02:45:30.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.718+0000 7ff78a7fc640 1 --2- 172.21.15.46:0/3394826979 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff7740388f0 0x7ff77403ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:30.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.719+0000 7ff78a7fc640 1 --2- 172.21.15.46:0/3394826979 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff7740388f0 0x7ff77403ae00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:30.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.723+0000 7ff78bfff640 1 -- 172.21.15.46:0/3394826979 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ff78400a9e0 con 0x7ff79409e5f0 2024-05-08T02:45:30.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:30.911+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7ff79411f6e0 con 0x7ff79409e5f0 2024-05-08T02:45:31.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.491+0000 7ff78bfff640 1 -- 172.21.15.46:0/3394826979 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff784007580 con 0x7ff79409e5f0 2024-05-08T02:45:31.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.567+0000 7ff78bfff640 1 -- 172.21.15.46:0/3394826979 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 173+0+0 (crc 0 0 0) 0x7ff7840477e0 con 0x7ff79409e5f0 2024-05-08T02:45:31.571 INFO:teuthology.orchestra.run.smithi046.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-08T02:45:31.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.571+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff7740388f0 msgr2=0x7ff77403ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:31.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.571+0000 7ff79946d640 1 --2- 172.21.15.46:0/3394826979 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff7740388f0 0x7ff77403ae00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.571+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409e5f0 msgr2=0x7ff79411bdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.571+0000 7ff79946d640 1 --2- 172.21.15.46:0/3394826979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409e5f0 0x7ff79411bdb0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.571+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 shutdown_connections 2024-05-08T02:45:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.571+0000 7ff79946d640 1 --2- 172.21.15.46:0/3394826979 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff7740388f0 0x7ff77403ae00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.571+0000 7ff79946d640 1 --2- 172.21.15.46:0/3394826979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff79409e5f0 0x7ff79411bdb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.571+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 >> 172.21.15.46:0/3394826979 conn(0x7ff7940a1b30 msgr2=0x7ff7941ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.572+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 shutdown_connections 2024-05-08T02:45:31.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.572+0000 7ff79946d640 1 -- 172.21.15.46:0/3394826979 wait complete. 2024-05-08T02:45:31.593 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T02:45:31.593 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T02:45:31.593 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T02:45:31.593 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T02:45:31.594 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T02:45:31.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.723+0000 7f4f5606d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:31.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.728+0000 7f4f5606d640 1 Processor -- start 2024-05-08T02:45:31.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.728+0000 7f4f5606d640 1 -- start start 2024-05-08T02:45:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.729+0000 7f4f5606d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4f5009ce30 0x7f4f50132c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.729+0000 7f4f5606d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5009dc80 con 0x7f4f501331b0 2024-05-08T02:45:31.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.729+0000 7f4f5606d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f4f5009c440 con 0x7f4f5009ce30 2024-05-08T02:45:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.729+0000 7f4f4f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4f5009ce30 0x7f4f50132c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.729+0000 7f4f4effd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4f501331b0 0x7f4f500a0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42208/0 (socket says 172.21.15.46:42208) 2024-05-08T02:45:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.730+0000 7f4f4effd640 1 -- 172.21.15.46:0/2187924856 learned_addr learned my addr 172.21.15.46:0/2187924856 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.730+0000 7f4f4f7fe640 1 -- 172.21.15.46:0/2187924856 >> v1:172.21.15.46:6789/0 conn(0x7f4f501331b0 legacy=0x7f4f500a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.730+0000 7f4f4f7fe640 1 -- 172.21.15.46:0/2187924856 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f50132840 con 0x7f4f5009ce30 2024-05-08T02:45:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.730+0000 7f4f4f7fe640 1 --2- 172.21.15.46:0/2187924856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 0x7f4f50132c70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c82dcc634d3eb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.730+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/2187924856 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f40009d90 con 0x7f4f5009ce30 2024-05-08T02:45:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.730+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/2187924856 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4f4000e230 con 0x7f4f5009ce30 2024-05-08T02:45:31.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.730+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/2187924856 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f4000e4d0 con 0x7f4f5009ce30 2024-05-08T02:45:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.731+0000 7f4f5606d640 1 -- 172.21.15.46:0/2187924856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 msgr2=0x7f4f50132c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.731+0000 7f4f5606d640 1 --2- 172.21.15.46:0/2187924856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 0x7f4f50132c70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.731+0000 7f4f5606d640 1 -- 172.21.15.46:0/2187924856 shutdown_connections 2024-05-08T02:45:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.731+0000 7f4f5606d640 1 --2- 172.21.15.46:0/2187924856 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 0x7f4f50132c70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.731+0000 7f4f5606d640 1 -- 172.21.15.46:0/2187924856 >> 172.21.15.46:0/2187924856 conn(0x7f4f5009aa00 msgr2=0x7f4f5009ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.731+0000 7f4f5606d640 1 -- 172.21.15.46:0/2187924856 shutdown_connections 2024-05-08T02:45:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.731+0000 7f4f5606d640 1 -- 172.21.15.46:0/2187924856 wait complete. 2024-05-08T02:45:31.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.731+0000 7f4f5606d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:31.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.733+0000 7f4f5606d640 1 Processor -- start 2024-05-08T02:45:31.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.733+0000 7f4f5606d640 1 -- start start 2024-05-08T02:45:31.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f5606d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 0x7f4f5011ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:31.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f5606d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50130280 con 0x7f4f5009ce30 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f4f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 0x7f4f5011ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f4f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 0x7f4f5011ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55370/0 (socket says 172.21.15.46:55370) 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f4f7fe640 1 -- 172.21.15.46:0/3054412905 learned_addr learned my addr 172.21.15.46:0/3054412905 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f4f7fe640 1 -- 172.21.15.46:0/3054412905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f50074f00 con 0x7f4f5009ce30 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f4f7fe640 1 --2- 172.21.15.46:0/3054412905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 0x7f4f5011ef60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f37fff640 1 -- 172.21.15.46:0/3054412905 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f40014620 con 0x7f4f5009ce30 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f37fff640 1 -- 172.21.15.46:0/3054412905 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4f40014780 con 0x7f4f5009ce30 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f37fff640 1 -- 172.21.15.46:0/3054412905 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4f40014a20 con 0x7f4f5009ce30 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.735+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5012ff90 con 0x7f4f5009ce30 2024-05-08T02:45:31.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.736+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f50120b30 con 0x7f4f5009ce30 2024-05-08T02:45:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.736+0000 7f4f37fff640 1 -- 172.21.15.46:0/3054412905 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4f40014bd0 con 0x7f4f5009ce30 2024-05-08T02:45:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.736+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f50063900 con 0x7f4f5009ce30 2024-05-08T02:45:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.737+0000 7f4f37fff640 1 --2- 172.21.15.46:0/3054412905 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4f3c0389d0 0x7f4f3c03aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.737+0000 7f4f37fff640 1 -- 172.21.15.46:0/3054412905 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2672+0+0 (crc 0 0 0) 0x7f4f40019040 con 0x7f4f5009ce30 2024-05-08T02:45:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.737+0000 7f4f4effd640 1 --2- 172.21.15.46:0/3054412905 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4f3c0389d0 0x7f4f3c03aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.738+0000 7f4f4effd640 1 --2- 172.21.15.46:0/3054412905 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4f3c0389d0 0x7f4f3c03aee0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:31.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.742+0000 7f4f37fff640 1 -- 172.21.15.46:0/3054412905 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f4f400185a0 con 0x7f4f5009ce30 2024-05-08T02:45:31.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.981+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4f50121410 con 0x7f4f5009ce30 2024-05-08T02:45:31.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.983+0000 7f4f37fff640 1 -- 172.21.15.46:0/3054412905 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87796 (crc 0 0 0) 0x7f4f40010310 con 0x7f4f5009ce30 2024-05-08T02:45:31.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:45:31.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4f3c0389d0 msgr2=0x7f4f3c03aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:31.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 --2- 172.21.15.46:0/3054412905 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4f3c0389d0 0x7f4f3c03aee0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 msgr2=0x7f4f5011ef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:31.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 --2- 172.21.15.46:0/3054412905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 0x7f4f5011ef60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 shutdown_connections 2024-05-08T02:45:31.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 --2- 172.21.15.46:0/3054412905 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4f3c0389d0 0x7f4f3c03aee0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 --2- 172.21.15.46:0/3054412905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f5009ce30 0x7f4f5011ef60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:31.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 >> 172.21.15.46:0/3054412905 conn(0x7f4f5009aa00 msgr2=0x7f4f500708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:31.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 shutdown_connections 2024-05-08T02:45:31.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:31.986+0000 7f4f5606d640 1 -- 172.21.15.46:0/3054412905 wait complete. 2024-05-08T02:45:32.000 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":280569916},{"type":"v1","addr":"172.21.15.80:6801","nonce":280569916}]},"active_addr":"172.21.15.80:6801/280569916","active_change":"2024-05-08T02:45:24.515880+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2926736291}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1345291719}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":2363798298}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.80:0","nonce":1684084536}]}]} 2024-05-08T02:45:32.002 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T02:45:32.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T02:45:32.002 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T02:45:32.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.108+0000 7fc0ffd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.113+0000 7fc0ffd5d640 1 Processor -- start 2024-05-08T02:45:32.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.113+0000 7fc0ffd5d640 1 -- start start 2024-05-08T02:45:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.115+0000 7fc0ffd5d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc0f809ce30 0x7fc0f8132c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.115+0000 7fc0ffd5d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f809dc80 con 0x7fc0f81331b0 2024-05-08T02:45:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.115+0000 7fc0ffd5d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc0f809c440 con 0x7fc0f809ce30 2024-05-08T02:45:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.115+0000 7fc0fdaf9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc0f809ce30 0x7fc0f8132c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.115+0000 7fc0fd2f8640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc0f81331b0 0x7fc0f80a0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42216/0 (socket says 172.21.15.46:42216) 2024-05-08T02:45:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.115+0000 7fc0fd2f8640 1 -- 172.21.15.46:0/2673720629 learned_addr learned my addr 172.21.15.46:0/2673720629 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.115+0000 7fc0fdaf9640 1 -- 172.21.15.46:0/2673720629 >> v1:172.21.15.46:6789/0 conn(0x7fc0f81331b0 legacy=0x7fc0f80a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.116+0000 7fc0fcaf7640 1 -- 172.21.15.46:0/2673720629 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 423422307 0 0) 0x7fc0f809dc80 con 0x7fc0f81331b0 2024-05-08T02:45:32.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.116+0000 7fc0fdaf9640 1 -- 172.21.15.46:0/2673720629 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f8132840 con 0x7fc0f809ce30 2024-05-08T02:45:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.116+0000 7fc0fdaf9640 1 --2- 172.21.15.46:0/2673720629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 0x7fc0f8132c70 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3893023814a20984 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.116+0000 7fc0fcaf7640 1 -- 172.21.15.46:0/2673720629 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0f400e040 con 0x7fc0f809ce30 2024-05-08T02:45:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.116+0000 7fc0fcaf7640 1 -- 172.21.15.46:0/2673720629 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc0f4007670 con 0x7fc0f809ce30 2024-05-08T02:45:32.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.116+0000 7fc0fcaf7640 1 -- 172.21.15.46:0/2673720629 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0f4007910 con 0x7fc0f809ce30 2024-05-08T02:45:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.117+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/2673720629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 msgr2=0x7fc0f8132c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.117+0000 7fc0ffd5d640 1 --2- 172.21.15.46:0/2673720629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 0x7fc0f8132c70 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.117+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/2673720629 shutdown_connections 2024-05-08T02:45:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.117+0000 7fc0ffd5d640 1 --2- 172.21.15.46:0/2673720629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 0x7fc0f8132c70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.117+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/2673720629 >> 172.21.15.46:0/2673720629 conn(0x7fc0f809aa00 msgr2=0x7fc0f809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.117+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/2673720629 shutdown_connections 2024-05-08T02:45:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.117+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/2673720629 wait complete. 2024-05-08T02:45:32.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.117+0000 7fc0ffd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.119+0000 7fc0ffd5d640 1 Processor -- start 2024-05-08T02:45:32.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.119+0000 7fc0ffd5d640 1 -- start start 2024-05-08T02:45:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.120+0000 7fc0ffd5d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 0x7fc0f811ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.120+0000 7fc0ffd5d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f8130010 con 0x7fc0f809ce30 2024-05-08T02:45:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.120+0000 7fc0fdaf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 0x7fc0f811ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.120+0000 7fc0fdaf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 0x7fc0f811ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55378/0 (socket says 172.21.15.46:55378) 2024-05-08T02:45:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.120+0000 7fc0fdaf9640 1 -- 172.21.15.46:0/1672886934 learned_addr learned my addr 172.21.15.46:0/1672886934 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.121+0000 7fc0fdaf9640 1 -- 172.21.15.46:0/1672886934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f8122f20 con 0x7fc0f809ce30 2024-05-08T02:45:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.121+0000 7fc0fdaf9640 1 --2- 172.21.15.46:0/1672886934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 0x7fc0f811ee90 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.121+0000 7fc0ee7fc640 1 -- 172.21.15.46:0/1672886934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0f400e040 con 0x7fc0f809ce30 2024-05-08T02:45:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.121+0000 7fc0ee7fc640 1 -- 172.21.15.46:0/1672886934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc0f4012a20 con 0x7fc0f809ce30 2024-05-08T02:45:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.121+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f8121a50 con 0x7fc0f809ce30 2024-05-08T02:45:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.121+0000 7fc0ee7fc640 1 -- 172.21.15.46:0/1672886934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc0f4012cc0 con 0x7fc0f809ce30 2024-05-08T02:45:32.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.121+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f8122310 con 0x7fc0f809ce30 2024-05-08T02:45:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.122+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f8121c40 con 0x7fc0f809ce30 2024-05-08T02:45:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.122+0000 7fc0ee7fc640 1 -- 172.21.15.46:0/1672886934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc0f40153f0 con 0x7fc0f809ce30 2024-05-08T02:45:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.122+0000 7fc0ee7fc640 1 --2- 172.21.15.46:0/1672886934 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc0dc038980 0x7fc0dc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.122+0000 7fc0ee7fc640 1 -- 172.21.15.46:0/1672886934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2672+0+0 (crc 0 0 0) 0x7fc0f4049b00 con 0x7fc0f809ce30 2024-05-08T02:45:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.123+0000 7fc0fd2f8640 1 --2- 172.21.15.46:0/1672886934 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc0dc038980 0x7fc0dc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.123+0000 7fc0fd2f8640 1 --2- 172.21.15.46:0/1672886934 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc0dc038980 0x7fc0dc03ae90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.128+0000 7fc0ee7fc640 1 -- 172.21.15.46:0/1672886934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fc0f400fc40 con 0x7fc0f809ce30 2024-05-08T02:45:32.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.314+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0f809ba30 con 0x7fc0f809ce30 2024-05-08T02:45:32.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.315+0000 7fc0ee7fc640 1 -- 172.21.15.46:0/1672886934 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8723 (crc 0 0 0) 0x7fc0f4012100 con 0x7fc0f809ce30 2024-05-08T02:45:32.319 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:45:32.319 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":13,"fsid":"3c41076c-82d6-4569-8543-dcb021c14d35","created":"2024-05-08T02:45:20.092180+0000","modified":"2024-05-08T02:45:31.564452+0000","last_up_change":"2024-05-08T02:45:26.547871+0000","last_in_change":"2024-05-08T02:45:22.225801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T02:45:28.537086+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T02:45:30.405125+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b109fb80-69d6-4e98-b5a0-5244abc7c70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6801","nonce":3562168766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3562168766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3562168766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3562168766}]},"public_addr":"172.21.15.46:6801/3562168766","cluster_addr":"172.21.15.46:6802/3562168766","heartbeat_back_addr":"172.21.15.46:6811/3562168766","heartbeat_front_addr":"172.21.15.46:6812/3562168766","state":["exists","up"]},{"osd":1,"uuid":"2d6fc267-c018-4cfd-b873-7f310b704694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2291706666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":2291706666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":2291706666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":2291706666}]},"public_addr":"172.21.15.46:6806/2291706666","cluster_addr":"172.21.15.46:6805/2291706666","heartbeat_back_addr":"172.21.15.46:6807/2291706666","heartbeat_front_addr":"172.21.15.46:6803/2291706666","state":["exists","up"]},{"osd":2,"uuid":"d39b74fe-9bab-4194-8443-20462cbf2445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":1892248062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1892248062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1892248062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":1892248062}]},"public_addr":"172.21.15.80:6805/1892248062","cluster_addr":"172.21.15.80:6804/1892248062","heartbeat_back_addr":"172.21.15.80:6808/1892248062","heartbeat_front_addr":"172.21.15.80:6809/1892248062","state":["exists","up"]},{"osd":3,"uuid":"9c4e5819-7dd8-4be4-bc0a-74351c97b323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6807","nonce":3216858417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3216858417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3216858417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6803","nonce":3216858417}]},"public_addr":"172.21.15.80:6807/3216858417","cluster_addr":"172.21.15.80:6806/3216858417","heartbeat_back_addr":"172.21.15.80:6802/3216858417","heartbeat_front_addr":"172.21.15.80:6803/3216858417","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T02:45:32.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc0dc038980 msgr2=0x7fc0dc03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 --2- 172.21.15.46:0/1672886934 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc0dc038980 0x7fc0dc03ae90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 msgr2=0x7fc0f811ee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 --2- 172.21.15.46:0/1672886934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 0x7fc0f811ee90 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 shutdown_connections 2024-05-08T02:45:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 --2- 172.21.15.46:0/1672886934 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc0dc038980 0x7fc0dc03ae90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 --2- 172.21.15.46:0/1672886934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f809ce30 0x7fc0f811ee90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 >> 172.21.15.46:0/1672886934 conn(0x7fc0f809aa00 msgr2=0x7fc0f80708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 shutdown_connections 2024-05-08T02:45:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.317+0000 7fc0ffd5d640 1 -- 172.21.15.46:0/1672886934 wait complete. 2024-05-08T02:45:32.332 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T02:45:32.332 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T02:45:32.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.437+0000 7f660d806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.442+0000 7f660d806640 1 Processor -- start 2024-05-08T02:45:32.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.442+0000 7f660d806640 1 -- start start 2024-05-08T02:45:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.444+0000 7f660d806640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f660809e7c0 0x7f66080a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.444+0000 7f660d806640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66080a0120 con 0x7f66080a2e10 2024-05-08T02:45:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.444+0000 7f660d806640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f660806f270 con 0x7f660809e7c0 2024-05-08T02:45:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.444+0000 7f6606ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f660809e7c0 0x7f66080a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.444+0000 7f66067fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f66080a2e10 0x7f6608131650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42228/0 (socket says 172.21.15.46:42228) 2024-05-08T02:45:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.444+0000 7f66067fc640 1 -- 172.21.15.46:0/3700893515 learned_addr learned my addr 172.21.15.46:0/3700893515 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.444+0000 7f6606ffd640 1 -- 172.21.15.46:0/3700893515 >> v1:172.21.15.46:6789/0 conn(0x7f66080a2e10 legacy=0x7f6608131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.444+0000 7f6606ffd640 1 -- 172.21.15.46:0/3700893515 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660809e430 con 0x7f660809e7c0 2024-05-08T02:45:32.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.445+0000 7f6606ffd640 1 --2- 172.21.15.46:0/3700893515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f660809e7c0 0x7f66080a28d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49feed4e5720d50b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.445+0000 7f6605ffb640 1 -- 172.21.15.46:0/3700893515 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f65f800e040 con 0x7f660809e7c0 2024-05-08T02:45:32.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.445+0000 7f6605ffb640 1 -- 172.21.15.46:0/3700893515 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f65f8007670 con 0x7f660809e7c0 2024-05-08T02:45:32.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.445+0000 7f6605ffb640 1 -- 172.21.15.46:0/3700893515 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f65f8007910 con 0x7f660809e7c0 2024-05-08T02:45:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.445+0000 7f660d806640 1 -- 172.21.15.46:0/3700893515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f660809e7c0 msgr2=0x7f66080a28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.445+0000 7f660d806640 1 --2- 172.21.15.46:0/3700893515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f660809e7c0 0x7f66080a28d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.445+0000 7f660d806640 1 -- 172.21.15.46:0/3700893515 shutdown_connections 2024-05-08T02:45:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.445+0000 7f660d806640 1 --2- 172.21.15.46:0/3700893515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f660809e7c0 0x7f66080a28d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.445+0000 7f660d806640 1 -- 172.21.15.46:0/3700893515 >> 172.21.15.46:0/3700893515 conn(0x7f660806e2c0 msgr2=0x7f660806e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.446+0000 7f660d806640 1 -- 172.21.15.46:0/3700893515 shutdown_connections 2024-05-08T02:45:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.446+0000 7f660d806640 1 -- 172.21.15.46:0/3700893515 wait complete. 2024-05-08T02:45:32.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.446+0000 7f660d806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.447+0000 7f660d806640 1 Processor -- start 2024-05-08T02:45:32.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.448+0000 7f660d806640 1 -- start start 2024-05-08T02:45:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.449+0000 7f660d806640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66080a2e10 0x7f660811e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.449+0000 7f660d806640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f66081213c0 con 0x7f66080a2e10 2024-05-08T02:45:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.449+0000 7f6606ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66080a2e10 0x7f660811e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.449+0000 7f6606ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66080a2e10 0x7f660811e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55384/0 (socket says 172.21.15.46:55384) 2024-05-08T02:45:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.449+0000 7f6606ffd640 1 -- 172.21.15.46:0/1072508089 learned_addr learned my addr 172.21.15.46:0/1072508089 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.450+0000 7f6606ffd640 1 -- 172.21.15.46:0/1072508089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6608121da0 con 0x7f66080a2e10 2024-05-08T02:45:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.450+0000 7f6606ffd640 1 --2- 172.21.15.46:0/1072508089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66080a2e10 0x7f660811e790 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.450+0000 7f65fffff640 1 -- 172.21.15.46:0/1072508089 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f65f800e040 con 0x7f66080a2e10 2024-05-08T02:45:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.450+0000 7f65fffff640 1 -- 172.21.15.46:0/1072508089 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f65f8012a90 con 0x7f66080a2e10 2024-05-08T02:45:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.450+0000 7f65fffff640 1 -- 172.21.15.46:0/1072508089 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f65f8012d30 con 0x7f66080a2e10 2024-05-08T02:45:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.450+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660811e1d0 con 0x7f66080a2e10 2024-05-08T02:45:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.450+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660811dec0 con 0x7f66080a2e10 2024-05-08T02:45:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.451+0000 7f65fffff640 1 -- 172.21.15.46:0/1072508089 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f65f80153f0 con 0x7f66080a2e10 2024-05-08T02:45:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.451+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6608063900 con 0x7f66080a2e10 2024-05-08T02:45:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.451+0000 7f65fffff640 1 --2- 172.21.15.46:0/1072508089 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f65e8038980 0x7f65e803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.451+0000 7f65fffff640 1 -- 172.21.15.46:0/1072508089 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2672+0+0 (crc 0 0 0) 0x7f65f8049a60 con 0x7f66080a2e10 2024-05-08T02:45:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.451+0000 7f66067fc640 1 --2- 172.21.15.46:0/1072508089 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f65e8038980 0x7f65e803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.452+0000 7f66067fc640 1 --2- 172.21.15.46:0/1072508089 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f65e8038980 0x7f65e803ae90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.456+0000 7f65fffff640 1 -- 172.21.15.46:0/1072508089 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f65f800fc80 con 0x7f66080a2e10 2024-05-08T02:45:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.651+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6608068ea0 con 0x7f66080a2e10 2024-05-08T02:45:32.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.652+0000 7f65fffff640 1 -- 172.21.15.46:0/1072508089 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8714 (crc 0 0 0) 0x7f65f800faa0 con 0x7f66080a2e10 2024-05-08T02:45:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:45:32.656 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":14,"fsid":"3c41076c-82d6-4569-8543-dcb021c14d35","created":"2024-05-08T02:45:20.092180+0000","modified":"2024-05-08T02:45:32.568246+0000","last_up_change":"2024-05-08T02:45:26.547871+0000","last_in_change":"2024-05-08T02:45:22.225801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T02:45:28.537086+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T02:45:30.405125+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b109fb80-69d6-4e98-b5a0-5244abc7c70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6801","nonce":3562168766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3562168766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3562168766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3562168766}]},"public_addr":"172.21.15.46:6801/3562168766","cluster_addr":"172.21.15.46:6802/3562168766","heartbeat_back_addr":"172.21.15.46:6811/3562168766","heartbeat_front_addr":"172.21.15.46:6812/3562168766","state":["exists","up"]},{"osd":1,"uuid":"2d6fc267-c018-4cfd-b873-7f310b704694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2291706666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":2291706666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":2291706666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":2291706666}]},"public_addr":"172.21.15.46:6806/2291706666","cluster_addr":"172.21.15.46:6805/2291706666","heartbeat_back_addr":"172.21.15.46:6807/2291706666","heartbeat_front_addr":"172.21.15.46:6803/2291706666","state":["exists","up"]},{"osd":2,"uuid":"d39b74fe-9bab-4194-8443-20462cbf2445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":1892248062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1892248062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1892248062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":1892248062}]},"public_addr":"172.21.15.80:6805/1892248062","cluster_addr":"172.21.15.80:6804/1892248062","heartbeat_back_addr":"172.21.15.80:6808/1892248062","heartbeat_front_addr":"172.21.15.80:6809/1892248062","state":["exists","up"]},{"osd":3,"uuid":"9c4e5819-7dd8-4be4-bc0a-74351c97b323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6807","nonce":3216858417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3216858417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3216858417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6803","nonce":3216858417}]},"public_addr":"172.21.15.80:6807/3216858417","cluster_addr":"172.21.15.80:6806/3216858417","heartbeat_back_addr":"172.21.15.80:6802/3216858417","heartbeat_front_addr":"172.21.15.80:6803/3216858417","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T02:45:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f65e8038980 msgr2=0x7f65e803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 --2- 172.21.15.46:0/1072508089 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f65e8038980 0x7f65e803ae90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66080a2e10 msgr2=0x7f660811e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 --2- 172.21.15.46:0/1072508089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66080a2e10 0x7f660811e790 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 shutdown_connections 2024-05-08T02:45:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 --2- 172.21.15.46:0/1072508089 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f65e8038980 0x7f65e803ae90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 --2- 172.21.15.46:0/1072508089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66080a2e10 0x7f660811e790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 >> 172.21.15.46:0/1072508089 conn(0x7f660806e2c0 msgr2=0x7f66081ba980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 shutdown_connections 2024-05-08T02:45:32.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.654+0000 7f660d806640 1 -- 172.21.15.46:0/1072508089 wait complete. 2024-05-08T02:45:32.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T02:45:32.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T02:45:32.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T02:45:32.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T02:45:32.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.786+0000 7fa17c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.786+0000 7ffb4915d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.786+0000 7f4d7359d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.787+0000 7f64e35c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.792+0000 7fa17c79d640 1 Processor -- start 2024-05-08T02:45:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.793+0000 7ffb4915d640 1 Processor -- start 2024-05-08T02:45:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.793+0000 7fa17c79d640 1 -- start start 2024-05-08T02:45:32.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.793+0000 7ffb4915d640 1 -- start start 2024-05-08T02:45:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.793+0000 7f4d7359d640 1 Processor -- start 2024-05-08T02:45:32.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.793+0000 7f64e35c6640 1 Processor -- start 2024-05-08T02:45:32.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.793+0000 7f4d7359d640 1 -- start start 2024-05-08T02:45:32.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.793+0000 7f64e35c6640 1 -- start start 2024-05-08T02:45:32.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.794+0000 7ffb4915d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffb44132c10 0x7ffb44133020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.794+0000 7fa17c79d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa17409f630 0x7fa1740a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.794+0000 7ffb4915d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb44132800 con 0x7ffb440a0630 2024-05-08T02:45:32.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.794+0000 7ffb4915d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ffb4409dcf0 con 0x7ffb44132c10 2024-05-08T02:45:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.794+0000 7fa17a539640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa17409f630 0x7fa1740a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.794+0000 7fa17c79d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17409fa40 con 0x7fa1740a0c30 2024-05-08T02:45:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7fa17c79d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fa17409ddd0 con 0x7fa17409f630 2024-05-08T02:45:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7fa17a539640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa17409f630 0x7fa1740a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60584/0 (socket says 172.21.15.46:60584) 2024-05-08T02:45:32.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7fa17a539640 1 -- 172.21.15.46:0/1917340143 learned_addr learned my addr 172.21.15.46:0/1917340143 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:32.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb4259c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffb440a0630 0x7ffb440a0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45294/0 (socket says 172.21.15.46:45294) 2024-05-08T02:45:32.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb4259c640 1 -- 172.21.15.46:0/1801380503 learned_addr learned my addr 172.21.15.46:0/1801380503 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:32.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb42d9d640 1 --2- 172.21.15.46:0/1801380503 >> v2:172.21.15.46:3300/0 conn(0x7ffb44132c10 0x7ffb44133020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f4d7359d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d6c12fe80 0x7f4d6c137b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f4d7359d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c073910 con 0x7f4d6c072230 2024-05-08T02:45:32.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7fa17a539640 1 -- 172.21.15.46:0/1917340143 >> v1:172.21.15.46:6789/0 conn(0x7fa1740a0c30 legacy=0x7fa174134940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f4d7359d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f4d6c071fb0 con 0x7f4d6c12fe80 2024-05-08T02:45:32.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f4d71339640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4d6c072230 0x7f4d6c12f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45318/0 (socket says 172.21.15.46:45318) 2024-05-08T02:45:32.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f4d70b38640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4d6c12fe80 0x7f4d6c137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f4d71339640 1 -- 172.21.15.46:0/1459779465 learned_addr learned my addr 172.21.15.46:0/1459779465 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:32.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7fa17a539640 1 -- 172.21.15.46:0/1917340143 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17409f100 con 0x7fa17409f630 2024-05-08T02:45:32.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382977132 0 0) 0x7ffb44132800 con 0x7ffb440a0630 2024-05-08T02:45:32.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb2c003580 con 0x7ffb440a0630 2024-05-08T02:45:32.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f64e35c6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f64dc0a0e00 0x7f64dc139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f64e35c6640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64dc09fa40 con 0x7f64dc09f630 2024-05-08T02:45:32.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f64e35c6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f64dc0a1210 con 0x7f64dc0a0e00 2024-05-08T02:45:32.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1862953093 0 0) 0x7ffb2c003580 con 0x7ffb440a0630 2024-05-08T02:45:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 >> v2:172.21.15.46:3300/0 conn(0x7ffb44132c10 msgr2=0x7ffb44133020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T02:45:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb41d9b640 1 --2- 172.21.15.46:0/1801380503 >> v2:172.21.15.46:3300/0 conn(0x7ffb44132c10 0x7ffb44133020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb44073ba0 con 0x7ffb440a0630 2024-05-08T02:45:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 418995289 0 0) 0x7ffb380015a0 con 0x7ffb440a0630 2024-05-08T02:45:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 >> v1:172.21.15.46:6789/0 conn(0x7ffb440a0630 legacy=0x7ffb440a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.795+0000 7f4d63fff640 1 -- 172.21.15.46:0/1459779465 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893364505 0 0) 0x7f4d6c073910 con 0x7f4d6c072230 2024-05-08T02:45:32.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f4d63fff640 1 -- 172.21.15.46:0/1459779465 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d58003580 con 0x7f4d6c072230 2024-05-08T02:45:32.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7ffb41d9b640 1 --2- 172.21.15.46:0/1801380503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb2c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4409dcf0 con 0x7ffb2c003a20 2024-05-08T02:45:32.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7ffb42d9d640 1 --2- 172.21.15.46:0/1801380503 >> v2:172.21.15.46:3300/0 conn(0x7ffb44132c10 0x7ffb44133020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T02:45:32.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7fa17a539640 1 --2- 172.21.15.46:0/1917340143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 0x7fa1740a06f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc3d5dbe50edb9c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f4d70b38640 1 -- 172.21.15.46:0/1459779465 >> v1:172.21.15.46:6789/0 conn(0x7f4d6c072230 legacy=0x7f4d6c12f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f4d70b38640 1 -- 172.21.15.46:0/1459779465 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c0a46d0 con 0x7f4d6c12fe80 2024-05-08T02:45:32.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f64e0b61640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f64dc0a0e00 0x7f64dc139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f64e1362640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f64dc09f630 0x7f64dc0a06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45334/0 (socket says 172.21.15.46:45334) 2024-05-08T02:45:32.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f64e1362640 1 -- 172.21.15.46:0/610433395 learned_addr learned my addr 172.21.15.46:0/610433395 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:32.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7ffb42d9d640 1 --2- 172.21.15.46:0/1801380503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb2c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7fa179537640 1 -- 172.21.15.46:0/1917340143 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa170009e50 con 0x7fa17409f630 2024-05-08T02:45:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f4d70b38640 1 --2- 172.21.15.46:0/1459779465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 0x7f4d6c137b10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b418aa0cae387af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7fa179537640 1 -- 172.21.15.46:0/1917340143 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa17000e230 con 0x7fa17409f630 2024-05-08T02:45:32.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7fa179537640 1 -- 172.21.15.46:0/1917340143 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa170009e50 con 0x7fa17409f630 2024-05-08T02:45:32.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7ffb42d9d640 1 -- 172.21.15.46:0/1801380503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c003580 con 0x7ffb2c003a20 2024-05-08T02:45:32.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f64e0b61640 1 -- 172.21.15.46:0/610433395 >> v1:172.21.15.46:6789/0 conn(0x7f64dc09f630 legacy=0x7f64dc0a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f4d63fff640 1 -- 172.21.15.46:0/1459779465 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d5c009d00 con 0x7f4d6c12fe80 2024-05-08T02:45:32.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f4d63fff640 1 -- 172.21.15.46:0/1459779465 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d5c009e60 con 0x7f4d6c12fe80 2024-05-08T02:45:32.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f64e0b61640 1 -- 172.21.15.46:0/610433395 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64dc09ddd0 con 0x7f64dc0a0e00 2024-05-08T02:45:32.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7ffb42d9d640 1 --2- 172.21.15.46:0/1801380503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb2c003e70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76908a2fbc8043bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.796+0000 7f4d63fff640 1 -- 172.21.15.46:0/1459779465 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d5c00e360 con 0x7f4d6c12fe80 2024-05-08T02:45:32.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb34009860 con 0x7ffb2c003a20 2024-05-08T02:45:32.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7f64e0b61640 1 --2- 172.21.15.46:0/610433395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc0a0e00 0x7f64dc139c60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f0f757be3a3df7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffb34011320 con 0x7ffb2c003a20 2024-05-08T02:45:32.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7ffb41d9b640 1 -- 172.21.15.46:0/1801380503 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb340115c0 con 0x7ffb2c003a20 2024-05-08T02:45:32.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7f64d3fff640 1 -- 172.21.15.46:0/610433395 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64cc009d90 con 0x7f64dc0a0e00 2024-05-08T02:45:32.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7f64d3fff640 1 -- 172.21.15.46:0/610433395 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f64cc00e230 con 0x7f64dc0a0e00 2024-05-08T02:45:32.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7f64d3fff640 1 -- 172.21.15.46:0/610433395 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64cc00e4d0 con 0x7f64dc0a0e00 2024-05-08T02:45:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7fa17c79d640 1 -- 172.21.15.46:0/1917340143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 msgr2=0x7fa1740a06f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7fa17c79d640 1 --2- 172.21.15.46:0/1917340143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 0x7fa1740a06f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7f4d7359d640 1 -- 172.21.15.46:0/1459779465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 msgr2=0x7f4d6c137b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7f4d7359d640 1 --2- 172.21.15.46:0/1459779465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 0x7f4d6c137b10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7f4d7359d640 1 -- 172.21.15.46:0/1459779465 shutdown_connections 2024-05-08T02:45:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7fa17c79d640 1 -- 172.21.15.46:0/1917340143 shutdown_connections 2024-05-08T02:45:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7fa17c79d640 1 --2- 172.21.15.46:0/1917340143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 0x7fa1740a06f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.797+0000 7fa17c79d640 1 -- 172.21.15.46:0/1917340143 >> 172.21.15.46:0/1917340143 conn(0x7fa17406be40 msgr2=0x7fa17406c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f4d7359d640 1 --2- 172.21.15.46:0/1459779465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 0x7f4d6c137b10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f4d7359d640 1 -- 172.21.15.46:0/1459779465 >> 172.21.15.46:0/1459779465 conn(0x7f4d6c0a2a20 msgr2=0x7f4d6c0a2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7fa17c79d640 1 -- 172.21.15.46:0/1917340143 shutdown_connections 2024-05-08T02:45:32.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7fa17c79d640 1 -- 172.21.15.46:0/1917340143 wait complete. 2024-05-08T02:45:32.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f64e35c6640 1 -- 172.21.15.46:0/610433395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc0a0e00 msgr2=0x7f64dc139c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f4d7359d640 1 -- 172.21.15.46:0/1459779465 shutdown_connections 2024-05-08T02:45:32.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f64e35c6640 1 --2- 172.21.15.46:0/610433395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc0a0e00 0x7f64dc139c60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f4d7359d640 1 -- 172.21.15.46:0/1459779465 wait complete. 2024-05-08T02:45:32.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7ffb4915d640 1 -- 172.21.15.46:0/1801380503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 msgr2=0x7ffb2c003e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f64e35c6640 1 -- 172.21.15.46:0/610433395 shutdown_connections 2024-05-08T02:45:32.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f64e35c6640 1 --2- 172.21.15.46:0/610433395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc0a0e00 0x7f64dc139c60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7ffb4915d640 1 --2- 172.21.15.46:0/1801380503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb2c003e70 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f64e35c6640 1 -- 172.21.15.46:0/610433395 >> 172.21.15.46:0/610433395 conn(0x7f64dc06be40 msgr2=0x7f64dc06c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7fa17c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7ffb4915d640 1 -- 172.21.15.46:0/1801380503 shutdown_connections 2024-05-08T02:45:32.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7ffb4915d640 1 --2- 172.21.15.46:0/1801380503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb2c003e70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7ffb4915d640 1 --2- 172.21.15.46:0/1801380503 >> v2:172.21.15.46:3300/0 conn(0x7ffb44132c10 0x7ffb44133020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f64e35c6640 1 -- 172.21.15.46:0/610433395 shutdown_connections 2024-05-08T02:45:32.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f4d7359d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7ffb4915d640 1 -- 172.21.15.46:0/1801380503 >> 172.21.15.46:0/1801380503 conn(0x7ffb4409aa00 msgr2=0x7ffb4409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f64e35c6640 1 -- 172.21.15.46:0/610433395 wait complete. 2024-05-08T02:45:32.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7ffb4915d640 1 -- 172.21.15.46:0/1801380503 shutdown_connections 2024-05-08T02:45:32.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7ffb4915d640 1 -- 172.21.15.46:0/1801380503 wait complete. 2024-05-08T02:45:32.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7f64e35c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.798+0000 7ffb4915d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:32.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.800+0000 7f4d7359d640 1 Processor -- start 2024-05-08T02:45:32.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.800+0000 7f4d7359d640 1 -- start start 2024-05-08T02:45:32.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.800+0000 7f64e35c6640 1 Processor -- start 2024-05-08T02:45:32.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.800+0000 7f64e35c6640 1 -- start start 2024-05-08T02:45:32.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.801+0000 7fa17c79d640 1 Processor -- start 2024-05-08T02:45:32.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.801+0000 7fa17c79d640 1 -- start start 2024-05-08T02:45:32.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.801+0000 7f4d7359d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 0x7f4d6c09adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.801+0000 7f4d7359d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c12cdc0 con 0x7f4d6c12fe80 2024-05-08T02:45:32.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f64e35c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc09f630 0x7f64dc11df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f4d71339640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 0x7f4d6c09adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f4d71339640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 0x7f4d6c09adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60620/0 (socket says 172.21.15.46:60620) 2024-05-08T02:45:32.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7ffb4915d640 1 Processor -- start 2024-05-08T02:45:32.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f4d71339640 1 -- 172.21.15.46:0/3159790264 learned_addr learned my addr 172.21.15.46:0/3159790264 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:32.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f64e35c6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f64dc1322e0 con 0x7f64dc09f630 2024-05-08T02:45:32.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f64e1362640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc09f630 0x7f64dc11df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7ffb4915d640 1 -- start start 2024-05-08T02:45:32.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f64e1362640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc09f630 0x7f64dc11df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60632/0 (socket says 172.21.15.46:60632) 2024-05-08T02:45:32.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f64e1362640 1 -- 172.21.15.46:0/3331884809 learned_addr learned my addr 172.21.15.46:0/3331884809 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:32.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f4d71339640 1 -- 172.21.15.46:0/3159790264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c09d180 con 0x7f4d6c12fe80 2024-05-08T02:45:32.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f64e1362640 1 -- 172.21.15.46:0/3331884809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64dc131ff0 con 0x7f64dc09f630 2024-05-08T02:45:32.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.802+0000 7f4d71339640 1 --2- 172.21.15.46:0/3159790264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 0x7f4d6c09adc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f4d61ffb640 1 -- 172.21.15.46:0/3159790264 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d68004b80 con 0x7f4d6c12fe80 2024-05-08T02:45:32.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f64e1362640 1 --2- 172.21.15.46:0/3331884809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc09f630 0x7f64dc11df40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f4d61ffb640 1 -- 172.21.15.46:0/3159790264 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d68004ce0 con 0x7f4d6c12fe80 2024-05-08T02:45:32.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f4d61ffb640 1 -- 172.21.15.46:0/3159790264 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d68007120 con 0x7f4d6c12fe80 2024-05-08T02:45:32.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c12ca70 con 0x7f4d6c12fe80 2024-05-08T02:45:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f64d1ffb640 1 -- 172.21.15.46:0/3331884809 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64d8005a60 con 0x7f64dc09f630 2024-05-08T02:45:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f64d1ffb640 1 -- 172.21.15.46:0/3331884809 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f64d8005bc0 con 0x7f64dc09f630 2024-05-08T02:45:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f64d1ffb640 1 -- 172.21.15.46:0/3331884809 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64d8005e60 con 0x7f64dc09f630 2024-05-08T02:45:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64dc122050 con 0x7f64dc09f630 2024-05-08T02:45:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7fa17c79d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 0x7fa1741c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7fa17c79d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa174120640 con 0x7fa17409f630 2024-05-08T02:45:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c11b3a0 con 0x7f4d6c12fe80 2024-05-08T02:45:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7fa17a539640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 0x7fa1741c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7fa17a539640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 0x7fa1741c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60644/0 (socket says 172.21.15.46:60644) 2024-05-08T02:45:32.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64dc06cdd0 con 0x7f64dc09f630 2024-05-08T02:45:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.803+0000 7fa17a539640 1 -- 172.21.15.46:0/3946841105 learned_addr learned my addr 172.21.15.46:0/3946841105 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.804+0000 7fa17a539640 1 -- 172.21.15.46:0/3946841105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa174120aa0 con 0x7fa17409f630 2024-05-08T02:45:32.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.804+0000 7ffb4915d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb4411ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.804+0000 7ffb4915d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4411fff0 con 0x7ffb2c003a20 2024-05-08T02:45:32.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.804+0000 7fa17a539640 1 --2- 172.21.15.46:0/3946841105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 0x7fa1741c9c00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.804+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4d6c063900 con 0x7f4d6c12fe80 2024-05-08T02:45:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.804+0000 7ffb42d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb4411ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.804+0000 7ffb42d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb4411ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60652/0 (socket says 172.21.15.46:60652) 2024-05-08T02:45:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.804+0000 7ffb42d9d640 1 -- 172.21.15.46:0/2214240737 learned_addr learned my addr 172.21.15.46:0/2214240737 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:32.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.804+0000 7ffb42d9d640 1 -- 172.21.15.46:0/2214240737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb44130080 con 0x7ffb2c003a20 2024-05-08T02:45:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7ffb42d9d640 1 --2- 172.21.15.46:0/2214240737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb4411ef50 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7fa16affd640 1 -- 172.21.15.46:0/3946841105 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa17000ecf0 con 0x7fa17409f630 2024-05-08T02:45:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7ffb2b7fe640 1 -- 172.21.15.46:0/2214240737 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb340118a0 con 0x7ffb2c003a20 2024-05-08T02:45:32.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb44122f90 con 0x7ffb2c003a20 2024-05-08T02:45:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1741c9550 con 0x7fa17409f630 2024-05-08T02:45:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64dc0a3510 con 0x7f64dc09f630 2024-05-08T02:45:32.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa174121e70 con 0x7fa17409f630 2024-05-08T02:45:32.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb44122520 con 0x7ffb2c003a20 2024-05-08T02:45:32.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7fa16affd640 1 -- 172.21.15.46:0/3946841105 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa17000ee50 con 0x7fa17409f630 2024-05-08T02:45:32.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7fa16affd640 1 -- 172.21.15.46:0/3946841105 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa170015550 con 0x7fa17409f630 2024-05-08T02:45:32.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7ffb2b7fe640 1 -- 172.21.15.46:0/2214240737 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffb34011a00 con 0x7ffb2c003a20 2024-05-08T02:45:32.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7ffb2b7fe640 1 -- 172.21.15.46:0/2214240737 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb34011b70 con 0x7ffb2c003a20 2024-05-08T02:45:32.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.805+0000 7f4d61ffb640 1 -- 172.21.15.46:0/3159790264 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4d680072d0 con 0x7f4d6c12fe80 2024-05-08T02:45:32.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f64d1ffb640 1 -- 172.21.15.46:0/3331884809 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f64d800c780 con 0x7f64dc09f630 2024-05-08T02:45:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f4d61ffb640 1 --2- 172.21.15.46:0/3159790264 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4d500389d0 0x7f4d5003aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f4d61ffb640 1 -- 172.21.15.46:0/3159790264 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f4d680485c0 con 0x7f4d6c12fe80 2024-05-08T02:45:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f4d61ffb640 1 --2- 172.21.15.46:0/3159790264 >> v2:172.21.15.80:6805/1892248062 conn(0x7f4d5003d9d0 0x7f4d5003fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f4d61ffb640 1 -- 172.21.15.46:0/3159790264 --> v2:172.21.15.80:6805/1892248062 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d500404f0 con 0x7f4d5003d9d0 2024-05-08T02:45:32.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f4d61ffb640 1 -- 172.21.15.46:0/3159790264 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f4d6800c5e0 con 0x7f4d6c12fe80 2024-05-08T02:45:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f64d1ffb640 1 --2- 172.21.15.46:0/3331884809 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f64c0038980 0x7f64c003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb24000f80 con 0x7ffb2c003a20 2024-05-08T02:45:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f64d1ffb640 1 -- 172.21.15.46:0/3331884809 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f64d80482b0 con 0x7f64dc09f630 2024-05-08T02:45:32.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f64d1ffb640 1 --2- 172.21.15.46:0/3331884809 >> v2:172.21.15.46:6806/2291706666 conn(0x7f64c003d980 0x7f64c003fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f64d1ffb640 1 -- 172.21.15.46:0/3331884809 --> v2:172.21.15.46:6806/2291706666 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64c00404a0 con 0x7f64c003d980 2024-05-08T02:45:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1741c9a00 con 0x7fa17409f630 2024-05-08T02:45:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7f64d1ffb640 1 -- 172.21.15.46:0/3331884809 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f64d800d510 con 0x7f64dc09f630 2024-05-08T02:45:32.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7f64e0b61640 1 --2- 172.21.15.46:0/3331884809 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f64c0038980 0x7f64c003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.806+0000 7f4d70b38640 1 --2- 172.21.15.46:0/3159790264 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4d500389d0 0x7f4d5003aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7fa16affd640 1 -- 172.21.15.46:0/3946841105 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa170015750 con 0x7fa17409f630 2024-05-08T02:45:32.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7ffb2b7fe640 1 -- 172.21.15.46:0/2214240737 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ffb34011cd0 con 0x7ffb2c003a20 2024-05-08T02:45:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7fa16affd640 1 --2- 172.21.15.46:0/3946841105 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa158038930 0x7fa15803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7fa16affd640 1 -- 172.21.15.46:0/3946841105 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fa170049870 con 0x7fa17409f630 2024-05-08T02:45:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7f4d70b38640 1 --2- 172.21.15.46:0/3159790264 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4d500389d0 0x7f4d5003aee0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7fa16affd640 1 --2- 172.21.15.46:0/3946841105 >> v2:172.21.15.80:6807/3216858417 conn(0x7fa15803d930 0x7fa15803fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7fa16affd640 1 -- 172.21.15.46:0/3946841105 --> v2:172.21.15.80:6807/3216858417 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa158040450 con 0x7fa15803d930 2024-05-08T02:45:32.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7fa16affd640 1 -- 172.21.15.46:0/3946841105 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7fa170010a00 con 0x7fa17409f630 2024-05-08T02:45:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7ffb2b7fe640 1 --2- 172.21.15.46:0/2214240737 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffb30038980 0x7ffb3003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7ffb2b7fe640 1 -- 172.21.15.46:0/2214240737 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7ffb3401a040 con 0x7ffb2c003a20 2024-05-08T02:45:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7ffb2b7fe640 1 --2- 172.21.15.46:0/2214240737 >> v2:172.21.15.46:6801/3562168766 conn(0x7ffb3003d980 0x7ffb3003fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7ffb2b7fe640 1 -- 172.21.15.46:0/2214240737 --> v2:172.21.15.46:6801/3562168766 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb300404a0 con 0x7ffb3003d980 2024-05-08T02:45:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.807+0000 7ffb2b7fe640 1 -- 172.21.15.46:0/2214240737 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7ffb3401a5c0 con 0x7ffb2c003a20 2024-05-08T02:45:32.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.808+0000 7fa179d38640 1 --2- 172.21.15.46:0/3946841105 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa158038930 0x7fa15803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.808+0000 7ffb4259c640 1 --2- 172.21.15.46:0/2214240737 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffb30038980 0x7ffb3003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.808+0000 7f64e1b63640 1 --2- 172.21.15.46:0/3331884809 >> v2:172.21.15.46:6806/2291706666 conn(0x7f64c003d980 0x7f64c003fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T02:45:32.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.808+0000 7f4d71b3a640 1 --2- 172.21.15.46:0/3159790264 >> v2:172.21.15.80:6805/1892248062 conn(0x7f4d5003d9d0 0x7f4d5003fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T02:45:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.808+0000 7f64e0b61640 1 --2- 172.21.15.46:0/3331884809 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f64c0038980 0x7f64c003ae90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.808+0000 7fa17ad3a640 1 --2- 172.21.15.46:0/3946841105 >> v2:172.21.15.80:6807/3216858417 conn(0x7fa15803d930 0x7fa15803fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T02:45:32.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.808+0000 7fa179d38640 1 --2- 172.21.15.46:0/3946841105 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa158038930 0x7fa15803ae40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.808+0000 7ffb4259c640 1 --2- 172.21.15.46:0/2214240737 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffb30038980 0x7ffb3003ae90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.808+0000 7ffb4359e640 1 --2- 172.21.15.46:0/2214240737 >> v2:172.21.15.46:6801/3562168766 conn(0x7ffb3003d980 0x7ffb3003fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T02:45:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.812+0000 7fa17ad3a640 1 --2- 172.21.15.46:0/3946841105 >> v2:172.21.15.80:6807/3216858417 conn(0x7fa15803d930 0x7fa15803fdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.812+0000 7f4d71b3a640 1 --2- 172.21.15.46:0/3159790264 >> v2:172.21.15.80:6805/1892248062 conn(0x7f4d5003d9d0 0x7f4d5003fe60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.813+0000 7ffb4359e640 1 --2- 172.21.15.46:0/2214240737 >> v2:172.21.15.46:6801/3562168766 conn(0x7ffb3003d980 0x7ffb3003fe10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.813+0000 7f64e1b63640 1 --2- 172.21.15.46:0/3331884809 >> v2:172.21.15.46:6806/2291706666 conn(0x7f64c003d980 0x7f64c003fe10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:32.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.813+0000 7fa16affd640 1 -- 172.21.15.46:0/3946841105 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7fa158040450 con 0x7fa15803d930 2024-05-08T02:45:32.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.814+0000 7f4d61ffb640 1 -- 172.21.15.46:0/3159790264 <== osd.2 v2:172.21.15.80:6805/1892248062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f4d500404f0 con 0x7f4d5003d9d0 2024-05-08T02:45:32.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.815+0000 7f64d1ffb640 1 -- 172.21.15.46:0/3331884809 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f64c00404a0 con 0x7f64c003d980 2024-05-08T02:45:32.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.815+0000 7ffb2b7fe640 1 -- 172.21.15.46:0/2214240737 <== osd.0 v2:172.21.15.46:6801/3562168766 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7ffb300404a0 con 0x7ffb3003d980 2024-05-08T02:45:32.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.817+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 --> v2:172.21.15.80:6807/3216858417 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa1741212e0 con 0x7fa15803d930 2024-05-08T02:45:32.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.818+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 --> v2:172.21.15.80:6805/1892248062 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4d6c09c860 con 0x7f4d5003d9d0 2024-05-08T02:45:32.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa16affd640 1 -- 172.21.15.46:0/3946841105 <== osd.3 v2:172.21.15.80:6807/3216858417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa1741212e0 con 0x7fa15803d930 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 >> v2:172.21.15.80:6807/3216858417 conn(0x7fa15803d930 msgr2=0x7fa15803fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 --2- 172.21.15.46:0/3946841105 >> v2:172.21.15.80:6807/3216858417 conn(0x7fa15803d930 0x7fa15803fdc0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa158038930 msgr2=0x7fa15803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 --2- 172.21.15.46:0/3946841105 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa158038930 0x7fa15803ae40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 msgr2=0x7fa1741c9c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 --2- 172.21.15.46:0/3946841105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 0x7fa1741c9c00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 shutdown_connections 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 --2- 172.21.15.46:0/3946841105 >> v2:172.21.15.80:6807/3216858417 conn(0x7fa15803d930 0x7fa15803fdc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 --2- 172.21.15.46:0/3946841105 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa158038930 0x7fa15803ae40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 --2- 172.21.15.46:0/3946841105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa17409f630 0x7fa1741c9c00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 >> 172.21.15.46:0/3946841105 conn(0x7fa17406be40 msgr2=0x7fa17409b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 shutdown_connections 2024-05-08T02:45:32.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.819+0000 7fa17c79d640 1 -- 172.21.15.46:0/3946841105 wait complete. 2024-05-08T02:45:32.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d61ffb640 1 -- 172.21.15.46:0/3159790264 <== osd.2 v2:172.21.15.80:6805/1892248062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4d6c09c860 con 0x7f4d5003d9d0 2024-05-08T02:45:32.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 >> v2:172.21.15.80:6805/1892248062 conn(0x7f4d5003d9d0 msgr2=0x7f4d5003fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 --2- 172.21.15.46:0/3159790264 >> v2:172.21.15.80:6805/1892248062 conn(0x7f4d5003d9d0 0x7f4d5003fe60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4d500389d0 msgr2=0x7f4d5003aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 --2- 172.21.15.46:0/3159790264 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4d500389d0 0x7f4d5003aee0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 msgr2=0x7f4d6c09adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 --2- 172.21.15.46:0/3159790264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 0x7f4d6c09adc0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 shutdown_connections 2024-05-08T02:45:32.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 --2- 172.21.15.46:0/3159790264 >> v2:172.21.15.80:6805/1892248062 conn(0x7f4d5003d9d0 0x7f4d5003fe60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 --2- 172.21.15.46:0/3159790264 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4d500389d0 0x7f4d5003aee0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 --2- 172.21.15.46:0/3159790264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d6c12fe80 0x7f4d6c09adc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 >> 172.21.15.46:0/3159790264 conn(0x7f4d6c0a2a20 msgr2=0x7f4d6c0a09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 shutdown_connections 2024-05-08T02:45:32.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.820+0000 7f4d7359d640 1 -- 172.21.15.46:0/3159790264 wait complete. 2024-05-08T02:45:32.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.822+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 --> v2:172.21.15.46:6801/3562168766 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffb24002c30 con 0x7ffb3003d980 2024-05-08T02:45:32.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.822+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 --> v2:172.21.15.46:6806/2291706666 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64dc0a03e0 con 0x7f64c003d980 2024-05-08T02:45:32.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.824+0000 7f64d1ffb640 1 -- 172.21.15.46:0/3331884809 <== osd.1 v2:172.21.15.46:6806/2291706666 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f64d400a820 con 0x7f64c003d980 2024-05-08T02:45:32.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.825+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 >> v2:172.21.15.46:6806/2291706666 conn(0x7f64c003d980 msgr2=0x7f64c003fe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.825+0000 7f64e35c6640 1 --2- 172.21.15.46:0/3331884809 >> v2:172.21.15.46:6806/2291706666 conn(0x7f64c003d980 0x7f64c003fe10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.825+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f64c0038980 msgr2=0x7f64c003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.825+0000 7f64e35c6640 1 --2- 172.21.15.46:0/3331884809 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f64c0038980 0x7f64c003ae90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.825+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc09f630 msgr2=0x7f64dc11df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.825+0000 7f64e35c6640 1 --2- 172.21.15.46:0/3331884809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc09f630 0x7f64dc11df40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.826+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 shutdown_connections 2024-05-08T02:45:32.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.826+0000 7f64e35c6640 1 --2- 172.21.15.46:0/3331884809 >> v2:172.21.15.46:6806/2291706666 conn(0x7f64c003d980 0x7f64c003fe10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.826+0000 7f64e35c6640 1 --2- 172.21.15.46:0/3331884809 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f64c0038980 0x7f64c003ae90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.826+0000 7f64e35c6640 1 --2- 172.21.15.46:0/3331884809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64dc09f630 0x7f64dc11df40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.826+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 >> 172.21.15.46:0/3331884809 conn(0x7f64dc06be40 msgr2=0x7f64dc1ba950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.827+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 shutdown_connections 2024-05-08T02:45:32.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.827+0000 7f64e35c6640 1 -- 172.21.15.46:0/3331884809 wait complete. 2024-05-08T02:45:32.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.831+0000 7ffb2b7fe640 1 -- 172.21.15.46:0/2214240737 <== osd.0 v2:172.21.15.46:6801/3562168766 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffb24002c30 con 0x7ffb3003d980 2024-05-08T02:45:32.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 >> v2:172.21.15.46:6801/3562168766 conn(0x7ffb3003d980 msgr2=0x7ffb3003fe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 --2- 172.21.15.46:0/2214240737 >> v2:172.21.15.46:6801/3562168766 conn(0x7ffb3003d980 0x7ffb3003fe10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffb30038980 msgr2=0x7ffb3003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 --2- 172.21.15.46:0/2214240737 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffb30038980 0x7ffb3003ae90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 msgr2=0x7ffb4411ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:32.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 --2- 172.21.15.46:0/2214240737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb4411ef50 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 shutdown_connections 2024-05-08T02:45:32.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 --2- 172.21.15.46:0/2214240737 >> v2:172.21.15.46:6801/3562168766 conn(0x7ffb3003d980 0x7ffb3003fe10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 --2- 172.21.15.46:0/2214240737 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffb30038980 0x7ffb3003ae90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 --2- 172.21.15.46:0/2214240737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb2c003a20 0x7ffb4411ef50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:32.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 >> 172.21.15.46:0/2214240737 conn(0x7ffb4409aa00 msgr2=0x7ffb440708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:32.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 shutdown_connections 2024-05-08T02:45:32.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:32.832+0000 7ffb4915d640 1 -- 172.21.15.46:0/2214240737 wait complete. 2024-05-08T02:45:32.861 INFO:teuthology.orchestra.run.smithi046.stdout:38654705670 2024-05-08T02:45:32.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T02:45:32.862 INFO:teuthology.orchestra.run.smithi046.stdout:38654705670 2024-05-08T02:45:32.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T02:45:32.863 INFO:teuthology.orchestra.run.smithi046.stdout:38654705670 2024-05-08T02:45:32.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T02:45:32.864 INFO:teuthology.orchestra.run.smithi046.stdout:38654705670 2024-05-08T02:45:32.864 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T02:45:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.017+0000 7f83e66ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.017+0000 7f174935d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.017+0000 7f12ada20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.017+0000 7f023cd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.023+0000 7f12ada20640 1 Processor -- start 2024-05-08T02:45:33.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.023+0000 7f174935d640 1 Processor -- start 2024-05-08T02:45:33.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.023+0000 7f12ada20640 1 -- start start 2024-05-08T02:45:33.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.023+0000 7f174935d640 1 -- start start 2024-05-08T02:45:33.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.024+0000 7f83e66ad640 1 Processor -- start 2024-05-08T02:45:33.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.024+0000 7f83e66ad640 1 -- start start 2024-05-08T02:45:33.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.024+0000 7f023cd5d640 1 Processor -- start 2024-05-08T02:45:33.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.024+0000 7f023cd5d640 1 -- start start 2024-05-08T02:45:33.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.025+0000 7f12ada20640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f12a812fe80 0x7f12a8137b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.025+0000 7f12ada20640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a8073910 con 0x7f12a8072230 2024-05-08T02:45:33.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.025+0000 7f12ada20640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f12a8071fb0 con 0x7f12a812fe80 2024-05-08T02:45:33.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.025+0000 7f12a6ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f12a8072230 0x7f12a812f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45346/0 (socket says 172.21.15.46:45346) 2024-05-08T02:45:33.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.025+0000 7f12a6ffd640 1 -- 172.21.15.46:0/733623011 learned_addr learned my addr 172.21.15.46:0/733623011 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:33.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.025+0000 7f12a67fc640 1 --2- 172.21.15.46:0/733623011 >> v2:172.21.15.46:3300/0 conn(0x7f12a812fe80 0x7f12a8137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f023cd5d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f023812ed90 0x7f0238136900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f023cd5d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023809ddb0 con 0x7f02380a3560 2024-05-08T02:45:33.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f023cd5d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f023809cee0 con 0x7f023812ed90 2024-05-08T02:45:33.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f12a67fc640 1 -- 172.21.15.46:0/733623011 >> v1:172.21.15.46:6789/0 conn(0x7f12a8072230 legacy=0x7f12a812f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f12a5ffb640 1 -- 172.21.15.46:0/733623011 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935250047 0 0) 0x7f12a8073910 con 0x7f12a8072230 2024-05-08T02:45:33.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f12a67fc640 1 -- 172.21.15.46:0/733623011 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a80a46d0 con 0x7f12a812fe80 2024-05-08T02:45:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f022ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f023812ed90 0x7f0238136900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f022ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f023812ed90 0x7f0238136900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60658/0 (socket says 172.21.15.46:60658) 2024-05-08T02:45:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f022ffff640 1 -- 172.21.15.46:0/538261394 learned_addr learned my addr 172.21.15.46:0/538261394 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f83e66ad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83e009e710 0x7f83e00a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f83e66ad640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e00a0000 con 0x7f83e00a10c0 2024-05-08T02:45:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f83e66ad640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f83e009e3c0 con 0x7f83e009e710 2024-05-08T02:45:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f022ffff640 1 -- 172.21.15.46:0/538261394 >> v1:172.21.15.46:6789/0 conn(0x7f02380a3560 legacy=0x7f023812e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f022ffff640 1 -- 172.21.15.46:0/538261394 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023809cbd0 con 0x7f023812ed90 2024-05-08T02:45:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f12a67fc640 1 --2- 172.21.15.46:0/733623011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 0x7f12a8137b10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd48420b70b26d4b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f83dffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83e009e710 0x7f83e00a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f022ffff640 1 --2- 172.21.15.46:0/538261394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f023812ed90 0x7f0238136900 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6729ab1b249bf8de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f83dffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f83e009e710 0x7f83e00a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60674/0 (socket says 172.21.15.46:60674) 2024-05-08T02:45:33.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.026+0000 7f83dffff640 1 -- 172.21.15.46:0/2096331274 learned_addr learned my addr 172.21.15.46:0/2096331274 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:33.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f0235d9b640 1 -- 172.21.15.46:0/538261394 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0220009e50 con 0x7f023812ed90 2024-05-08T02:45:33.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f12a5ffb640 1 -- 172.21.15.46:0/733623011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f129c009d90 con 0x7f12a812fe80 2024-05-08T02:45:33.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f83deffd640 1 -- 172.21.15.46:0/2096331274 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892974457 0 0) 0x7f83e00a0000 con 0x7f83e00a10c0 2024-05-08T02:45:33.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f83deffd640 1 -- 172.21.15.46:0/2096331274 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83c8003580 con 0x7f83e00a10c0 2024-05-08T02:45:33.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f12a5ffb640 1 -- 172.21.15.46:0/733623011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f129c00e230 con 0x7f12a812fe80 2024-05-08T02:45:33.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f12a5ffb640 1 -- 172.21.15.46:0/733623011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f129c00e4d0 con 0x7f12a812fe80 2024-05-08T02:45:33.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f0235d9b640 1 -- 172.21.15.46:0/538261394 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f022000e230 con 0x7f023812ed90 2024-05-08T02:45:33.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f0235d9b640 1 -- 172.21.15.46:0/538261394 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f022000e4d0 con 0x7f023812ed90 2024-05-08T02:45:33.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f83dffff640 1 -- 172.21.15.46:0/2096331274 >> v1:172.21.15.46:6789/0 conn(0x7f83e00a10c0 legacy=0x7f83e0134900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f83dffff640 1 -- 172.21.15.46:0/2096331274 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e00a0730 con 0x7f83e009e710 2024-05-08T02:45:33.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f174935d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f174412ed90 0x7f1744136900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f83dffff640 1 --2- 172.21.15.46:0/2096331274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e009e710 0x7f83e00a0b80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65932142268e1383 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f174935d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f174409ddb0 con 0x7f17440a3560 2024-05-08T02:45:33.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f1742ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f17440a3560 0x7f174412e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45354/0 (socket says 172.21.15.46:45354) 2024-05-08T02:45:33.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f1742ffd640 1 -- 172.21.15.46:0/819313195 learned_addr learned my addr 172.21.15.46:0/819313195 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:33.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f174935d640 1 -- 172.21.15.46:0/819313195 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f174409cee0 con 0x7f174412ed90 2024-05-08T02:45:33.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.027+0000 7f17427fc640 1 --2- 172.21.15.46:0/819313195 >> v2:172.21.15.46:3300/0 conn(0x7f174412ed90 0x7f1744136900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f83deffd640 1 -- 172.21.15.46:0/2096331274 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83d800e040 con 0x7f83e009e710 2024-05-08T02:45:33.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f1741ffb640 1 -- 172.21.15.46:0/819313195 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475091174 0 0) 0x7f174409ddb0 con 0x7f17440a3560 2024-05-08T02:45:33.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f1741ffb640 1 -- 172.21.15.46:0/819313195 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f172c003580 con 0x7f17440a3560 2024-05-08T02:45:33.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f17427fc640 1 -- 172.21.15.46:0/819313195 >> v1:172.21.15.46:6789/0 conn(0x7f17440a3560 legacy=0x7f174412e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f17427fc640 1 -- 172.21.15.46:0/819313195 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174409cbd0 con 0x7f174412ed90 2024-05-08T02:45:33.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f83deffd640 1 -- 172.21.15.46:0/2096331274 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f83d80091e0 con 0x7f83e009e710 2024-05-08T02:45:33.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f83deffd640 1 -- 172.21.15.46:0/2096331274 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83d8007730 con 0x7f83e009e710 2024-05-08T02:45:33.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f17427fc640 1 --2- 172.21.15.46:0/819313195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174412ed90 0x7f1744136900 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59a1e7e5c2b5a21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f023cd5d640 1 -- 172.21.15.46:0/538261394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f023812ed90 msgr2=0x7f0238136900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f023cd5d640 1 --2- 172.21.15.46:0/538261394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f023812ed90 0x7f0238136900 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f12ada20640 1 -- 172.21.15.46:0/733623011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 msgr2=0x7f12a8137b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f12ada20640 1 --2- 172.21.15.46:0/733623011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 0x7f12a8137b10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f1741ffb640 1 -- 172.21.15.46:0/819313195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1738009d90 con 0x7f174412ed90 2024-05-08T02:45:33.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f12ada20640 1 -- 172.21.15.46:0/733623011 shutdown_connections 2024-05-08T02:45:33.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f023cd5d640 1 -- 172.21.15.46:0/538261394 shutdown_connections 2024-05-08T02:45:33.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f023cd5d640 1 --2- 172.21.15.46:0/538261394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f023812ed90 0x7f0238136900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f023cd5d640 1 -- 172.21.15.46:0/538261394 >> 172.21.15.46:0/538261394 conn(0x7f02380a19a0 msgr2=0x7f02380a1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f12ada20640 1 --2- 172.21.15.46:0/733623011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 0x7f12a8137b10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f12ada20640 1 -- 172.21.15.46:0/733623011 >> 172.21.15.46:0/733623011 conn(0x7f12a80a2a20 msgr2=0x7f12a80a2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f023cd5d640 1 -- 172.21.15.46:0/538261394 shutdown_connections 2024-05-08T02:45:33.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f12ada20640 1 -- 172.21.15.46:0/733623011 shutdown_connections 2024-05-08T02:45:33.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f023cd5d640 1 -- 172.21.15.46:0/538261394 wait complete. 2024-05-08T02:45:33.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f12ada20640 1 -- 172.21.15.46:0/733623011 wait complete. 2024-05-08T02:45:33.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f1741ffb640 1 -- 172.21.15.46:0/819313195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f173800e230 con 0x7f174412ed90 2024-05-08T02:45:33.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.028+0000 7f1741ffb640 1 -- 172.21.15.46:0/819313195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f173800e4d0 con 0x7f174412ed90 2024-05-08T02:45:33.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f023cd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f12ada20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f83e66ad640 1 -- 172.21.15.46:0/2096331274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e009e710 msgr2=0x7f83e00a0b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f83e66ad640 1 --2- 172.21.15.46:0/2096331274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e009e710 0x7f83e00a0b80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f174935d640 1 -- 172.21.15.46:0/819313195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174412ed90 msgr2=0x7f1744136900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f174935d640 1 --2- 172.21.15.46:0/819313195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174412ed90 0x7f1744136900 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f83e66ad640 1 -- 172.21.15.46:0/2096331274 shutdown_connections 2024-05-08T02:45:33.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f174935d640 1 -- 172.21.15.46:0/819313195 shutdown_connections 2024-05-08T02:45:33.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f174935d640 1 --2- 172.21.15.46:0/819313195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174412ed90 0x7f1744136900 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f83e66ad640 1 --2- 172.21.15.46:0/2096331274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e009e710 0x7f83e00a0b80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f174935d640 1 -- 172.21.15.46:0/819313195 >> 172.21.15.46:0/819313195 conn(0x7f17440a19a0 msgr2=0x7f17440a1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f83e66ad640 1 -- 172.21.15.46:0/2096331274 >> 172.21.15.46:0/2096331274 conn(0x7f83e00a3af0 msgr2=0x7f83e00a3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f174935d640 1 -- 172.21.15.46:0/819313195 shutdown_connections 2024-05-08T02:45:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f174935d640 1 -- 172.21.15.46:0/819313195 wait complete. 2024-05-08T02:45:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.029+0000 7f83e66ad640 1 -- 172.21.15.46:0/2096331274 shutdown_connections 2024-05-08T02:45:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.030+0000 7f83e66ad640 1 -- 172.21.15.46:0/2096331274 wait complete. 2024-05-08T02:45:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.030+0000 7f174935d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.030+0000 7f83e66ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.031+0000 7f023cd5d640 1 Processor -- start 2024-05-08T02:45:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.031+0000 7f023cd5d640 1 -- start start 2024-05-08T02:45:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.031+0000 7f12ada20640 1 Processor -- start 2024-05-08T02:45:33.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.032+0000 7f12ada20640 1 -- start start 2024-05-08T02:45:33.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.032+0000 7f174935d640 1 Processor -- start 2024-05-08T02:45:33.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.032+0000 7f174935d640 1 -- start start 2024-05-08T02:45:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.032+0000 7f023cd5d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02380a3560 0x7f02380720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.032+0000 7f023cd5d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0238075070 con 0x7f02380a3560 2024-05-08T02:45:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f023659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02380a3560 0x7f02380720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f023659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02380a3560 0x7f02380720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60682/0 (socket says 172.21.15.46:60682) 2024-05-08T02:45:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f023659c640 1 -- 172.21.15.46:0/3279866989 learned_addr learned my addr 172.21.15.46:0/3279866989 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:33.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f83e66ad640 1 Processor -- start 2024-05-08T02:45:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f023659c640 1 -- 172.21.15.46:0/3279866989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023811b970 con 0x7f02380a3560 2024-05-08T02:45:33.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f83e66ad640 1 -- start start 2024-05-08T02:45:33.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f023659c640 1 --2- 172.21.15.46:0/3279866989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02380a3560 0x7f02380720c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f022effd640 1 -- 172.21.15.46:0/3279866989 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f022800c870 con 0x7f02380a3560 2024-05-08T02:45:33.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f022effd640 1 -- 172.21.15.46:0/3279866989 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f022800c9d0 con 0x7f02380a3560 2024-05-08T02:45:33.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023806bcd0 con 0x7f02380a3560 2024-05-08T02:45:33.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.033+0000 7f022effd640 1 -- 172.21.15.46:0/3279866989 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f022800cc70 con 0x7f02380a3560 2024-05-08T02:45:33.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f023806c350 con 0x7f02380a3560 2024-05-08T02:45:33.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f174935d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17440a3560 0x7f174411bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17440a3560 0x7f174411bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17440a3560 0x7f174411bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60692/0 (socket says 172.21.15.46:60692) 2024-05-08T02:45:33.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f1742ffd640 1 -- 172.21.15.46:0/328533118 learned_addr learned my addr 172.21.15.46:0/328533118 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:33.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f174411ce50 con 0x7f17440a3560 2024-05-08T02:45:33.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f12ada20640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 0x7f12a809dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f12ada20640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f12a809d890 con 0x7f12a812fe80 2024-05-08T02:45:33.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f12a6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 0x7f12a809dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f12a6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 0x7f12a809dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60702/0 (socket says 172.21.15.46:60702) 2024-05-08T02:45:33.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f12a6ffd640 1 -- 172.21.15.46:0/134676161 learned_addr learned my addr 172.21.15.46:0/134676161 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:33.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.034+0000 7f1742ffd640 1 -- 172.21.15.46:0/328533118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174411f7a0 con 0x7f17440a3560 2024-05-08T02:45:33.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f1742ffd640 1 --2- 172.21.15.46:0/328533118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17440a3560 0x7f174411bdb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f172b7fe640 1 -- 172.21.15.46:0/328533118 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1734005a60 con 0x7f17440a3560 2024-05-08T02:45:33.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f172b7fe640 1 -- 172.21.15.46:0/328533118 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1734005bc0 con 0x7f17440a3560 2024-05-08T02:45:33.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0238063900 con 0x7f02380a3560 2024-05-08T02:45:33.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f12a6ffd640 1 -- 172.21.15.46:0/134676161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a811be20 con 0x7f12a812fe80 2024-05-08T02:45:33.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174411f9d0 con 0x7f17440a3560 2024-05-08T02:45:33.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f172b7fe640 1 -- 172.21.15.46:0/328533118 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1734005e60 con 0x7f17440a3560 2024-05-08T02:45:33.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f12a6ffd640 1 --2- 172.21.15.46:0/134676161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 0x7f12a809dde0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f83e66ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e00a10c0 0x7f83e01c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f022effd640 1 -- 172.21.15.46:0/3279866989 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0228011310 con 0x7f02380a3560 2024-05-08T02:45:33.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f022effd640 1 --2- 172.21.15.46:0/3279866989 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0218038930 0x7f021803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.035+0000 7f022effd640 1 -- 172.21.15.46:0/3279866989 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f02280488b0 con 0x7f02380a3560 2024-05-08T02:45:33.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f83e66ad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f83e01237b0 con 0x7f83e00a10c0 2024-05-08T02:45:33.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174411e960 con 0x7f17440a3560 2024-05-08T02:45:33.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f83dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e00a10c0 0x7f83e01c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f83dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e00a10c0 0x7f83e01c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60708/0 (socket says 172.21.15.46:60708) 2024-05-08T02:45:33.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f83dffff640 1 -- 172.21.15.46:0/2972578324 learned_addr learned my addr 172.21.15.46:0/2972578324 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:33.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f022ffff640 1 --2- 172.21.15.46:0/3279866989 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0218038930 0x7f021803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f172b7fe640 1 -- 172.21.15.46:0/328533118 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f173400c7a0 con 0x7f17440a3560 2024-05-08T02:45:33.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f83dffff640 1 -- 172.21.15.46:0/2972578324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e01c9000 con 0x7f83e00a10c0 2024-05-08T02:45:33.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.036+0000 7f172b7fe640 1 --2- 172.21.15.46:0/328533118 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1730038930 0x7f173003ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.037+0000 7f83dffff640 1 --2- 172.21.15.46:0/2972578324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e00a10c0 0x7f83e01c96b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.037+0000 7f17427fc640 1 --2- 172.21.15.46:0/328533118 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1730038930 0x7f173003ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.037+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174411e600 con 0x7f17440a3560 2024-05-08T02:45:33.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.037+0000 7f022ffff640 1 --2- 172.21.15.46:0/3279866989 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0218038930 0x7f021803ae40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.037+0000 7f17427fc640 1 --2- 172.21.15.46:0/328533118 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1730038930 0x7f173003ae40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.041+0000 7f128ffff640 1 -- 172.21.15.46:0/134676161 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1298004b80 con 0x7f12a812fe80 2024-05-08T02:45:33.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.041+0000 7f022effd640 1 -- 172.21.15.46:0/3279866989 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f022800ab90 con 0x7f02380a3560 2024-05-08T02:45:33.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.041+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a809d4f0 con 0x7f12a812fe80 2024-05-08T02:45:33.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.041+0000 7f172b7fe640 1 -- 172.21.15.46:0/328533118 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f173400adb0 con 0x7f17440a3560 2024-05-08T02:45:33.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.042+0000 7f128ffff640 1 -- 172.21.15.46:0/134676161 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1298004ce0 con 0x7f12a812fe80 2024-05-08T02:45:33.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.042+0000 7f83dcff9640 1 -- 172.21.15.46:0/2972578324 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83d800e040 con 0x7f83e00a10c0 2024-05-08T02:45:33.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.042+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a811d5b0 con 0x7f12a812fe80 2024-05-08T02:45:33.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.042+0000 7f128ffff640 1 -- 172.21.15.46:0/134676161 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1298007120 con 0x7f12a812fe80 2024-05-08T02:45:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.042+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e01c9310 con 0x7f83e00a10c0 2024-05-08T02:45:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.042+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e0123c10 con 0x7f83e00a10c0 2024-05-08T02:45:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.042+0000 7f83dcff9640 1 -- 172.21.15.46:0/2972578324 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f83d8011870 con 0x7f83e00a10c0 2024-05-08T02:45:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.042+0000 7f83dcff9640 1 -- 172.21.15.46:0/2972578324 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f83d8011b10 con 0x7f83e00a10c0 2024-05-08T02:45:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.043+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a812d0e0 con 0x7f12a812fe80 2024-05-08T02:45:33.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.043+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e0069330 con 0x7f83e00a10c0 2024-05-08T02:45:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.047+0000 7f172b7fe640 1 -- 172.21.15.46:0/328533118 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f17340096a0 con 0x7f17440a3560 2024-05-08T02:45:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.048+0000 7f128ffff640 1 -- 172.21.15.46:0/134676161 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f12980072d0 con 0x7f12a812fe80 2024-05-08T02:45:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.048+0000 7f128ffff640 1 --2- 172.21.15.46:0/134676161 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1294038980 0x7f129403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.048+0000 7f128ffff640 1 -- 172.21.15.46:0/134676161 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f1298048720 con 0x7f12a812fe80 2024-05-08T02:45:33.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.048+0000 7f12a67fc640 1 --2- 172.21.15.46:0/134676161 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1294038980 0x7f129403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.049+0000 7f83dcff9640 1 -- 172.21.15.46:0/2972578324 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f83d8011c70 con 0x7f83e00a10c0 2024-05-08T02:45:33.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.049+0000 7f12a67fc640 1 --2- 172.21.15.46:0/134676161 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1294038980 0x7f129403ae90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.049+0000 7f83dcff9640 1 --2- 172.21.15.46:0/2972578324 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f83cc038980 0x7f83cc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.049+0000 7f83dcff9640 1 -- 172.21.15.46:0/2972578324 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f83d8049980 con 0x7f83e00a10c0 2024-05-08T02:45:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.049+0000 7f83df7fe640 1 --2- 172.21.15.46:0/2972578324 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f83cc038980 0x7f83cc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.050+0000 7f83df7fe640 1 --2- 172.21.15.46:0/2972578324 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f83cc038980 0x7f83cc03ae90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.054+0000 7f128ffff640 1 -- 172.21.15.46:0/134676161 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f129800dc50 con 0x7f12a812fe80 2024-05-08T02:45:33.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.059+0000 7f83dcff9640 1 -- 172.21.15.46:0/2972578324 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f83d8009a80 con 0x7f83e00a10c0 2024-05-08T02:45:33.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.251+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f023812e0e0 con 0x7f02380a3560 2024-05-08T02:45:33.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.252+0000 7f022effd640 1 -- 172.21.15.46:0/3279866989 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f022800a9b0 con 0x7f02380a3560 2024-05-08T02:45:33.256 INFO:teuthology.orchestra.run.smithi046.stdout:38654705670 2024-05-08T02:45:33.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0218038930 msgr2=0x7f021803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 --2- 172.21.15.46:0/3279866989 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0218038930 0x7f021803ae40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02380a3560 msgr2=0x7f02380720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 --2- 172.21.15.46:0/3279866989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02380a3560 0x7f02380720c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 shutdown_connections 2024-05-08T02:45:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 --2- 172.21.15.46:0/3279866989 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0218038930 0x7f021803ae40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 --2- 172.21.15.46:0/3279866989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02380a3560 0x7f02380720c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 >> 172.21.15.46:0/3279866989 conn(0x7f02380a19a0 msgr2=0x7f023809e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 shutdown_connections 2024-05-08T02:45:33.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.254+0000 7f023cd5d640 1 -- 172.21.15.46:0/3279866989 wait complete. 2024-05-08T02:45:33.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.258+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1744063900 con 0x7f17440a3560 2024-05-08T02:45:33.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.258+0000 7f172b7fe640 1 -- 172.21.15.46:0/328533118 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f173400edb0 con 0x7f17440a3560 2024-05-08T02:45:33.262 INFO:teuthology.orchestra.run.smithi046.stdout:38654705670 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1730038930 msgr2=0x7f173003ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 --2- 172.21.15.46:0/328533118 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1730038930 0x7f173003ae40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17440a3560 msgr2=0x7f174411bdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 --2- 172.21.15.46:0/328533118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17440a3560 0x7f174411bdb0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 shutdown_connections 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 --2- 172.21.15.46:0/328533118 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1730038930 0x7f173003ae40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 --2- 172.21.15.46:0/328533118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17440a3560 0x7f174411bdb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 >> 172.21.15.46:0/328533118 conn(0x7f17440a19a0 msgr2=0x7f1744131460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 shutdown_connections 2024-05-08T02:45:33.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.261+0000 7f174935d640 1 -- 172.21.15.46:0/328533118 wait complete. 2024-05-08T02:45:33.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-05-08T02:45:33.270 DEBUG:teuthology.parallel:result is None 2024-05-08T02:45:33.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-05-08T02:45:33.281 DEBUG:teuthology.parallel:result is None 2024-05-08T02:45:33.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.294+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f12a8063900 con 0x7f12a812fe80 2024-05-08T02:45:33.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.294+0000 7f128ffff640 1 -- 172.21.15.46:0/134676161 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f129800d150 con 0x7f12a812fe80 2024-05-08T02:45:33.298 INFO:teuthology.orchestra.run.smithi046.stdout:38654705670 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.296+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1294038980 msgr2=0x7f129403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.296+0000 7f12ada20640 1 --2- 172.21.15.46:0/134676161 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1294038980 0x7f129403ae90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.296+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 msgr2=0x7f12a809dde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.296+0000 7f12ada20640 1 --2- 172.21.15.46:0/134676161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 0x7f12a809dde0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.296+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 shutdown_connections 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.296+0000 7f12ada20640 1 --2- 172.21.15.46:0/134676161 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1294038980 0x7f129403ae90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.296+0000 7f12ada20640 1 --2- 172.21.15.46:0/134676161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12a812fe80 0x7f12a809dde0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.296+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 >> 172.21.15.46:0/134676161 conn(0x7f12a80a2a20 msgr2=0x7f12a80a2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.297+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 shutdown_connections 2024-05-08T02:45:33.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.297+0000 7f12ada20640 1 -- 172.21.15.46:0/134676161 wait complete. 2024-05-08T02:45:33.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.305+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f83e0063900 con 0x7f83e00a10c0 2024-05-08T02:45:33.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.305+0000 7f83dcff9640 1 -- 172.21.15.46:0/2972578324 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f83d800faa0 con 0x7f83e00a10c0 2024-05-08T02:45:33.309 INFO:teuthology.orchestra.run.smithi046.stdout:38654705670 2024-05-08T02:45:33.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-05-08T02:45:33.312 DEBUG:teuthology.parallel:result is None 2024-05-08T02:45:33.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f83cc038980 msgr2=0x7f83cc03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 --2- 172.21.15.46:0/2972578324 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f83cc038980 0x7f83cc03ae90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e00a10c0 msgr2=0x7f83e01c96b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 --2- 172.21.15.46:0/2972578324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e00a10c0 0x7f83e01c96b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 shutdown_connections 2024-05-08T02:45:33.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 --2- 172.21.15.46:0/2972578324 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f83cc038980 0x7f83cc03ae90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 --2- 172.21.15.46:0/2972578324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83e00a10c0 0x7f83e01c96b0 crc :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 >> 172.21.15.46:0/2972578324 conn(0x7f83e00a3af0 msgr2=0x7f83e00a1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 shutdown_connections 2024-05-08T02:45:33.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.308+0000 7f83e66ad640 1 -- 172.21.15.46:0/2972578324 wait complete. 2024-05-08T02:45:33.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2024-05-08T02:45:33.323 DEBUG:teuthology.parallel:result is None 2024-05-08T02:45:33.323 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T02:45:33.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T02:45:33.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.468+0000 7fddfa55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.473+0000 7fddfa55d640 1 Processor -- start 2024-05-08T02:45:33.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.473+0000 7fddfa55d640 1 -- start start 2024-05-08T02:45:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.475+0000 7fddfa55d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fddf4133380 0x7fddf4137b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.475+0000 7fddfa55d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf4133790 con 0x7fddf409ce30 2024-05-08T02:45:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.475+0000 7fddfa55d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fddf409c440 con 0x7fddf4133380 2024-05-08T02:45:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.475+0000 7fddf37fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fddf4133380 0x7fddf4137b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.475+0000 7fddf3fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fddf409ce30 0x7fddf4132c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45362/0 (socket says 172.21.15.46:45362) 2024-05-08T02:45:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.475+0000 7fddf3fff640 1 -- 172.21.15.46:0/3321977059 learned_addr learned my addr 172.21.15.46:0/3321977059 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.475+0000 7fddf37fe640 1 -- 172.21.15.46:0/3321977059 >> v1:172.21.15.46:6789/0 conn(0x7fddf409ce30 legacy=0x7fddf4132c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.475+0000 7fddf37fe640 1 -- 172.21.15.46:0/3321977059 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf409dc80 con 0x7fddf4133380 2024-05-08T02:45:33.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.475+0000 7fddf2ffd640 1 -- 172.21.15.46:0/3321977059 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520050073 0 0) 0x7fdde4001110 con 0x7fddf409ce30 2024-05-08T02:45:33.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.476+0000 7fddf37fe640 1 --2- 172.21.15.46:0/3321977059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf4133380 0x7fddf4137b60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e92b7db2a872e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.476+0000 7fddf2ffd640 1 -- 172.21.15.46:0/3321977059 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdde8009d90 con 0x7fddf4133380 2024-05-08T02:45:33.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.476+0000 7fddf2ffd640 1 -- 172.21.15.46:0/3321977059 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdde800e230 con 0x7fddf4133380 2024-05-08T02:45:33.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.476+0000 7fddf2ffd640 1 -- 172.21.15.46:0/3321977059 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdde800e4d0 con 0x7fddf4133380 2024-05-08T02:45:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.476+0000 7fddfa55d640 1 -- 172.21.15.46:0/3321977059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf4133380 msgr2=0x7fddf4137b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.476+0000 7fddfa55d640 1 --2- 172.21.15.46:0/3321977059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf4133380 0x7fddf4137b60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.476+0000 7fddfa55d640 1 -- 172.21.15.46:0/3321977059 shutdown_connections 2024-05-08T02:45:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.476+0000 7fddfa55d640 1 --2- 172.21.15.46:0/3321977059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf4133380 0x7fddf4137b60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.476+0000 7fddfa55d640 1 -- 172.21.15.46:0/3321977059 >> 172.21.15.46:0/3321977059 conn(0x7fddf409aa00 msgr2=0x7fddf409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.477+0000 7fddfa55d640 1 -- 172.21.15.46:0/3321977059 shutdown_connections 2024-05-08T02:45:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.477+0000 7fddfa55d640 1 -- 172.21.15.46:0/3321977059 wait complete. 2024-05-08T02:45:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.477+0000 7fddfa55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.478+0000 7fddfa55d640 1 Processor -- start 2024-05-08T02:45:33.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.479+0000 7fddfa55d640 1 -- start start 2024-05-08T02:45:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.480+0000 7fddfa55d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf409ce30 0x7fddf411d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.480+0000 7fddfa55d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fddf411cc20 con 0x7fddf409ce30 2024-05-08T02:45:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.480+0000 7fddf3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf409ce30 0x7fddf411d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.480+0000 7fddf3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf409ce30 0x7fddf411d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60712/0 (socket says 172.21.15.46:60712) 2024-05-08T02:45:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.480+0000 7fddf3fff640 1 -- 172.21.15.46:0/4225780991 learned_addr learned my addr 172.21.15.46:0/4225780991 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.481+0000 7fddf3fff640 1 -- 172.21.15.46:0/4225780991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf411d1f0 con 0x7fddf409ce30 2024-05-08T02:45:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.481+0000 7fddf3fff640 1 --2- 172.21.15.46:0/4225780991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf409ce30 0x7fddf411d6b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.481+0000 7fddf0ff9640 1 -- 172.21.15.46:0/4225780991 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdde4004b80 con 0x7fddf409ce30 2024-05-08T02:45:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.481+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf4120c40 con 0x7fddf409ce30 2024-05-08T02:45:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.481+0000 7fddf0ff9640 1 -- 172.21.15.46:0/4225780991 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdde4004ce0 con 0x7fddf409ce30 2024-05-08T02:45:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.481+0000 7fddf0ff9640 1 -- 172.21.15.46:0/4225780991 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdde4007120 con 0x7fddf409ce30 2024-05-08T02:45:33.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.481+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf411ce50 con 0x7fddf409ce30 2024-05-08T02:45:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.482+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf4063900 con 0x7fddf409ce30 2024-05-08T02:45:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.482+0000 7fddf0ff9640 1 -- 172.21.15.46:0/4225780991 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fdde4007320 con 0x7fddf409ce30 2024-05-08T02:45:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.482+0000 7fddf0ff9640 1 --2- 172.21.15.46:0/4225780991 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdde0038930 0x7fdde003ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.482+0000 7fddf0ff9640 1 -- 172.21.15.46:0/4225780991 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fdde4048200 con 0x7fddf409ce30 2024-05-08T02:45:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.482+0000 7fddf37fe640 1 --2- 172.21.15.46:0/4225780991 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdde0038930 0x7fdde003ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.483+0000 7fddf37fe640 1 --2- 172.21.15.46:0/4225780991 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdde0038930 0x7fdde003ae40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.487+0000 7fddf0ff9640 1 -- 172.21.15.46:0/4225780991 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fdde400a670 con 0x7fddf409ce30 2024-05-08T02:45:33.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.669+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fddf409ba30 con 0x7fdde0038930 2024-05-08T02:45:33.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.671+0000 7fddf0ff9640 1 -- 172.21.15.46:0/4225780991 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31068 (crc 0 0 0) 0x7fdde800e3a0 con 0x7fdde0038930 2024-05-08T02:45:33.676 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:45:33.676 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.673+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdde0038930 msgr2=0x7fdde003ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.673+0000 7fddfa55d640 1 --2- 172.21.15.46:0/4225780991 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdde0038930 0x7fdde003ae40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.673+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf409ce30 msgr2=0x7fddf411d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.673+0000 7fddfa55d640 1 --2- 172.21.15.46:0/4225780991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf409ce30 0x7fddf411d6b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.673+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 shutdown_connections 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.673+0000 7fddfa55d640 1 --2- 172.21.15.46:0/4225780991 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdde0038930 0x7fdde003ae40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.673+0000 7fddfa55d640 1 --2- 172.21.15.46:0/4225780991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fddf409ce30 0x7fddf411d6b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.673+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 >> 172.21.15.46:0/4225780991 conn(0x7fddf409aa00 msgr2=0x7fddf409fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.674+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 shutdown_connections 2024-05-08T02:45:33.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.674+0000 7fddfa55d640 1 -- 172.21.15.46:0/4225780991 wait complete. 2024-05-08T02:45:33.688 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-05-08T02:45:32.833459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109776,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320624,"statfs":{"total":429496729600,"available":429384318976,"internally_reserved":0,"allocated":1630208,"data_stored":1289732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.651306+0000","last_change":"2024-05-08T02:45:31.653041+0000","last_active":"2024-05-08T02:45:31.651306+0000","last_peered":"2024-05-08T02:45:31.651306+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.647316+0000","last_became_peered":"2024-05-08T02:45:31.647316+0000","last_unstale":"2024-05-08T02:45:31.651306+0000","last_undegraded":"2024-05-08T02:45:31.651306+0000","last_fullsized":"2024-05-08T02:45:31.651306+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.639930+0000","last_change":"2024-05-08T02:45:31.640980+0000","last_active":"2024-05-08T02:45:31.639930+0000","last_peered":"2024-05-08T02:45:31.639930+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.636059+0000","last_became_peered":"2024-05-08T02:45:31.636059+0000","last_unstale":"2024-05-08T02:45:31.639930+0000","last_undegraded":"2024-05-08T02:45:31.639930+0000","last_fullsized":"2024-05-08T02:45:31.639930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T02:45:32.582586+0000","last_change":"2024-05-08T02:45:31.616723+0000","last_active":"2024-05-08T02:45:32.582586+0000","last_peered":"2024-05-08T02:45:32.582586+0000","last_clean":"2024-05-08T02:45:32.582586+0000","last_became_active":"2024-05-08T02:45:31.611005+0000","last_became_peered":"2024-05-08T02:45:31.611005+0000","last_unstale":"2024-05-08T02:45:32.582586+0000","last_undegraded":"2024-05-08T02:45:32.582586+0000","last_fullsized":"2024-05-08T02:45:32.582586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.622787+0000","last_change":"2024-05-08T02:45:31.623778+0000","last_active":"2024-05-08T02:45:31.622787+0000","last_peered":"2024-05-08T02:45:31.622787+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.617883+0000","last_became_peered":"2024-05-08T02:45:31.617883+0000","last_unstale":"2024-05-08T02:45:31.622787+0000","last_undegraded":"2024-05-08T02:45:31.622787+0000","last_fullsized":"2024-05-08T02:45:31.622787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.633190+0000","last_change":"2024-05-08T02:45:31.634126+0000","last_active":"2024-05-08T02:45:31.633190+0000","last_peered":"2024-05-08T02:45:31.633190+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.628702+0000","last_became_peered":"2024-05-08T02:45:31.628702+0000","last_unstale":"2024-05-08T02:45:31.633190+0000","last_undegraded":"2024-05-08T02:45:31.633190+0000","last_fullsized":"2024-05-08T02:45:31.633190+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.619587+0000","last_change":"2024-05-08T02:45:31.621292+0000","last_active":"2024-05-08T02:45:31.619587+0000","last_peered":"2024-05-08T02:45:31.619587+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.615285+0000","last_became_peered":"2024-05-08T02:45:31.615285+0000","last_unstale":"2024-05-08T02:45:31.619587+0000","last_undegraded":"2024-05-08T02:45:31.619587+0000","last_fullsized":"2024-05-08T02:45:31.619587+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.633924+0000","last_change":"2024-05-08T02:45:31.635093+0000","last_active":"2024-05-08T02:45:31.633924+0000","last_peered":"2024-05-08T02:45:31.633924+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.629721+0000","last_became_peered":"2024-05-08T02:45:31.629721+0000","last_unstale":"2024-05-08T02:45:31.633924+0000","last_undegraded":"2024-05-08T02:45:31.633924+0000","last_fullsized":"2024-05-08T02:45:31.633924+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.647431+0000","last_change":"2024-05-08T02:45:31.648464+0000","last_active":"2024-05-08T02:45:31.647431+0000","last_peered":"2024-05-08T02:45:31.647431+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.642977+0000","last_became_peered":"2024-05-08T02:45:31.642977+0000","last_unstale":"2024-05-08T02:45:31.647431+0000","last_undegraded":"2024-05-08T02:45:31.647431+0000","last_fullsized":"2024-05-08T02:45:31.647431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":144,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T02:45:32.579020+0000","last_change":"2024-05-08T02:45:29.600723+0000","last_active":"2024-05-08T02:45:32.579020+0000","last_peered":"2024-05-08T02:45:32.579020+0000","last_clean":"2024-05-08T02:45:32.579020+0000","last_became_active":"2024-05-08T02:45:29.595527+0000","last_became_peered":"2024-05-08T02:45:29.595527+0000","last_unstale":"2024-05-08T02:45:32.579020+0000","last_undegraded":"2024-05-08T02:45:32.579020+0000","last_fullsized":"2024-05-08T02:45:32.579020+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_clean_scrub_stamp":"2024-05-08T02:45:28.553006+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T02:45:33.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T02:45:33.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.795+0000 7fc87d39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.800+0000 7fc87d39d640 1 Processor -- start 2024-05-08T02:45:33.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.800+0000 7fc87d39d640 1 -- start start 2024-05-08T02:45:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.801+0000 7fc87d39d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc87809f630 0x7fc8780a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc87d39d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87809ddd0 con 0x7fc8780a0c30 2024-05-08T02:45:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc87d39d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc87809fa40 con 0x7fc87809f630 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc876ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc87809f630 0x7fc8780a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc8767fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc8780a0c30 0x7fc878134940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45370/0 (socket says 172.21.15.46:45370) 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc8767fc640 1 -- 172.21.15.46:0/814959351 learned_addr learned my addr 172.21.15.46:0/814959351 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc876ffd640 1 -- 172.21.15.46:0/814959351 >> v1:172.21.15.46:6789/0 conn(0x7fc8780a0c30 legacy=0x7fc878134940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc876ffd640 1 -- 172.21.15.46:0/814959351 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87809f100 con 0x7fc87809f630 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc875ffb640 1 -- 172.21.15.46:0/814959351 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377572502 0 0) 0x7fc87809ddd0 con 0x7fc8780a0c30 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc876ffd640 1 --2- 172.21.15.46:0/814959351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 0x7fc8780a06f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9138100fab18b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc875ffb640 1 -- 172.21.15.46:0/814959351 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc868009d90 con 0x7fc87809f630 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc875ffb640 1 -- 172.21.15.46:0/814959351 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc86800e230 con 0x7fc87809f630 2024-05-08T02:45:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.802+0000 7fc875ffb640 1 -- 172.21.15.46:0/814959351 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc86800e4d0 con 0x7fc87809f630 2024-05-08T02:45:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.803+0000 7fc87d39d640 1 -- 172.21.15.46:0/814959351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 msgr2=0x7fc8780a06f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.803+0000 7fc87d39d640 1 --2- 172.21.15.46:0/814959351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 0x7fc8780a06f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.803+0000 7fc87d39d640 1 -- 172.21.15.46:0/814959351 shutdown_connections 2024-05-08T02:45:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.803+0000 7fc87d39d640 1 --2- 172.21.15.46:0/814959351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 0x7fc8780a06f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.803+0000 7fc87d39d640 1 -- 172.21.15.46:0/814959351 >> 172.21.15.46:0/814959351 conn(0x7fc8780a3950 msgr2=0x7fc8780a3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.803+0000 7fc87d39d640 1 -- 172.21.15.46:0/814959351 shutdown_connections 2024-05-08T02:45:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.803+0000 7fc87d39d640 1 -- 172.21.15.46:0/814959351 wait complete. 2024-05-08T02:45:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.803+0000 7fc87d39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.805+0000 7fc87d39d640 1 Processor -- start 2024-05-08T02:45:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.805+0000 7fc87d39d640 1 -- start start 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.807+0000 7fc87d39d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 0x7fc87811dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.807+0000 7fc87d39d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc87811f510 con 0x7fc87809f630 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.807+0000 7fc876ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 0x7fc87811dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.807+0000 7fc876ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 0x7fc87811dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60734/0 (socket says 172.21.15.46:60734) 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.807+0000 7fc876ffd640 1 -- 172.21.15.46:0/928049990 learned_addr learned my addr 172.21.15.46:0/928049990 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.807+0000 7fc876ffd640 1 -- 172.21.15.46:0/928049990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc878121610 con 0x7fc87809f630 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.807+0000 7fc876ffd640 1 --2- 172.21.15.46:0/928049990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 0x7fc87811dff0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.808+0000 7fc85f7fe640 1 -- 172.21.15.46:0/928049990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc868013610 con 0x7fc87809f630 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.808+0000 7fc85f7fe640 1 -- 172.21.15.46:0/928049990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc868013770 con 0x7fc87809f630 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.808+0000 7fc85f7fe640 1 -- 172.21.15.46:0/928049990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc868013a10 con 0x7fc87809f630 2024-05-08T02:45:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.808+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8781207a0 con 0x7fc87809f630 2024-05-08T02:45:33.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.808+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc878122000 con 0x7fc87809f630 2024-05-08T02:45:33.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.809+0000 7fc85f7fe640 1 -- 172.21.15.46:0/928049990 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc868013c10 con 0x7fc87809f630 2024-05-08T02:45:33.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.809+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87809fd20 con 0x7fc87809f630 2024-05-08T02:45:33.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.809+0000 7fc85f7fe640 1 --2- 172.21.15.46:0/928049990 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc864038930 0x7fc86403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:33.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.809+0000 7fc85f7fe640 1 -- 172.21.15.46:0/928049990 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fc868018040 con 0x7fc87809f630 2024-05-08T02:45:33.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.809+0000 7fc8767fc640 1 --2- 172.21.15.46:0/928049990 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc864038930 0x7fc86403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:33.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.810+0000 7fc8767fc640 1 --2- 172.21.15.46:0/928049990 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc864038930 0x7fc86403ae40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:33.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.814+0000 7fc85f7fe640 1 -- 172.21.15.46:0/928049990 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fc868018c30 con 0x7fc87809f630 2024-05-08T02:45:33.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.995+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8780a0020 con 0x7fc864038930 2024-05-08T02:45:34.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.997+0000 7fc85f7fe640 1 -- 172.21.15.46:0/928049990 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31068 (crc 0 0 0) 0x7fc8780a0020 con 0x7fc864038930 2024-05-08T02:45:34.001 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:45:34.001 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-08T02:45:34.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc864038930 msgr2=0x7fc86403ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:34.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 --2- 172.21.15.46:0/928049990 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc864038930 0x7fc86403ae40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 msgr2=0x7fc87811dff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:34.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 --2- 172.21.15.46:0/928049990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 0x7fc87811dff0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 shutdown_connections 2024-05-08T02:45:34.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 --2- 172.21.15.46:0/928049990 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc864038930 0x7fc86403ae40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 --2- 172.21.15.46:0/928049990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc87809f630 0x7fc87811dff0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 >> 172.21.15.46:0/928049990 conn(0x7fc8780a3950 msgr2=0x7fc8781ba950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:34.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 shutdown_connections 2024-05-08T02:45:34.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:33.999+0000 7fc87d39d640 1 -- 172.21.15.46:0/928049990 wait complete. 2024-05-08T02:45:34.013 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-05-08T02:45:32.833459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109776,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320624,"statfs":{"total":429496729600,"available":429384318976,"internally_reserved":0,"allocated":1630208,"data_stored":1289732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.651306+0000","last_change":"2024-05-08T02:45:31.653041+0000","last_active":"2024-05-08T02:45:31.651306+0000","last_peered":"2024-05-08T02:45:31.651306+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.647316+0000","last_became_peered":"2024-05-08T02:45:31.647316+0000","last_unstale":"2024-05-08T02:45:31.651306+0000","last_undegraded":"2024-05-08T02:45:31.651306+0000","last_fullsized":"2024-05-08T02:45:31.651306+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.639930+0000","last_change":"2024-05-08T02:45:31.640980+0000","last_active":"2024-05-08T02:45:31.639930+0000","last_peered":"2024-05-08T02:45:31.639930+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.636059+0000","last_became_peered":"2024-05-08T02:45:31.636059+0000","last_unstale":"2024-05-08T02:45:31.639930+0000","last_undegraded":"2024-05-08T02:45:31.639930+0000","last_fullsized":"2024-05-08T02:45:31.639930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T02:45:32.582586+0000","last_change":"2024-05-08T02:45:31.616723+0000","last_active":"2024-05-08T02:45:32.582586+0000","last_peered":"2024-05-08T02:45:32.582586+0000","last_clean":"2024-05-08T02:45:32.582586+0000","last_became_active":"2024-05-08T02:45:31.611005+0000","last_became_peered":"2024-05-08T02:45:31.611005+0000","last_unstale":"2024-05-08T02:45:32.582586+0000","last_undegraded":"2024-05-08T02:45:32.582586+0000","last_fullsized":"2024-05-08T02:45:32.582586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.622787+0000","last_change":"2024-05-08T02:45:31.623778+0000","last_active":"2024-05-08T02:45:31.622787+0000","last_peered":"2024-05-08T02:45:31.622787+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.617883+0000","last_became_peered":"2024-05-08T02:45:31.617883+0000","last_unstale":"2024-05-08T02:45:31.622787+0000","last_undegraded":"2024-05-08T02:45:31.622787+0000","last_fullsized":"2024-05-08T02:45:31.622787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.633190+0000","last_change":"2024-05-08T02:45:31.634126+0000","last_active":"2024-05-08T02:45:31.633190+0000","last_peered":"2024-05-08T02:45:31.633190+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.628702+0000","last_became_peered":"2024-05-08T02:45:31.628702+0000","last_unstale":"2024-05-08T02:45:31.633190+0000","last_undegraded":"2024-05-08T02:45:31.633190+0000","last_fullsized":"2024-05-08T02:45:31.633190+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.619587+0000","last_change":"2024-05-08T02:45:31.621292+0000","last_active":"2024-05-08T02:45:31.619587+0000","last_peered":"2024-05-08T02:45:31.619587+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.615285+0000","last_became_peered":"2024-05-08T02:45:31.615285+0000","last_unstale":"2024-05-08T02:45:31.619587+0000","last_undegraded":"2024-05-08T02:45:31.619587+0000","last_fullsized":"2024-05-08T02:45:31.619587+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.633924+0000","last_change":"2024-05-08T02:45:31.635093+0000","last_active":"2024-05-08T02:45:31.633924+0000","last_peered":"2024-05-08T02:45:31.633924+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.629721+0000","last_became_peered":"2024-05-08T02:45:31.629721+0000","last_unstale":"2024-05-08T02:45:31.633924+0000","last_undegraded":"2024-05-08T02:45:31.633924+0000","last_fullsized":"2024-05-08T02:45:31.633924+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-05-08T02:45:31.647431+0000","last_change":"2024-05-08T02:45:31.648464+0000","last_active":"2024-05-08T02:45:31.647431+0000","last_peered":"2024-05-08T02:45:31.647431+0000","last_clean":"2024-05-08T02:45:30.560655+0000","last_became_active":"2024-05-08T02:45:31.642977+0000","last_became_peered":"2024-05-08T02:45:31.642977+0000","last_unstale":"2024-05-08T02:45:31.647431+0000","last_undegraded":"2024-05-08T02:45:31.647431+0000","last_fullsized":"2024-05-08T02:45:31.647431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":144,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T02:45:32.579020+0000","last_change":"2024-05-08T02:45:29.600723+0000","last_active":"2024-05-08T02:45:32.579020+0000","last_peered":"2024-05-08T02:45:32.579020+0000","last_clean":"2024-05-08T02:45:32.579020+0000","last_became_active":"2024-05-08T02:45:29.595527+0000","last_became_peered":"2024-05-08T02:45:29.595527+0000","last_unstale":"2024-05-08T02:45:32.579020+0000","last_undegraded":"2024-05-08T02:45:32.579020+0000","last_fullsized":"2024-05-08T02:45:32.579020+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_clean_scrub_stamp":"2024-05-08T02:45:28.553006+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T02:45:34.014 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T02:45:34.014 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T02:45:34.014 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T02:45:34.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T02:45:34.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.120+0000 7ff84779d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:34.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.124+0000 7ff84779d640 1 Processor -- start 2024-05-08T02:45:34.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.124+0000 7ff84779d640 1 -- start start 2024-05-08T02:45:34.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.125+0000 7ff84779d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff8400a0e00 0x7ff840139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:34.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.125+0000 7ff84779d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8400a1210 con 0x7ff84009f630 2024-05-08T02:45:34.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.125+0000 7ff84779d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ff84009ddd0 con 0x7ff8400a0e00 2024-05-08T02:45:34.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff844d38640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff8400a0e00 0x7ff840139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:34.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff845539640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff84009f630 0x7ff8400a06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45382/0 (socket says 172.21.15.46:45382) 2024-05-08T02:45:34.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff845539640 1 -- 172.21.15.46:0/2574890890 learned_addr learned my addr 172.21.15.46:0/2574890890 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T02:45:34.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff844d38640 1 --2- 172.21.15.46:0/2574890890 >> v2:172.21.15.46:3300/0 conn(0x7ff8400a0e00 0x7ff840139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60744/0 (socket says 172.21.15.46:60744) 2024-05-08T02:45:34.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff844d38640 1 -- 172.21.15.46:0/2574890890 >> v1:172.21.15.46:6789/0 conn(0x7ff84009f630 legacy=0x7ff8400a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:34.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff844d38640 1 -- 172.21.15.46:0/2574890890 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84009fa40 con 0x7ff8400a0e00 2024-05-08T02:45:34.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff837fff640 1 -- 172.21.15.46:0/2574890890 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800638073 0 0) 0x7ff8400a1210 con 0x7ff84009f630 2024-05-08T02:45:34.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff844d38640 1 --2- 172.21.15.46:0/2574890890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8400a0e00 0x7ff840139c60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e7fd6bd9c14e77 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:34.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff837fff640 1 -- 172.21.15.46:0/2574890890 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff830009d90 con 0x7ff8400a0e00 2024-05-08T02:45:34.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff837fff640 1 -- 172.21.15.46:0/2574890890 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff83000e230 con 0x7ff8400a0e00 2024-05-08T02:45:34.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.126+0000 7ff837fff640 1 -- 172.21.15.46:0/2574890890 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff83000e4d0 con 0x7ff8400a0e00 2024-05-08T02:45:34.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.127+0000 7ff84779d640 1 -- 172.21.15.46:0/2574890890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8400a0e00 msgr2=0x7ff840139c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:34.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.127+0000 7ff84779d640 1 --2- 172.21.15.46:0/2574890890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8400a0e00 0x7ff840139c60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.127+0000 7ff84779d640 1 -- 172.21.15.46:0/2574890890 shutdown_connections 2024-05-08T02:45:34.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.127+0000 7ff84779d640 1 --2- 172.21.15.46:0/2574890890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff8400a0e00 0x7ff840139c60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.127+0000 7ff84779d640 1 -- 172.21.15.46:0/2574890890 >> 172.21.15.46:0/2574890890 conn(0x7ff8400a3950 msgr2=0x7ff8400a3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:34.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.127+0000 7ff84779d640 1 -- 172.21.15.46:0/2574890890 shutdown_connections 2024-05-08T02:45:34.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.127+0000 7ff84779d640 1 -- 172.21.15.46:0/2574890890 wait complete. 2024-05-08T02:45:34.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.127+0000 7ff84779d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:45:34.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.129+0000 7ff84779d640 1 Processor -- start 2024-05-08T02:45:34.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.129+0000 7ff84779d640 1 -- start start 2024-05-08T02:45:34.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.130+0000 7ff84779d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff84009f630 0x7ff84011e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:34.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff84779d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff84011f1d0 con 0x7ff84009f630 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff845539640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff84009f630 0x7ff84011e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff845539640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff84009f630 0x7ff84011e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60746/0 (socket says 172.21.15.46:60746) 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff845539640 1 -- 172.21.15.46:0/2098158860 learned_addr learned my addr 172.21.15.46:0/2098158860 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff845539640 1 -- 172.21.15.46:0/2098158860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff840122180 con 0x7ff84009f630 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff845539640 1 --2- 172.21.15.46:0/2098158860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff84009f630 0x7ff84011e090 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff835ffb640 1 -- 172.21.15.46:0/2098158860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff83c004cf0 con 0x7ff84009f630 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff835ffb640 1 -- 172.21.15.46:0/2098158860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff83c004e50 con 0x7ff84009f630 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8401321f0 con 0x7ff84009f630 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff835ffb640 1 -- 172.21.15.46:0/2098158860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff83c007250 con 0x7ff84009f630 2024-05-08T02:45:34.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.131+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8401214c0 con 0x7ff84009f630 2024-05-08T02:45:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.132+0000 7ff835ffb640 1 -- 172.21.15.46:0/2098158860 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff83c007450 con 0x7ff84009f630 2024-05-08T02:45:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.132+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff840121f30 con 0x7ff84009f630 2024-05-08T02:45:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.133+0000 7ff835ffb640 1 --2- 172.21.15.46:0/2098158860 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff824038930 0x7ff82403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:45:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.133+0000 7ff835ffb640 1 -- 172.21.15.46:0/2098158860 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7ff83c048b40 con 0x7ff84009f630 2024-05-08T02:45:34.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.133+0000 7ff844d38640 1 --2- 172.21.15.46:0/2098158860 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff824038930 0x7ff82403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:45:34.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.133+0000 7ff844d38640 1 --2- 172.21.15.46:0/2098158860 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff824038930 0x7ff82403ae40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:45:34.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.138+0000 7ff835ffb640 1 -- 172.21.15.46:0/2098158860 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ff840121f30 con 0x7ff84009f630 2024-05-08T02:45:34.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.366+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff840121f30 con 0x7ff84009f630 2024-05-08T02:45:34.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.366+0000 7ff835ffb640 1 -- 172.21.15.46:0/2098158860 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7ff840121f30 con 0x7ff84009f630 2024-05-08T02:45:34.371 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T02:45:34.371 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T02:45:34.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.368+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff824038930 msgr2=0x7ff82403ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:34.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.368+0000 7ff84779d640 1 --2- 172.21.15.46:0/2098158860 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff824038930 0x7ff82403ae40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.368+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff84009f630 msgr2=0x7ff84011e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:45:34.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.368+0000 7ff84779d640 1 --2- 172.21.15.46:0/2098158860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff84009f630 0x7ff84011e090 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.369+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 shutdown_connections 2024-05-08T02:45:34.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.369+0000 7ff84779d640 1 --2- 172.21.15.46:0/2098158860 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff824038930 0x7ff82403ae40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.369+0000 7ff84779d640 1 --2- 172.21.15.46:0/2098158860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff84009f630 0x7ff84011e090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:45:34.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.369+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 >> 172.21.15.46:0/2098158860 conn(0x7ff8400a3950 msgr2=0x7ff8401ba950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:45:34.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.369+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 shutdown_connections 2024-05-08T02:45:34.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T02:45:34.369+0000 7ff84779d640 1 -- 172.21.15.46:0/2098158860 wait complete. 2024-05-08T02:45:34.384 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T02:45:34.384 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T02:45:34.398 INFO:tasks.workunit:Pulling workunits from ref 4184b4e61afa6555ed712d5225eb247792c31f69 2024-05-08T02:45:34.398 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T02:45:34.398 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T02:45:34.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T02:45:34.414 INFO:teuthology.orchestra.run.smithi046.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-08T02:45:34.415 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-08T02:45:34.471 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-08T02:45:34.471 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-08T02:45:34.527 INFO:tasks.workunit:timeout=3h 2024-05-08T02:45:34.527 INFO:tasks.workunit:cleanup=True 2024-05-08T02:45:34.527 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4184b4e61afa6555ed712d5225eb247792c31f69 2024-05-08T02:45:34.584 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T02:47:00.153 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 91% (11216/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-08T02:47:00.538 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '4184b4e61afa6555ed712d5225eb247792c31f69'. 2024-05-08T02:47:00.539 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-08T02:47:00.539 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T02:47:00.540 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T02:47:00.540 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T02:47:00.540 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-08T02:47:00.540 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T02:47:00.540 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T02:47:00.540 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-08T02:47:00.540 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-05-08T02:47:00.540 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-08T02:47:00.540 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-05-08T02:47:00.541 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-08T02:47:00.541 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-05-08T02:47:00.541 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-08T02:47:00.541 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T02:47:00.541 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-05-08T02:47:00.541 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 4184b4e61af crimson/common/operation: distruct barrier after the wait future is resolved 2024-05-08T02:47:00.545 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T02:47:00.612 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T02:47:00.614 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T02:47:00.614 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T02:47:01.318 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T02:47:01.376 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T02:47:01.419 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T02:47:01.421 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T02:47:01.421 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T02:47:01.461 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T02:47:01.465 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-05-08T02:47:01.465 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T02:47:01.521 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-05-08T02:47:01.522 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-05-08T02:47:01.523 DEBUG:teuthology.orchestra.run.smithi046:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4184b4e61afa6555ed712d5225eb247792c31f69 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ parallel=1 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' --crimson = --serial ']' 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ crimson=0 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' --crimson = --crimson ']' 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ parallel=0 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ crimson=1 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ color= 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -t 1 ']' 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-05-08T02:47:01.584 INFO:tasks.workunit.client.0.smithi046.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-05-08T02:47:01.585 INFO:tasks.workunit.client.0.smithi046.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-05-08T02:47:01.585 INFO:tasks.workunit.client.0.smithi046.stderr:+ declare -A pids 2024-05-08T02:47:01.585 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:47:01.585 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:47:01.585 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_aio 2024-05-08T02:47:01.602 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:47:01.602 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 42 tests from 2 test suites. 2024-05-08T02:47:01.602 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:47:01.602 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 26 tests from LibRadosAio 2024-05-08T02:47:01.602 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.TooBig 2024-05-08T02:47:04.140 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.TooBig (2538 ms) 2024-05-08T02:47:04.141 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-05-08T02:47:07.153 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleWrite (3013 ms) 2024-05-08T02:47:07.153 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-05-08T02:47:10.165 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.WaitForSafe (3012 ms) 2024-05-08T02:47:10.165 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-05-08T02:47:13.178 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTrip (3013 ms) 2024-05-08T02:47:13.178 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-05-08T02:47:16.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTrip2 (3012 ms) 2024-05-08T02:47:16.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-05-08T02:47:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTrip3 (3014 ms) 2024-05-08T02:47:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-05-08T02:47:22.216 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripAppend (3012 ms) 2024-05-08T02:47:22.216 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-05-08T02:47:25.228 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RemoveTest (3012 ms) 2024-05-08T02:47:25.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-05-08T02:47:28.240 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3011 ms) 2024-05-08T02:47:28.240 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RmXattr 2024-05-08T02:47:31.254 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RmXattr (3014 ms) 2024-05-08T02:47:31.254 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.XattrIter 2024-05-08T02:47:34.265 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.XattrIter (3011 ms) 2024-05-08T02:47:34.265 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.IsComplete 2024-05-08T02:47:37.278 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.IsComplete (3013 ms) 2024-05-08T02:47:37.278 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.IsSafe 2024-05-08T02:47:40.287 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.IsSafe (3009 ms) 2024-05-08T02:47:40.287 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-05-08T02:47:43.303 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.ReturnValue (3016 ms) 2024-05-08T02:47:43.303 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.Flush 2024-05-08T02:47:46.314 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.Flush (3012 ms) 2024-05-08T02:47:46.315 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-05-08T02:47:49.328 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.FlushAsync (3013 ms) 2024-05-08T02:47:49.328 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-05-08T02:47:52.338 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3010 ms) 2024-05-08T02:47:52.338 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-05-08T02:47:55.112 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (2774 ms) 2024-05-08T02:47:55.112 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-05-08T02:47:58.118 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleStat (3006 ms) 2024-05-08T02:47:58.118 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-05-08T02:48:01.132 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.OperateMtime (3014 ms) 2024-05-08T02:48:01.133 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-05-08T02:48:04.143 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.Operate2Mtime (3012 ms) 2024-05-08T02:48:04.144 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-05-08T02:48:07.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleStatNS (3007 ms) 2024-05-08T02:48:07.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.StatRemove 2024-05-08T02:48:10.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.StatRemove (3012 ms) 2024-05-08T02:48:10.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-05-08T02:48:13.177 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.ExecuteClass (3014 ms) 2024-05-08T02:48:13.177 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-05-08T02:48:16.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.MultiWrite (3011 ms) 2024-05-08T02:48:16.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.AioUnlock (3014 ms) 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 26 tests from LibRadosAio (77600 ms total) 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 16 tests from LibRadosAioEC 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1100: Skipped 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-05-08T02:48:19.204 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1132: Skipped 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1149: Skipped 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1182: Skipped 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1215: Skipped 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1286: Skipped 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1326: Skipped 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1366: Skipped 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-05-08T02:48:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.Flush 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1385: Skipped 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1415: Skipped 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1454: Skipped 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1498: Skipped 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1532: Skipped 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1593: Skipped 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1649: Skipped 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio.cc:1681: Skipped 2024-05-08T02:48:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 42 tests from 2 test suites ran. (77600 ms total) 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 26 tests. 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 16 tests, listed below: 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-05-08T02:48:19.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-05-08T02:48:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-05-08T02:48:19.211 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-05-08T02:48:19.211 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:48:19.211 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:48:19.211 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_aio_pp 2024-05-08T02:48:19.226 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:48:19.226 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 57 tests from 4 test suites. 2024-05-08T02:48:19.226 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:48:19.226 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 32 tests from LibRadosAio 2024-05-08T02:48:19.226 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-05-08T02:48:22.211 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.TooBigPP (2985 ms) 2024-05-08T02:48:22.211 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-05-08T02:48:42.129 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.PoolQuotaPP (19918 ms) 2024-05-08T02:48:42.129 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-05-08T02:48:48.157 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleWritePP (6028 ms) 2024-05-08T02:48:48.158 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-05-08T02:48:51.166 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.WaitForSafePP (3009 ms) 2024-05-08T02:48:51.166 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-05-08T02:48:54.179 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripPP (3013 ms) 2024-05-08T02:48:54.179 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-05-08T02:48:57.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3015 ms) 2024-05-08T02:48:57.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-05-08T02:49:00.126 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2932 ms) 2024-05-08T02:49:00.126 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-05-08T02:49:03.135 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3010 ms) 2024-05-08T02:49:03.136 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-05-08T02:49:06.147 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.IsCompletePP (3011 ms) 2024-05-08T02:49:06.148 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-05-08T02:49:09.160 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.IsSafePP (3013 ms) 2024-05-08T02:49:09.160 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-05-08T02:49:12.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.ReturnValuePP (3002 ms) 2024-05-08T02:49:12.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.FlushPP 2024-05-08T02:49:15.175 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.FlushPP (3013 ms) 2024-05-08T02:49:15.175 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-05-08T02:49:18.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3009 ms) 2024-05-08T02:49:18.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-05-08T02:49:21.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3011 ms) 2024-05-08T02:49:21.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-05-08T02:49:24.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3014 ms) 2024-05-08T02:49:24.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-05-08T02:49:27.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3012 ms) 2024-05-08T02:49:27.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-05-08T02:49:30.140 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (2919 ms) 2024-05-08T02:49:30.140 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-05-08T02:49:33.142 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3002 ms) 2024-05-08T02:49:33.143 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-05-08T02:49:36.157 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.SimpleStatPP (3014 ms) 2024-05-08T02:49:36.157 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-05-08T02:49:39.171 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.OperateMtime (3014 ms) 2024-05-08T02:49:39.171 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-05-08T02:49:42.173 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.OperateMtime2 (3002 ms) 2024-05-08T02:49:42.173 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-05-08T02:49:45.186 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.StatRemovePP (3013 ms) 2024-05-08T02:49:45.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-05-08T02:49:48.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3011 ms) 2024-05-08T02:49:48.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.OmapPP 2024-05-08T02:49:51.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.OmapPP (3008 ms) 2024-05-08T02:49:51.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-05-08T02:49:54.219 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.MultiWritePP (3013 ms) 2024-05-08T02:49:54.219 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-05-08T02:49:57.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.AioUnlockPP (3015 ms) 2024-05-08T02:49:57.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-05-08T02:50:00.138 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2904 ms) 2024-05-08T02:50:00.138 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-05-08T02:50:03.147 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RacingRemovePP (3009 ms) 2024-05-08T02:50:03.147 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-05-08T02:50:06.158 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3011 ms) 2024-05-08T02:50:06.158 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-05-08T02:50:09.172 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3014 ms) 2024-05-08T02:50:09.173 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-05-08T02:50:11.641 INFO:tasks.workunit.client.0.smithi046.stdout:setting pool EIO 2024-05-08T02:50:21.320 INFO:tasks.workunit.client.0.smithi046.stdout:waiting for 760 2024-05-08T02:50:22.320 INFO:tasks.workunit.client.0.smithi046.stdout:waiting for 760 2024-05-08T02:50:23.320 INFO:tasks.workunit.client.0.smithi046.stdout:waiting for 760 2024-05-08T02:50:24.321 INFO:tasks.workunit.client.0.smithi046.stdout:max_success 240, min_failed 241 2024-05-08T02:50:25.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAio.PoolEIOFlag (16016 ms) 2024-05-08T02:50:25.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAio.MultiReads 2024-05-08T02:50:25.188 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:2427: Skipped 2024-05-08T02:50:25.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:25.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-05-08T02:50:25.188 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 32 tests from LibRadosAio (125962 ms total) 2024-05-08T02:50:25.189 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:50:25.189 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosAioPP 2024-05-08T02:50:25.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-05-08T02:50:28.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (3011 ms) 2024-05-08T02:50:28.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-05-08T02:50:37.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (9035 ms) 2024-05-08T02:50:37.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-05-08T02:50:52.156 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAioPP.RmXattrPP (14922 ms) 2024-05-08T02:50:52.156 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-05-08T02:50:55.169 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3013 ms) 2024-05-08T02:50:55.169 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosAioPP (29981 ms total) 2024-05-08T02:50:55.170 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:50:55.170 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosIoPP 2024-05-08T02:50:55.170 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-05-08T02:50:58.183 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.XattrListPP (3012 ms) 2024-05-08T02:50:58.183 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosIoPP (3012 ms total) 2024-05-08T02:50:58.183 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:50:58.183 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 20 tests from LibRadosAioEC 2024-05-08T02:50:58.183 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-05-08T02:50:58.183 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1384: Skipped 2024-05-08T02:50:58.183 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1419: Skipped 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1436: Skipped 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1467: Skipped 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-05-08T02:50:58.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1500: Skipped 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1605: Skipped 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1637: Skipped 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-05-08T02:50:58.185 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1705: Skipped 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1742: Skipped 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1780: Skipped 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1796: Skipped 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.186 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1824: Skipped 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1859: Skipped 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1904: Skipped 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-05-08T02:50:58.187 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1946: Skipped 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:1977: Skipped 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:2008: Skipped 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:2059: Skipped 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-05-08T02:50:58.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:2089: Skipped 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/aio_cxx.cc:2124: Skipped 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 57 tests from 4 test suites ran. (158955 ms total) 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 36 tests. 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 21 tests, listed below: 2024-05-08T02:50:58.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-05-08T02:50:58.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-05-08T02:50:58.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-05-08T02:50:58.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-05-08T02:50:58.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-05-08T02:50:58.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-05-08T02:50:58.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-05-08T02:50:58.191 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:50:58.191 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:50:58.191 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_io 2024-05-08T02:50:58.209 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:50:58.209 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 24 tests from 2 test suites. 2024-05-08T02:50:58.209 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:50:58.209 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from LibRadosIo 2024-05-08T02:51:00.148 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-05-08T02:51:00.544 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.SimpleWrite (396 ms) 2024-05-08T02:51:00.544 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.TooBig 2024-05-08T02:51:00.544 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-05-08T02:51:00.544 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-05-08T02:51:00.610 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-05-08T02:51:00.610 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-05-08T02:51:00.610 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-05-08T02:51:00.610 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-05-08T02:51:00.610 INFO:tasks.workunit.client.0.smithi046.stdout:no timeout :/ 2024-05-08T02:51:00.610 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.ReadTimeout (66 ms) 2024-05-08T02:51:00.610 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-05-08T02:51:00.645 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.RoundTrip (35 ms) 2024-05-08T02:51:00.645 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.Checksum 2024-05-08T02:51:00.658 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.Checksum (14 ms) 2024-05-08T02:51:00.659 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-05-08T02:51:00.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (25 ms) 2024-05-08T02:51:00.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-05-08T02:51:00.708 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (24 ms) 2024-05-08T02:51:00.708 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-05-08T02:51:00.732 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.AppendRoundTrip (25 ms) 2024-05-08T02:51:00.733 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-05-08T02:51:00.736 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.ZeroLenZero (4 ms) 2024-05-08T02:51:00.737 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.TruncTest 2024-05-08T02:51:00.760 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.TruncTest (23 ms) 2024-05-08T02:51:00.760 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-05-08T02:51:00.783 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.RemoveTest (23 ms) 2024-05-08T02:51:00.783 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-05-08T02:51:00.811 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (29 ms) 2024-05-08T02:51:00.811 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.RmXattr 2024-05-08T02:51:00.880 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.RmXattr (69 ms) 2024-05-08T02:51:00.881 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIo.XattrIter 2024-05-08T02:51:00.913 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIo.XattrIter (32 ms) 2024-05-08T02:51:01.191 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from LibRadosIo (765 ms total) 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from LibRadosIoEC 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:168: Skipped 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-05-08T02:51:01.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-05-08T02:51:01.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:176: Skipped 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from LibRadosIoEC (1 ms total) 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 24 tests from 2 test suites ran. (2981 ms total) 2024-05-08T02:51:01.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 14 tests. 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 10 tests, listed below: 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-05-08T02:51:01.197 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:51:01.198 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:51:01.198 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_io_pp 2024-05-08T02:51:01.216 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:51:01.216 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 38 tests from 2 test suites. 2024-05-08T02:51:01.216 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:51:01.216 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 21 tests from LibRadosIoPP 2024-05-08T02:51:01.216 INFO:tasks.workunit.client.0.smithi046.stdout:seed 32141 2024-05-08T02:51:03.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-05-08T02:51:03.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-05-08T02:51:03.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-05-08T02:51:03.637 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (439 ms) 2024-05-08T02:51:03.637 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-05-08T02:51:03.702 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.ReadOpPP (65 ms) 2024-05-08T02:51:03.702 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-05-08T02:51:03.721 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (19 ms) 2024-05-08T02:51:03.721 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-05-08T02:51:05.983 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2263 ms) 2024-05-08T02:51:05.984 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-05-08T02:51:06.001 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.RoundTripPP (17 ms) 2024-05-08T02:51:06.001 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-05-08T02:51:06.025 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (25 ms) 2024-05-08T02:51:06.026 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-05-08T02:51:06.042 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.Checksum (16 ms) 2024-05-08T02:51:06.042 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-05-08T02:51:06.059 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (17 ms) 2024-05-08T02:51:06.059 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-05-08T02:51:06.085 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (26 ms) 2024-05-08T02:51:06.085 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-05-08T02:51:06.111 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (26 ms) 2024-05-08T02:51:06.111 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-05-08T02:51:06.127 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (16 ms) 2024-05-08T02:51:06.127 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-05-08T02:51:06.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (28 ms) 2024-05-08T02:51:06.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-05-08T02:51:06.181 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.TruncTestPP (26 ms) 2024-05-08T02:51:06.181 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-05-08T02:51:06.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (24 ms) 2024-05-08T02:51:06.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-05-08T02:51:06.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (30 ms) 2024-05-08T02:51:06.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-05-08T02:51:06.307 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.RmXattrPP (72 ms) 2024-05-08T02:51:06.307 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-05-08T02:51:06.340 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.XattrListPP (33 ms) 2024-05-08T02:51:06.340 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-05-08T02:51:06.366 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.CmpExtPP (26 ms) 2024-05-08T02:51:06.366 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-05-08T02:51:06.382 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (16 ms) 2024-05-08T02:51:06.382 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-05-08T02:51:06.404 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (22 ms) 2024-05-08T02:51:07.217 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 21 tests from LibRadosIoPP (3207 ms total) 2024-05-08T02:51:07.217 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:07.217 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 17 tests from LibRadosIoECPP 2024-05-08T02:51:07.217 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:373: Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.218 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-05-08T02:51:07.219 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.221 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (1 ms) 2024-05-08T02:51:07.225 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.226 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.227 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:381: Skipped 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 17 tests from LibRadosIoECPP (1 ms total) 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 38 tests from 2 test suites ran. (5997 ms total) 2024-05-08T02:51:07.228 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 21 tests. 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 17 tests, listed below: 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-05-08T02:51:07.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-05-08T02:51:07.230 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-05-08T02:51:07.230 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-05-08T02:51:07.230 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-05-08T02:51:07.230 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-05-08T02:51:07.230 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:51:07.230 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:51:07.230 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_asio 2024-05-08T02:51:07.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.254+0000 7fa157c696c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:51:07.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.264+0000 7fa157c696c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:51:07.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.264+0000 7fa157c696c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:51:07.268 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 12 tests from 1 test suite. 2024-05-08T02:51:07.268 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:51:07.268 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 12 tests from AsioRados 2024-05-08T02:51:07.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.266+0000 7fa157c696c0 1 Processor -- start 2024-05-08T02:51:07.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.266+0000 7fa157c696c0 1 -- start start 2024-05-08T02:51:07.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.268+0000 7fa157c696c0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x186a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:51:07.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.268+0000 7fa157c696c0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x17d6950 con 0x1870090 2024-05-08T02:51:07.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.268+0000 7fa14b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x186a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:51:07.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.269+0000 7fa14b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x186a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34750/0 (socket says 172.21.15.46:34750) 2024-05-08T02:51:07.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.269+0000 7fa14b7fe640 1 -- 172.21.15.46:0/2785178969 learned_addr learned my addr 172.21.15.46:0/2785178969 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:51:07.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.269+0000 7fa14b7fe640 1 -- 172.21.15.46:0/2785178969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17751e0 con 0x1870090 2024-05-08T02:51:07.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.269+0000 7fa14b7fe640 1 --2- 172.21.15.46:0/2785178969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x186a920 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61de84612813e29 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:51:07.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.269+0000 7fa149ffb640 1 -- 172.21.15.46:0/2785178969 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa13c032040 con 0x1870090 2024-05-08T02:51:07.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.269+0000 7fa149ffb640 1 -- 172.21.15.46:0/2785178969 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa13c00a170 con 0x1870090 2024-05-08T02:51:07.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.269+0000 7fa149ffb640 1 -- 172.21.15.46:0/2785178969 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa13c02cb40 con 0x1870090 2024-05-08T02:51:07.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.271+0000 7fa157c696c0 1 -- 172.21.15.46:0/2785178969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 msgr2=0x186a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:51:07.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.271+0000 7fa157c696c0 1 --2- 172.21.15.46:0/2785178969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x186a920 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:51:07.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.271+0000 7fa157c696c0 1 -- 172.21.15.46:0/2785178969 shutdown_connections 2024-05-08T02:51:07.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.271+0000 7fa157c696c0 1 --2- 172.21.15.46:0/2785178969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x186a920 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:51:07.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.271+0000 7fa157c696c0 1 -- 172.21.15.46:0/2785178969 >> 172.21.15.46:0/2785178969 conn(0x178d960 msgr2=0x198a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:51:07.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.271+0000 7fa157c696c0 1 -- 172.21.15.46:0/2785178969 shutdown_connections 2024-05-08T02:51:07.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.271+0000 7fa157c696c0 1 -- 172.21.15.46:0/2785178969 wait complete. 2024-05-08T02:51:07.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.272+0000 7fa157c696c0 1 Processor -- start 2024-05-08T02:51:07.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.272+0000 7fa157c696c0 1 -- start start 2024-05-08T02:51:07.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.274+0000 7fa157c696c0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x1976980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:51:07.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.274+0000 7fa157c696c0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x17d43d0 con 0x1870090 2024-05-08T02:51:07.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.274+0000 7fa14b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x1976980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:51:07.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.274+0000 7fa14b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x1976980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34758/0 (socket says 172.21.15.46:34758) 2024-05-08T02:51:07.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.274+0000 7fa14b7fe640 1 -- 172.21.15.46:0/4145538762 learned_addr learned my addr 172.21.15.46:0/4145538762 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T02:51:07.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.275+0000 7fa14b7fe640 1 -- 172.21.15.46:0/4145538762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1767e30 con 0x1870090 2024-05-08T02:51:07.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.275+0000 7fa14b7fe640 1 --2- 172.21.15.46:0/4145538762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x1976980 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:51:07.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.275+0000 7fa148ff9640 1 -- 172.21.15.46:0/4145538762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa13c02cb40 con 0x1870090 2024-05-08T02:51:07.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.275+0000 7fa148ff9640 1 -- 172.21.15.46:0/4145538762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa13c02c580 con 0x1870090 2024-05-08T02:51:07.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.275+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1767890 con 0x1870090 2024-05-08T02:51:07.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.275+0000 7fa148ff9640 1 -- 172.21.15.46:0/4145538762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa13c02dc00 con 0x1870090 2024-05-08T02:51:07.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.276+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1978370 con 0x1870090 2024-05-08T02:51:07.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.276+0000 7fa148ff9640 1 -- 172.21.15.46:0/4145538762 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa13c0393f0 con 0x1870090 2024-05-08T02:51:07.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.277+0000 7fa148ff9640 1 --2- 172.21.15.46:0/4145538762 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa138037210 0x7fa138039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:51:07.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.277+0000 7fa148ff9640 1 -- 172.21.15.46:0/4145538762 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 2672+0+0 (crc 0 0 0) 0x7fa13c032040 con 0x1870090 2024-05-08T02:51:07.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.277+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x17906a0 con 0x1870090 2024-05-08T02:51:07.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.277+0000 7fa14affd640 1 --2- 172.21.15.46:0/4145538762 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa138037210 0x7fa138039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T02:51:07.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.277+0000 7fa148ff9640 1 -- 172.21.15.46:0/4145538762 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (crc 0 0 0) 0x7fa13c02ddb0 con 0x1870090 2024-05-08T02:51:07.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.277+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x17dc7b0 con 0x1870090 2024-05-08T02:51:07.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:07.278+0000 7fa14affd640 1 --2- 172.21.15.46:0/4145538762 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa138037210 0x7fa138039720 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:51:08.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:08.206+0000 7fa148ff9640 1 -- 172.21.15.46:0/4145538762 <== mon.0 v2:172.21.15.46:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v236) ==== 43+0+0 (crc 0 0 0) 0x7fa13c009a00 con 0x1870090 2024-05-08T02:51:08.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:08.206+0000 7fa148ff9640 1 -- 172.21.15.46:0/4145538762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=236}) -- 0x7fa13803bb90 con 0x1870090 2024-05-08T02:51:08.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:08.209+0000 7fa148ff9640 1 -- 172.21.15.46:0/4145538762 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(236..236 src has 1..236) ==== 651+0+0 (crc 0 0 0) 0x7fa13c03ae70 con 0x1870090 2024-05-08T02:51:08.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:08.210+0000 7fa157c696c0 1 --2- 172.21.15.46:0/4145538762 >> v2:172.21.15.46:6806/2291706666 conn(0x1871e70 0x199f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T02:51:08.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:08.210+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x197a3e0 con 0x1871e70 2024-05-08T02:51:08.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:08.212+0000 7fa14bfff640 1 --2- 172.21.15.46:0/4145538762 >> v2:172.21.15.46:6806/2291706666 conn(0x1871e70 0x199f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T02:51:08.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:08.216+0000 7fa14bfff640 1 --2- 172.21.15.46:0/4145538762 >> v2:172.21.15.46:6806/2291706666 conn(0x1871e70 0x199f320 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T02:51:09.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.527+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(2 exist [writefull 0~5] v237'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.531 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-05-08T02:51:09.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.527+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x198b1f0 con 0x1871e70 2024-05-08T02:51:09.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.527+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x198a440 con 0x1871e70 2024-05-08T02:51:09.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.541+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.541+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.545 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadCallback (14 ms) 2024-05-08T02:51:09.545 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-05-08T02:51:09.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.541+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1976ec0 con 0x1871e70 2024-05-08T02:51:09.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.541+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x199f860 con 0x1871e70 2024-05-08T02:51:09.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.555+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.556+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.560 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadFuture (15 ms) 2024-05-08T02:51:09.560 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-05-08T02:51:09.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.556+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x19bfbd0 con 0x1871e70 2024-05-08T02:51:09.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.556+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x19e03f0 con 0x1871e70 2024-05-08T02:51:09.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.566+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 6 ==== osd_op_reply(7 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.567+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 7 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.571 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadYield (11 ms) 2024-05-08T02:51:09.571 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-05-08T02:51:09.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.567+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x198a0e0 con 0x1871e70 2024-05-08T02:51:09.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.581+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 8 ==== osd_op_reply(9 exist [write 0~5] v237'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.586 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteCallback (14 ms) 2024-05-08T02:51:09.586 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-05-08T02:51:09.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.582+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x198a0e0 con 0x1871e70 2024-05-08T02:51:09.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.592+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 9 ==== osd_op_reply(10 exist [write 0~5] v237'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.596 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteFuture (10 ms) 2024-05-08T02:51:09.596 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-05-08T02:51:09.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.592+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x198a820 con 0x1871e70 2024-05-08T02:51:09.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.601+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 10 ==== osd_op_reply(11 exist [write 0~5] v237'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteYield (9 ms) 2024-05-08T02:51:09.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-05-08T02:51:09.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.601+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x198a820 con 0x1871e70 2024-05-08T02:51:09.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.601+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x19a0070 con 0x1871e70 2024-05-08T02:51:09.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.607+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 11 ==== osd_op_reply(12 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.607+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 12 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.611 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (6 ms) 2024-05-08T02:51:09.612 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-05-08T02:51:09.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.607+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x199fbc0 con 0x1871e70 2024-05-08T02:51:09.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.607+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x19a0620 con 0x1871e70 2024-05-08T02:51:09.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.613+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 13 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.613+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.617 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (7 ms) 2024-05-08T02:51:09.618 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-05-08T02:51:09.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.614+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x198a820 con 0x1871e70 2024-05-08T02:51:09.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.614+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x19a07e0 con 0x1871e70 2024-05-08T02:51:09.623 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.620+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 15 ==== osd_op_reply(16 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.620+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 16 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.624 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncReadOperationYield (6 ms) 2024-05-08T02:51:09.624 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-05-08T02:51:09.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.620+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x19a0170 con 0x1871e70 2024-05-08T02:51:09.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.628+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 17 ==== osd_op_reply(18 exist [writefull 0~5] v237'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.632 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (9 ms) 2024-05-08T02:51:09.633 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-05-08T02:51:09.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.629+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x19a0170 con 0x1871e70 2024-05-08T02:51:09.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.637+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 18 ==== osd_op_reply(19 exist [writefull 0~5] v237'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.641 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (8 ms) 2024-05-08T02:51:09.641 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-05-08T02:51:09.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.638+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x19a07e0 con 0x1871e70 2024-05-08T02:51:09.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.646+0000 7fa14bfff640 1 -- 172.21.15.46:0/4145538762 <== osd.1 v2:172.21.15.46:6806/2291706666 19 ==== osd_op_reply(20 exist [writefull 0~5] v237'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa14400a430 con 0x1871e70 2024-05-08T02:51:09.650 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (9 ms) 2024-05-08T02:51:09.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.646+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 >> v2:172.21.15.46:6806/2291706666 conn(0x1871e70 msgr2=0x199f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:51:09.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.646+0000 7fa157c696c0 1 --2- 172.21.15.46:0/4145538762 >> v2:172.21.15.46:6806/2291706666 conn(0x1871e70 0x199f320 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.646+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa138037210 msgr2=0x7fa138039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.646+0000 7fa157c696c0 1 --2- 172.21.15.46:0/4145538762 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa138037210 0x7fa138039720 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.646+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 msgr2=0x1976980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.646+0000 7fa157c696c0 1 --2- 172.21.15.46:0/4145538762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x1976980 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.647+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 shutdown_connections 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.647+0000 7fa157c696c0 1 --2- 172.21.15.46:0/4145538762 >> v2:172.21.15.46:6806/2291706666 conn(0x1871e70 0x199f320 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.647+0000 7fa157c696c0 1 --2- 172.21.15.46:0/4145538762 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa138037210 0x7fa138039720 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.647+0000 7fa157c696c0 1 --2- 172.21.15.46:0/4145538762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1870090 0x1976980 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.647+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 >> 172.21.15.46:0/4145538762 conn(0x178d960 msgr2=0x186a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.647+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 shutdown_connections 2024-05-08T02:51:09.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.647+0000 7fa157c696c0 1 -- 172.21.15.46:0/4145538762 wait complete. 2024-05-08T02:51:09.653 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 12 tests from AsioRados (119 ms total) 2024-05-08T02:51:09.653 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:09.653 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:51:09.653 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 12 tests from 1 test suite ran. (2383 ms total) 2024-05-08T02:51:09.653 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 12 tests. 2024-05-08T02:51:09.653 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:51:09.653 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:51:09.654 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_list 2024-05-08T02:51:09.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.679+0000 7f28cce2d9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:51:09.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.679+0000 7f28cce2d9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:51:09.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:09.680+0000 7f28cce2d9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:51:09.684 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 11 tests from 3 test suites. 2024-05-08T02:51:09.684 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:51:09.684 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosList 2024-05-08T02:51:11.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjects 2024-05-08T02:51:11.774 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjects (619 ms) 2024-05-08T02:51:11.775 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-05-08T02:51:11.977 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (204 ms) 2024-05-08T02:51:11.978 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-05-08T02:51:12.058 INFO:tasks.workunit.client.0.smithi046.stdout:myset foo1,foo2,foo3 2024-05-08T02:51:12.155 INFO:tasks.workunit.client.0.smithi046.stdout:foo1 2024-05-08T02:51:12.155 INFO:tasks.workunit.client.0.smithi046.stdout:foo2 2024-05-08T02:51:12.155 INFO:tasks.workunit.client.0.smithi046.stdout:foo3 2024-05-08T02:51:12.155 INFO:tasks.workunit.client.0.smithi046.stdout:myset foo1,foo4,foo5 2024-05-08T02:51:12.308 INFO:tasks.workunit.client.0.smithi046.stdout:foo4 2024-05-08T02:51:12.308 INFO:tasks.workunit.client.0.smithi046.stdout:foo5 2024-05-08T02:51:12.308 INFO:tasks.workunit.client.0.smithi046.stdout:foo1 2024-05-08T02:51:12.308 INFO:tasks.workunit.client.0.smithi046.stdout:myset foo6,foo7 2024-05-08T02:51:12.400 INFO:tasks.workunit.client.0.smithi046.stdout:foo7 2024-05-08T02:51:12.401 INFO:tasks.workunit.client.0.smithi046.stdout:foo6 2024-05-08T02:51:12.401 INFO:tasks.workunit.client.0.smithi046.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-05-08T02:51:12.493 INFO:tasks.workunit.client.0.smithi046.stdout:ns1:foo4 2024-05-08T02:51:12.493 INFO:tasks.workunit.client.0.smithi046.stdout:ns1:foo5 2024-05-08T02:51:12.493 INFO:tasks.workunit.client.0.smithi046.stdout:ns2:foo7 2024-05-08T02:51:12.493 INFO:tasks.workunit.client.0.smithi046.stdout:ns2:foo6 2024-05-08T02:51:12.493 INFO:tasks.workunit.client.0.smithi046.stdout:ns1:foo1 2024-05-08T02:51:12.493 INFO:tasks.workunit.client.0.smithi046.stdout::foo1 2024-05-08T02:51:12.493 INFO:tasks.workunit.client.0.smithi046.stdout::foo2 2024-05-08T02:51:12.494 INFO:tasks.workunit.client.0.smithi046.stdout::foo3 2024-05-08T02:51:12.660 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjectsNS (682 ms) 2024-05-08T02:51:12.660 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-05-08T02:51:12.912 INFO:tasks.workunit.client.0.smithi046.stdout:1 0 2024-05-08T02:51:12.912 INFO:tasks.workunit.client.0.smithi046.stdout:10 0 2024-05-08T02:51:12.912 INFO:tasks.workunit.client.0.smithi046.stdout:13 0 2024-05-08T02:51:12.912 INFO:tasks.workunit.client.0.smithi046.stdout:7 0 2024-05-08T02:51:12.912 INFO:tasks.workunit.client.0.smithi046.stdout:14 0 2024-05-08T02:51:12.912 INFO:tasks.workunit.client.0.smithi046.stdout:0 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:15 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:11 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:5 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:8 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:6 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:3 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:4 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:12 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:9 0 2024-05-08T02:51:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:2 0 2024-05-08T02:51:13.005 INFO:tasks.workunit.client.0.smithi046.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-05-08T02:51:13.243 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjectsStart (583 ms) 2024-05-08T02:51:13.243 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-05-08T02:51:13.393 INFO:tasks.workunit.client.0.smithi046.stdout:x cursor=MIN 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-05-08T02:51:13.493 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-05-08T02:51:13.494 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-05-08T02:51:13.494 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-05-08T02:51:13.494 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-05-08T02:51:13.494 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-05-08T02:51:13.494 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-05-08T02:51:13.494 INFO:tasks.workunit.client.0.smithi046.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-05-08T02:51:13.754 INFO:tasks.workunit.client.0.smithi046.stdout:FIRST> seek to MIN oid=1 2024-05-08T02:51:13.852 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-05-08T02:51:13.852 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:02547ec2:::1:head 2024-05-08T02:51:13.946 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:02547ec2:::1:head -> 1 2024-05-08T02:51:13.946 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-05-08T02:51:13.946 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:52ea6a34:::10:head 2024-05-08T02:51:14.009 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:52ea6a34:::10:head -> 10 2024-05-08T02:51:14.009 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-05-08T02:51:14.009 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:566253c9:::13:head 2024-05-08T02:51:14.074 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:566253c9:::13:head -> 13 2024-05-08T02:51:14.075 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-05-08T02:51:14.075 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:5c6b0b28:::7:head 2024-05-08T02:51:14.135 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:5c6b0b28:::7:head -> 7 2024-05-08T02:51:14.135 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-05-08T02:51:14.135 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:62a1935d:::14:head 2024-05-08T02:51:14.194 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:62a1935d:::14:head -> 14 2024-05-08T02:51:14.194 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-05-08T02:51:14.194 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:6cac518f:::0:head 2024-05-08T02:51:14.251 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:6cac518f:::0:head -> 0 2024-05-08T02:51:14.251 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-05-08T02:51:14.251 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:863748b0:::15:head 2024-05-08T02:51:14.297 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:863748b0:::15:head -> 15 2024-05-08T02:51:14.297 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-05-08T02:51:14.297 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:89d3ae78:::11:head 2024-05-08T02:51:14.341 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:89d3ae78:::11:head -> 11 2024-05-08T02:51:14.341 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-05-08T02:51:14.342 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:b29083e3:::5:head 2024-05-08T02:51:14.370 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:b29083e3:::5:head -> 5 2024-05-08T02:51:14.370 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-05-08T02:51:14.370 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:bd63b0f1:::8:head 2024-05-08T02:51:14.396 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:bd63b0f1:::8:head -> 8 2024-05-08T02:51:14.396 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-05-08T02:51:14.396 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:c4fdafeb:::6:head 2024-05-08T02:51:14.419 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:c4fdafeb:::6:head -> 6 2024-05-08T02:51:14.419 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-05-08T02:51:14.419 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:cfc208b3:::3:head 2024-05-08T02:51:14.439 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:cfc208b3:::3:head -> 3 2024-05-08T02:51:14.439 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-05-08T02:51:14.440 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:d83876eb:::4:head 2024-05-08T02:51:14.453 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:d83876eb:::4:head -> 4 2024-05-08T02:51:14.453 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-05-08T02:51:14.453 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:de5d7c5f:::12:head 2024-05-08T02:51:14.467 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:de5d7c5f:::12:head -> 12 2024-05-08T02:51:14.467 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-05-08T02:51:14.467 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:e960b815:::9:head 2024-05-08T02:51:14.475 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:e960b815:::9:head -> 9 2024-05-08T02:51:14.475 INFO:tasks.workunit.client.0.smithi046.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-05-08T02:51:14.476 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:f905c69b:::2:head 2024-05-08T02:51:14.478 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:f905c69b:::2:head -> 2 2024-05-08T02:51:14.478 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:52ea6a34:::10:head 2024-05-08T02:51:14.478 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-05-08T02:51:14.543 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:52ea6a34:::10:head -> 10 2024-05-08T02:51:14.543 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=10 expected=10 2024-05-08T02:51:14.543 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:d83876eb:::4:head 2024-05-08T02:51:14.543 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-05-08T02:51:14.557 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:d83876eb:::4:head -> 4 2024-05-08T02:51:14.557 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=4 expected=4 2024-05-08T02:51:14.557 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:cfc208b3:::3:head 2024-05-08T02:51:14.557 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-05-08T02:51:14.577 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:cfc208b3:::3:head -> 3 2024-05-08T02:51:14.577 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=3 expected=3 2024-05-08T02:51:14.577 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:f905c69b:::2:head 2024-05-08T02:51:14.577 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-05-08T02:51:14.580 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:f905c69b:::2:head -> 2 2024-05-08T02:51:14.580 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=2 expected=2 2024-05-08T02:51:14.580 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:e960b815:::9:head 2024-05-08T02:51:14.580 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-05-08T02:51:14.588 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:e960b815:::9:head -> 9 2024-05-08T02:51:14.589 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=9 expected=9 2024-05-08T02:51:14.589 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:de5d7c5f:::12:head 2024-05-08T02:51:14.589 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-05-08T02:51:14.603 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:de5d7c5f:::12:head -> 12 2024-05-08T02:51:14.603 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=12 expected=12 2024-05-08T02:51:14.603 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:c4fdafeb:::6:head 2024-05-08T02:51:14.603 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-05-08T02:51:14.626 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:c4fdafeb:::6:head -> 6 2024-05-08T02:51:14.626 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=6 expected=6 2024-05-08T02:51:14.626 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:bd63b0f1:::8:head 2024-05-08T02:51:14.626 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-05-08T02:51:14.652 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:bd63b0f1:::8:head -> 8 2024-05-08T02:51:14.652 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=8 expected=8 2024-05-08T02:51:14.652 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:b29083e3:::5:head 2024-05-08T02:51:14.652 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-05-08T02:51:14.681 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:b29083e3:::5:head -> 5 2024-05-08T02:51:14.681 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=5 expected=5 2024-05-08T02:51:14.681 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:89d3ae78:::11:head 2024-05-08T02:51:14.681 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-05-08T02:51:14.725 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:89d3ae78:::11:head -> 11 2024-05-08T02:51:14.725 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=11 expected=11 2024-05-08T02:51:14.725 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:863748b0:::15:head 2024-05-08T02:51:14.725 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-05-08T02:51:14.772 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:863748b0:::15:head -> 15 2024-05-08T02:51:14.772 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=15 expected=15 2024-05-08T02:51:14.772 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:6cac518f:::0:head 2024-05-08T02:51:14.772 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-05-08T02:51:14.827 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:6cac518f:::0:head -> 0 2024-05-08T02:51:14.827 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=0 expected=0 2024-05-08T02:51:14.827 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:62a1935d:::14:head 2024-05-08T02:51:14.827 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-05-08T02:51:14.886 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:62a1935d:::14:head -> 14 2024-05-08T02:51:14.886 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=14 expected=14 2024-05-08T02:51:14.887 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:5c6b0b28:::7:head 2024-05-08T02:51:14.887 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-05-08T02:51:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:5c6b0b28:::7:head -> 7 2024-05-08T02:51:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=7 expected=7 2024-05-08T02:51:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:02547ec2:::1:head 2024-05-08T02:51:14.948 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-05-08T02:51:15.042 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:02547ec2:::1:head -> 1 2024-05-08T02:51:15.042 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=1 expected=1 2024-05-08T02:51:15.043 INFO:tasks.workunit.client.0.smithi046.stdout:: seek to 76:566253c9:::13:head 2024-05-08T02:51:15.043 INFO:tasks.workunit.client.0.smithi046.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-05-08T02:51:15.106 INFO:tasks.workunit.client.0.smithi046.stdout:> 76:566253c9:::13:head -> 13 2024-05-08T02:51:15.107 INFO:tasks.workunit.client.0.smithi046.stdout:: entry=13 expected=13 2024-05-08T02:51:15.348 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.ListObjectsCursor (2105 ms) 2024-05-08T02:51:15.348 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-05-08T02:51:15.844 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.EnumerateObjects (496 ms) 2024-05-08T02:51:15.844 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-05-08T02:51:16.001 INFO:tasks.workunit.client.0.smithi046.stdout:split 0/5 -> MIN 76:33333333::::head 2024-05-08T02:51:16.022 INFO:tasks.workunit.client.0.smithi046.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-05-08T02:51:16.046 INFO:tasks.workunit.client.0.smithi046.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-05-08T02:51:16.068 INFO:tasks.workunit.client.0.smithi046.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-05-08T02:51:16.089 INFO:tasks.workunit.client.0.smithi046.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-05-08T02:51:16.351 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (506 ms) 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosList (5196 ms total) 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosListEC 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:70: Skipped 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:84: Skipped 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:96: Skipped 2024-05-08T02:51:17.231 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:84: Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:96: Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:84: Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:96: Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:78: Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:17.232 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosListEC (1 ms total) 2024-05-08T02:51:17.233 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:17.233 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosListNP 2024-05-08T02:51:17.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-05-08T02:51:20.153 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosListNP.ListObjectsError (2923 ms) 2024-05-08T02:51:20.153 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosListNP (2923 ms total) 2024-05-08T02:51:20.154 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:20.154 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:51:20.154 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 11 tests from 3 test suites ran. (10469 ms total) 2024-05-08T02:51:20.154 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-05-08T02:51:20.154 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 3 tests, listed below: 2024-05-08T02:51:20.154 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-05-08T02:51:20.154 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-05-08T02:51:20.154 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-05-08T02:51:20.156 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:51:20.156 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:51:20.156 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_lock 2024-05-08T02:51:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:51:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 16 tests from 2 test suites. 2024-05-08T02:51:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:51:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLock 2024-05-08T02:51:22.157 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-05-08T02:51:22.523 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockExclusive (366 ms) 2024-05-08T02:51:22.523 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockShared 2024-05-08T02:51:22.564 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockShared (41 ms) 2024-05-08T02:51:22.564 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-05-08T02:51:23.603 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1039 ms) 2024-05-08T02:51:23.603 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-05-08T02:51:24.645 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockSharedDur (1042 ms) 2024-05-08T02:51:24.645 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-05-08T02:51:24.681 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.LockMayRenew (36 ms) 2024-05-08T02:51:24.681 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.Unlock 2024-05-08T02:51:24.715 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.Unlock (34 ms) 2024-05-08T02:51:24.715 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.ListLockers 2024-05-08T02:51:24.770 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.ListLockers (55 ms) 2024-05-08T02:51:24.770 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLock.BreakLock 2024-05-08T02:51:24.797 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLock.BreakLock (27 ms) 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLock (2640 ms total) 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockEC 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:168: Skipped 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:25.158 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-05-08T02:51:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-05-08T02:51:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-05-08T02:51:25.160 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:176: Skipped 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 16 tests from 2 test suites ran. (4978 ms total) 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 8 tests, listed below: 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-05-08T02:51:25.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-05-08T02:51:25.164 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:51:25.164 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:51:25.164 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_lock_pp 2024-05-08T02:51:25.180 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:51:25.180 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 16 tests from 2 test suites. 2024-05-08T02:51:25.180 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:51:25.180 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockPP 2024-05-08T02:51:25.181 INFO:tasks.workunit.client.0.smithi046.stdout:seed 32256 2024-05-08T02:51:27.174 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-05-08T02:51:27.563 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (390 ms) 2024-05-08T02:51:27.564 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-05-08T02:51:27.588 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockSharedPP (24 ms) 2024-05-08T02:51:27.588 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-05-08T02:51:28.621 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1033 ms) 2024-05-08T02:51:28.621 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-05-08T02:51:29.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1036 ms) 2024-05-08T02:51:29.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-05-08T02:51:29.703 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (46 ms) 2024-05-08T02:51:29.703 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-05-08T02:51:29.741 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.UnlockPP (38 ms) 2024-05-08T02:51:29.741 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-05-08T02:51:29.793 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.ListLockersPP (52 ms) 2024-05-08T02:51:29.793 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-05-08T02:51:29.824 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosLockPP.BreakLockPP (32 ms) 2024-05-08T02:51:30.160 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockPP (2651 ms total) 2024-05-08T02:51:30.160 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:30.160 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockECPP 2024-05-08T02:51:30.160 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:373: Skipped 2024-05-08T02:51:30.160 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.160 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-05-08T02:51:30.160 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:30.161 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-05-08T02:51:30.162 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.163 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (1 ms) 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:381: Skipped 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosLockECPP (1 ms total) 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 16 tests from 2 test suites ran. (4978 ms total) 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 8 tests, listed below: 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-05-08T02:51:30.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-05-08T02:51:30.165 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-05-08T02:51:30.165 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-05-08T02:51:30.165 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:51:30.165 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:51:30.165 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_misc 2024-05-08T02:51:30.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:30.191+0000 7f84a20656c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:51:30.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:30.191+0000 7f84a20656c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:51:30.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:30.191+0000 7f84a20656c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:51:30.196 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 12 tests from 4 test suites. 2024-05-08T02:51:30.197 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:51:30.197 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscVersion 2024-05-08T02:51:30.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-05-08T02:51:30.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-05-08T02:51:30.197 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-05-08T02:51:30.197 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:30.197 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-05-08T02:51:30.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-05-08T02:51:30.232 INFO:tasks.workunit.client.0.smithi046.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-05-08T02:51:30.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:30.227+0000 7f84a20656c0 -1 failed for service _ceph-mon._tcp 2024-05-08T02:51:30.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:51:30.227+0000 7f84a20656c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-05-08T02:51:30.232 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (36 ms) 2024-05-08T02:51:30.232 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-05-08T02:51:32.238 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2007 ms) 2024-05-08T02:51:32.239 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (2043 ms total) 2024-05-08T02:51:32.239 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:32.239 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscPool 2024-05-08T02:51:32.239 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-05-08T02:51:35.193 INFO:tasks.workunit.client.0.smithi046.stdout:started 0x7f846c005d20 2024-05-08T02:51:36.193 INFO:tasks.workunit.client.0.smithi046.stdout:started 0x7f8484005d20 2024-05-08T02:51:36.193 INFO:tasks.workunit.client.0.smithi046.stdout: started 2 aios 2024-05-08T02:51:36.193 INFO:tasks.workunit.client.0.smithi046.stdout:waiting 0x7f846c005d20 2024-05-08T02:51:36.193 INFO:tasks.workunit.client.0.smithi046.stdout:waiting 0x7f8484005d20 2024-05-08T02:51:36.198 INFO:tasks.workunit.client.0.smithi046.stdout:done. 2024-05-08T02:51:38.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (5970 ms) 2024-05-08T02:51:38.209 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscPool (5970 ms total) 2024-05-08T02:51:38.209 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:51:38.209 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosMisc 2024-05-08T02:51:40.157 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-05-08T02:51:40.157 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-05-08T02:51:40.157 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.Exec 2024-05-08T02:51:40.602 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.Exec (445 ms) 2024-05-08T02:51:40.603 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-05-08T02:51:40.638 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.WriteSame (36 ms) 2024-05-08T02:51:40.638 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-05-08T02:51:40.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.CmpExt (20 ms) 2024-05-08T02:51:40.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.Applications 2024-05-08T02:51:45.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.Applications (4575 ms) 2024-05-08T02:51:45.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-05-08T02:51:45.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-05-08T02:51:45.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-05-08T02:51:45.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-05-08T02:51:45.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-05-08T02:52:13.400 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMisc.ShutdownRace (28167 ms) 2024-05-08T02:52:14.255 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 8 tests from LibRadosMisc (33243 ms total) 2024-05-08T02:52:14.255 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:14.255 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:52:14.255 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 12 tests from 4 test suites ran. (44059 ms total) 2024-05-08T02:52:14.255 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 12 tests. 2024-05-08T02:52:14.268 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:52:14.269 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:52:14.269 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_misc_pp 2024-05-08T02:52:14.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:52:14.300+0000 7fb36dc3a840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:52:14.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:52:14.300+0000 7fb36dc3a840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:52:14.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:52:14.301+0000 7fb36dc3a840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:52:14.305 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 31 tests from 7 test suites. 2024-05-08T02:52:14.305 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:52:14.306 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscVersion 2024-05-08T02:52:14.306 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-05-08T02:52:14.306 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-05-08T02:52:14.306 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-05-08T02:52:14.306 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:14.306 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosMiscPP 2024-05-08T02:52:14.306 INFO:tasks.workunit.client.0.smithi046.stdout:seed 93921 2024-05-08T02:52:16.166 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-05-08T02:52:16.166 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-05-08T02:52:16.166 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-05-08T02:52:16.651 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.LongNamePP (485 ms) 2024-05-08T02:52:16.652 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-05-08T02:52:16.652 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/misc_cxx.cc:53: Skipped 2024-05-08T02:52:16.652 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:16.652 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-05-08T02:52:16.652 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-05-08T02:52:16.702 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (51 ms) 2024-05-08T02:52:16.702 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-05-08T02:52:16.747 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (45 ms) 2024-05-08T02:52:16.747 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-05-08T02:52:16.763 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.ExecPP (16 ms) 2024-05-08T02:52:16.763 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-05-08T02:52:16.778 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (15 ms) 2024-05-08T02:52:16.778 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-05-08T02:52:16.804 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.Operate1PP (26 ms) 2024-05-08T02:52:16.804 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-05-08T02:52:16.820 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.Operate2PP (16 ms) 2024-05-08T02:52:16.820 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-05-08T02:52:16.863 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (43 ms) 2024-05-08T02:52:16.863 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-05-08T02:52:16.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (16 ms) 2024-05-08T02:52:16.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-05-08T02:52:16.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (21 ms) 2024-05-08T02:52:16.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-05-08T02:52:16.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (43 ms) 2024-05-08T02:52:16.943 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-05-08T02:52:16.959 INFO:tasks.workunit.client.0.smithi046.stdout:osd_max_attr_size = 0 2024-05-08T02:52:16.959 INFO:tasks.workunit.client.0.smithi046.stdout:osd_max_attr_size == 0; skipping test 2024-05-08T02:52:33.148 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (16204 ms) 2024-05-08T02:52:33.423 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-05-08T02:52:33.423 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/misc_cxx.cc:387: Skipped 2024-05-08T02:52:33.423 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:33.423 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-05-08T02:52:33.423 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-05-08T02:52:33.423 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/misc_cxx.cc:550: Skipped 2024-05-08T02:52:33.423 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:33.424 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-05-08T02:52:33.424 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-05-08T02:52:33.425 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (36 ms) 2024-05-08T02:52:33.425 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-05-08T02:52:33.425 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (20 ms) 2024-05-08T02:52:33.425 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-05-08T02:52:37.292 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.Applications (4088 ms) 2024-05-08T02:52:37.292 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-05-08T02:52:37.292 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-05-08T02:52:37.292 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-05-08T02:52:37.293 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-05-08T02:52:37.293 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-05-08T02:52:37.293 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-05-08T02:52:38.298 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosMiscPP (21126 ms total) 2024-05-08T02:52:38.298 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:38.298 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-05-08T02:52:38.298 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/misc_cxx.cc:477: Skipped 2024-05-08T02:52:38.298 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:38.298 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-05-08T02:52:38.298 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/misc_cxx.cc:499: Skipped 2024-05-08T02:52:38.299 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:38.299 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/misc_cxx.cc:505: Skipped 2024-05-08T02:52:38.299 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:38.299 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-05-08T02:52:38.299 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/misc_cxx.cc:492: Skipped 2024-05-08T02:52:38.299 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:38.299 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-05-08T02:52:38.299 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:38.299 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-05-08T02:52:40.169 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-05-08T02:52:40.506 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/0.Subset (337 ms) 2024-05-08T02:52:40.506 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-05-08T02:52:40.553 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/0.Chunked (47 ms) 2024-05-08T02:52:41.306 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/0 (384 ms total) 2024-05-08T02:52:41.306 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:41.306 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-05-08T02:52:43.315 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-05-08T02:52:43.706 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/1.Subset (391 ms) 2024-05-08T02:52:43.706 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-05-08T02:52:43.720 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/1.Chunked (15 ms) 2024-05-08T02:52:44.319 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/1 (406 ms total) 2024-05-08T02:52:44.319 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:44.320 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-05-08T02:52:46.327 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-05-08T02:52:46.691 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/2.Subset (364 ms) 2024-05-08T02:52:46.691 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-05-08T02:52:46.714 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosChecksum/2.Chunked (23 ms) 2024-05-08T02:52:47.333 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosChecksum/2 (387 ms total) 2024-05-08T02:52:47.333 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:47.333 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscECPP 2024-05-08T02:52:47.333 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:373: Skipped 2024-05-08T02:52:47.333 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:47.333 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:381: Skipped 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 31 tests from 7 test suites ran. (33028 ms total) 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 26 tests. 2024-05-08T02:52:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 5 tests, listed below: 2024-05-08T02:52:47.335 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-05-08T02:52:47.335 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-05-08T02:52:47.335 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-05-08T02:52:47.335 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-05-08T02:52:47.335 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-05-08T02:52:47.336 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:52:47.336 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:52:47.336 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_tier_pp 2024-05-08T02:52:47.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:52:47.370+0000 7f9e878309c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:52:47.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:52:47.371+0000 7f9e878309c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:52:47.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:52:47.371+0000 7f9e878309c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:52:47.375 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 77 tests from 4 test suites. 2024-05-08T02:52:47.375 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:52:47.375 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosTierPP 2024-05-08T02:52:47.375 INFO:tasks.workunit.client.0.smithi046.stdout:seed 93995 2024-05-08T02:52:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-05-08T02:52:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:287: Skipped 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:2182: Skipped 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:2561: Skipped 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-05-08T02:52:50.174 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-05-08T02:52:50.174 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:50.174 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-05-08T02:52:52.186 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-05-08T02:52:52.187 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-05-08T02:52:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-05-08T02:52:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-05-08T02:52:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-05-08T02:52:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-05-08T02:52:52.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-05-08T02:52:52.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-05-08T02:52:52.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-05-08T02:52:52.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-05-08T02:52:52.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-05-08T02:52:52.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-05-08T02:52:52.200 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (1 ms) 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.201 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.202 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-05-08T02:52:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.204 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-05-08T02:52:52.205 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-05-08T02:52:52.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:223: Skipped 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:233: Skipped 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-05-08T02:52:53.190 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-05-08T02:52:53.190 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:53.190 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosTierECPP 2024-05-08T02:52:53.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:373: Skipped 2024-05-08T02:52:53.190 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-05-08T02:52:53.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:52:53.190 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:52:53.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:381: Skipped 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-05-08T02:52:53.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6267: Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-05-08T02:52:53.193 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.195 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.196 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-05-08T02:52:53.197 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-05-08T02:52:53.198 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.199 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.200 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-05-08T02:52:53.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6278: Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6288: Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (1 ms) 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/tier_cxx.cc:6272: Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:52:53.202 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 77 tests from 4 test suites ran. (5811 ms total) 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 0 tests. 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 77 tests, listed below: 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-05-08T02:52:53.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-05-08T02:52:53.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-05-08T02:52:53.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-05-08T02:52:53.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-05-08T02:52:53.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-05-08T02:52:53.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-05-08T02:52:53.209 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:52:53.209 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:52:53.209 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_pool 2024-05-08T02:52:53.215 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:52:53.215 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 9 tests from 1 test suite. 2024-05-08T02:52:53.215 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:52:53.215 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from LibRadosPools 2024-05-08T02:52:53.215 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolList 2024-05-08T02:52:56.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolList (2980 ms) 2024-05-08T02:52:56.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-05-08T02:52:59.211 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolLookup (3016 ms) 2024-05-08T02:52:59.211 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-05-08T02:53:02.178 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolLookup2 (2967 ms) 2024-05-08T02:53:02.178 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-05-08T02:53:05.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3017 ms) 2024-05-08T02:53:05.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-05-08T02:53:08.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3011 ms) 2024-05-08T02:53:08.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-05-08T02:53:13.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolDelete (4986 ms) 2024-05-08T02:53:13.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-05-08T02:53:18.212 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolCreateDelete (5020 ms) 2024-05-08T02:53:18.212 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-05-08T02:53:23.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (4981 ms) 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/pool.cc:139: Skipped 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from LibRadosPools (29978 ms total) 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 9 tests from 1 test suite ran. (29978 ms total) 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-05-08T02:53:23.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 1 test, listed below: 2024-05-08T02:53:23.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-05-08T02:53:23.195 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:53:23.196 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:53:23.196 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_snapshots 2024-05-08T02:53:23.217 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:53:23.217 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 13 tests from 4 test suites. 2024-05-08T02:53:23.217 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:53:23.217 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshots 2024-05-08T02:53:25.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-05-08T02:53:27.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshots.SnapList (2008 ms) 2024-05-08T02:53:27.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-05-08T02:53:29.216 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2008 ms) 2024-05-08T02:53:29.217 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-05-08T02:53:31.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshots.Rollback (2004 ms) 2024-05-08T02:53:31.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-05-08T02:53:33.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2008 ms) 2024-05-08T02:53:34.235 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshots (8028 ms total) 2024-05-08T02:53:34.235 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:53:34.235 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-05-08T02:53:36.242 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-05-08T02:53:40.291 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4049 ms) 2024-05-08T02:53:40.291 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-05-08T02:53:44.433 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (4142 ms) 2024-05-08T02:53:44.434 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-05-08T02:53:49.492 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5059 ms) 2024-05-08T02:53:50.188 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13250 ms total) 2024-05-08T02:53:50.188 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:53:50.188 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:168: Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-05-08T02:53:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:176: Skipped 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:168: Skipped 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-05-08T02:53:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:176: Skipped 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 13 tests from 4 test suites ran. (26971 ms total) 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 7 tests. 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 6 tests, listed below: 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-05-08T02:53:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-05-08T02:53:50.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-05-08T02:53:50.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-05-08T02:53:50.193 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:53:50.193 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:53:50.193 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_snapshots_pp 2024-05-08T02:53:50.208 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:53:50.208 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 21 tests from 5 test suites. 2024-05-08T02:53:50.208 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:53:50.209 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-05-08T02:53:50.209 INFO:tasks.workunit.client.0.smithi046.stdout:seed 94251 2024-05-08T02:53:52.195 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-05-08T02:53:54.198 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (2003 ms) 2024-05-08T02:53:54.199 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-05-08T02:53:56.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2007 ms) 2024-05-08T02:53:56.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-05-08T02:53:58.215 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2010 ms) 2024-05-08T02:53:58.215 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-05-08T02:54:00.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1972 ms) 2024-05-08T02:54:00.188 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-05-08T02:54:04.235 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4048 ms) 2024-05-08T02:54:05.241 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosSnapshotsPP (12040 ms total) 2024-05-08T02:54:05.241 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:05.241 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-05-08T02:54:07.249 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-05-08T02:54:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4118 ms) 2024-05-08T02:54:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-05-08T02:54:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/snapshots_cxx.cc:156: Skipped 2024-05-08T02:54:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP (0 ms) 2024-05-08T02:54:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-05-08T02:54:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/snapshots_cxx.cc:242: Skipped 2024-05-08T02:54:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:11.368 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (0 ms) 2024-05-08T02:54:11.369 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-05-08T02:54:15.270 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3902 ms) 2024-05-08T02:54:15.270 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-05-08T02:54:17.421 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2151 ms) 2024-05-08T02:54:17.421 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-05-08T02:54:17.421 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-05-08T02:54:17.421 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:17.422 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-05-08T02:54:17.422 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-05-08T02:54:19.285 INFO:tasks.workunit.client.0.smithi046.stdout:deleting snap 9 in pool LibRadosSnapshotsSelfManagedPP_smithi046-94251-7 2024-05-08T02:54:20.191 INFO:tasks.workunit.client.0.smithi046.stdout:waiting for snaps to purge 2024-05-08T02:54:35.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17786 ms) 2024-05-08T02:54:35.301 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (27958 ms total) 2024-05-08T02:54:35.301 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:35.301 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-05-08T02:54:35.301 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-05-08T02:54:35.307 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (6 ms) 2024-05-08T02:54:35.307 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-05-08T02:54:40.232 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (4923 ms) 2024-05-08T02:54:40.232 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (4929 ms total) 2024-05-08T02:54:40.232 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:40.232 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-05-08T02:54:40.232 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:373: Skipped 2024-05-08T02:54:40.232 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-05-08T02:54:40.233 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:381: Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.234 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:373: Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.235 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:381: Skipped 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 21 tests from 5 test suites ran. (50022 ms total) 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 11 tests. 2024-05-08T02:54:40.236 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 10 tests, listed below: 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-05-08T02:54:40.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-05-08T02:54:40.238 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:54:40.238 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:54:40.238 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_stat 2024-05-08T02:54:40.262 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:54:40.263 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 9 tests from 2 test suites. 2024-05-08T02:54:40.263 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:54:40.263 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosStat 2024-05-08T02:54:42.201 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.Stat 2024-05-08T02:54:42.588 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.Stat (387 ms) 2024-05-08T02:54:42.588 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.Stat2 2024-05-08T02:54:42.615 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.Stat2 (27 ms) 2024-05-08T02:54:42.616 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.StatNS 2024-05-08T02:54:42.670 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.StatNS (55 ms) 2024-05-08T02:54:42.670 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-05-08T02:54:42.670 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.ClusterStat (0 ms) 2024-05-08T02:54:42.671 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStat.PoolStat 2024-05-08T02:54:42.681 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStat.PoolStat (12 ms) 2024-05-08T02:54:43.207 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosStat (481 ms total) 2024-05-08T02:54:43.207 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:43.207 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosStatEC 2024-05-08T02:54:43.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:168: Skipped 2024-05-08T02:54:43.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.207 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatEC.Stat 2024-05-08T02:54:43.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:54:43.207 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.207 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.208 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:176: Skipped 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 9 tests from 2 test suites ran. (2944 ms total) 2024-05-08T02:54:43.209 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 5 tests. 2024-05-08T02:54:43.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 4 tests, listed below: 2024-05-08T02:54:43.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-05-08T02:54:43.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-05-08T02:54:43.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-05-08T02:54:43.210 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-05-08T02:54:43.210 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:54:43.210 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:54:43.211 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_stat_pp 2024-05-08T02:54:43.234 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:54:43.234 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 9 tests from 2 test suites. 2024-05-08T02:54:43.234 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:54:43.234 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosStatPP 2024-05-08T02:54:43.234 INFO:tasks.workunit.client.0.smithi046.stdout:seed 94387 2024-05-08T02:54:45.216 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-05-08T02:54:45.660 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.StatPP (444 ms) 2024-05-08T02:54:45.660 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-05-08T02:54:45.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (23 ms) 2024-05-08T02:54:45.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-05-08T02:54:45.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-05-08T02:54:45.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-05-08T02:54:45.693 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.PoolStatPP (10 ms) 2024-05-08T02:54:45.693 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-05-08T02:54:45.753 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosStatPP.StatPPNS (59 ms) 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from LibRadosStatPP (537 ms total) 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosStatECPP 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:373: Skipped 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-05-08T02:54:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:381: Skipped 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 9 tests from 2 test suites ran. (2985 ms total) 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 5 tests. 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 4 tests, listed below: 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-05-08T02:54:46.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-05-08T02:54:46.223 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-05-08T02:54:46.223 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-05-08T02:54:46.223 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:54:46.223 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:54:46.223 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_watch_notify 2024-05-08T02:54:46.243 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:54:46.243 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 11 tests from 2 test suites. 2024-05-08T02:54:46.243 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:54:46.243 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-05-08T02:54:48.230 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-05-08T02:54:48.603 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify_test_cb 2024-05-08T02:54:48.636 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (405 ms) 2024-05-08T02:54:48.636 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-05-08T02:54:48.710 INFO:tasks.workunit.client.0.smithi046.stdout:waiting up to 300 for disconnect notification ... 2024-05-08T02:54:51.281 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_errcb cookie 18461680 err -107 2024-05-08T02:54:51.847 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3212 ms) 2024-05-08T02:54:51.848 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-05-08T02:54:51.950 INFO:tasks.workunit.client.0.smithi046.stdout:waiting up to 300 for disconnect notification ... 2024-05-08T02:54:56.282 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_errcb cookie 18473344 err -107 2024-05-08T02:54:56.959 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5111 ms) 2024-05-08T02:54:56.959 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-05-08T02:54:56.991 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15482 notify_id 1692217114624 cookie 18491072 2024-05-08T02:54:57.013 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (55 ms) 2024-05-08T02:54:57.014 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-05-08T02:54:57.043 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15482 notify_id 1692217114624 cookie 18491072 2024-05-08T02:54:57.064 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (50 ms) 2024-05-08T02:54:57.065 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-05-08T02:54:57.092 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15482 notify_id 1692217114625 cookie 18491072 2024-05-08T02:54:57.112 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.AioNotify (48 ms) 2024-05-08T02:54:57.112 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-05-08T02:54:57.155 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15482 notify_id 1692217114625 cookie 18491072 2024-05-08T02:54:57.155 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15482 notify_id 1692217114625 cookie 18496928 2024-05-08T02:54:57.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (73 ms) 2024-05-08T02:54:57.185 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-05-08T02:54:57.212 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15482 notify_id 1692217114626 cookie 18496928 2024-05-08T02:55:00.212 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15482 notify_id 1692217114627 cookie 18496928 2024-05-08T02:55:00.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3049 ms) 2024-05-08T02:55:00.234 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-05-08T02:55:00.260 INFO:tasks.workunit.client.0.smithi046.stdout:waiting up to 1024 for osd to time us out ... 2024-05-08T02:55:04.269 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_errcb cookie 18491072 err -107 2024-05-08T02:55:05.291 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_cb from 15482 notify_id 1692217114629 cookie 18496928 2024-05-08T02:55:05.308 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5074 ms) 2024-05-08T02:55:05.308 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-05-08T02:55:05.344 INFO:tasks.workunit.client.0.smithi046.stdout:waiting up to 30 for disconnect notification ... 2024-05-08T02:55:06.284 INFO:tasks.workunit.client.0.smithi046.stdout:watch_notify2_test_errcb cookie 18491072 err -107 2024-05-08T02:55:06.353 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (1045 ms) 2024-05-08T02:55:07.249 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from LibRadosWatchNotify (18123 ms total) 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:168: Skipped 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:182: Skipped 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:196: Skipped 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/TestCase.cc:176: Skipped 2024-05-08T02:55:07.250 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.251 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-05-08T02:55:07.251 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:07.251 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:55:07.251 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 11 tests from 2 test suites ran. (21006 ms total) 2024-05-08T02:55:07.251 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 10 tests. 2024-05-08T02:55:07.251 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 1 test, listed below: 2024-05-08T02:55:07.251 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-05-08T02:55:07.251 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:55:07.251 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:55:07.252 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 16 tests from 2 test suites. 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:373: Skipped 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.280 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:387: Skipped 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:400: Skipped 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/testcase_cxx.cc:381: Skipped 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:07.281 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-05-08T02:55:09.257 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-05-08T02:55:09.657 INFO:tasks.workunit.client.0.smithi046.stdout:notify 2024-05-08T02:55:09.670 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (413 ms) 2024-05-08T02:55:09.670 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-05-08T02:55:09.701 INFO:tasks.workunit.client.0.smithi046.stdout:notify 2024-05-08T02:55:09.717 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (48 ms) 2024-05-08T02:55:09.718 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-05-08T02:55:09.757 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (39 ms) 2024-05-08T02:55:09.757 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-05-08T02:55:09.789 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (32 ms) 2024-05-08T02:55:09.789 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-05-08T02:55:09.817 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37118528 notify_id 1705102016519 notifier_gid 15485 2024-05-08T02:55:09.831 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (42 ms) 2024-05-08T02:55:09.831 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-05-08T02:55:09.858 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37118528 notify_id 1705102016513 notifier_gid 15485 2024-05-08T02:55:09.876 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (46 ms) 2024-05-08T02:55:09.876 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-05-08T02:55:09.911 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37118528 notify_id 1705102016514 notifier_gid 15485 2024-05-08T02:55:09.924 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (47 ms) 2024-05-08T02:55:09.924 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-05-08T02:55:09.951 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37118528 notify_id 1705102016515 notifier_gid 15485 2024-05-08T02:55:09.964 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (40 ms) 2024-05-08T02:55:09.964 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-05-08T02:55:09.991 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37118528 notify_id 1705102016514 notifier_gid 15485 2024-05-08T02:55:10.005 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (41 ms) 2024-05-08T02:55:10.005 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-05-08T02:55:10.032 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37118528 notify_id 1705102016515 notifier_gid 15485 2024-05-08T02:55:10.045 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (40 ms) 2024-05-08T02:55:10.045 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-05-08T02:55:10.070 INFO:tasks.workunit.client.0.smithi046.stdout: trying... 2024-05-08T02:55:10.075 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37128144 notify_id 1705102016513 notifier_gid 15485 2024-05-08T02:55:11.076 INFO:tasks.workunit.client.0.smithi046.stdout: timed out 2024-05-08T02:55:11.088 INFO:tasks.workunit.client.0.smithi046.stdout: flushing 2024-05-08T02:55:13.076 INFO:tasks.workunit.client.0.smithi046.stdout: flushed 2024-05-08T02:55:13.076 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3030 ms) 2024-05-08T02:55:13.076 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-05-08T02:55:13.106 INFO:tasks.workunit.client.0.smithi046.stdout: trying... 2024-05-08T02:55:13.111 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37128144 notify_id 1705102016516 notifier_gid 15485 2024-05-08T02:55:14.109 INFO:tasks.workunit.client.0.smithi046.stdout: timed out 2024-05-08T02:55:14.119 INFO:tasks.workunit.client.0.smithi046.stdout: flushing 2024-05-08T02:55:16.111 INFO:tasks.workunit.client.0.smithi046.stdout: flushed 2024-05-08T02:55:16.111 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3036 ms) 2024-05-08T02:55:16.111 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-05-08T02:55:16.141 INFO:tasks.workunit.client.0.smithi046.stdout:List watches 2024-05-08T02:55:16.141 INFO:tasks.workunit.client.0.smithi046.stdout:notify2 2024-05-08T02:55:16.145 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37128144 notify_id 1705102016514 notifier_gid 15485 2024-05-08T02:55:19.151 INFO:tasks.workunit.client.0.smithi046.stdout:notify2 done 2024-05-08T02:55:19.151 INFO:tasks.workunit.client.0.smithi046.stdout:watch_check 2024-05-08T02:55:19.151 INFO:tasks.workunit.client.0.smithi046.stdout:unwatch2 2024-05-08T02:55:19.164 INFO:tasks.workunit.client.0.smithi046.stdout: flushing 2024-05-08T02:55:19.164 INFO:tasks.workunit.client.0.smithi046.stdout:done 2024-05-08T02:55:19.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3053 ms) 2024-05-08T02:55:19.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-05-08T02:55:19.195 INFO:tasks.workunit.client.0.smithi046.stdout:List watches 2024-05-08T02:55:19.195 INFO:tasks.workunit.client.0.smithi046.stdout:notify2 2024-05-08T02:55:19.199 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 37128144 notify_id 1709396983812 notifier_gid 15485 2024-05-08T02:55:22.205 INFO:tasks.workunit.client.0.smithi046.stdout:notify2 done 2024-05-08T02:55:22.205 INFO:tasks.workunit.client.0.smithi046.stdout:watch_check 2024-05-08T02:55:22.205 INFO:tasks.workunit.client.0.smithi046.stdout:unwatch2 2024-05-08T02:55:22.217 INFO:tasks.workunit.client.0.smithi046.stdout: flushing 2024-05-08T02:55:22.217 INFO:tasks.workunit.client.0.smithi046.stdout:done 2024-05-08T02:55:22.218 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3053 ms) 2024-05-08T02:55:22.273 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12960 ms total) 2024-05-08T02:55:22.273 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:22.273 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:55:22.273 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 16 tests from 2 test suites ran. (14994 ms total) 2024-05-08T02:55:22.274 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 14 tests. 2024-05-08T02:55:22.274 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 2 tests, listed below: 2024-05-08T02:55:22.274 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-05-08T02:55:22.274 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-05-08T02:55:22.275 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:55:22.275 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:55:22.275 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_cmd 2024-05-08T02:55:22.298 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:55:22.298 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 4 tests from 1 test suite. 2024-05-08T02:55:22.298 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:55:22.298 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosCmd 2024-05-08T02:55:22.298 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-05-08T02:55:22.337 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.MonDescribe (39 ms) 2024-05-08T02:55:22.337 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-05-08T02:55:22.372 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.OSDCmd (35 ms) 2024-05-08T02:55:22.372 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-05-08T02:55:25.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.PGCmd (2833 ms) 2024-05-08T02:55:25.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-05-08T02:55:25.231 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-05-08T02:55:23.275011+0000 mon.a [INF] from='client.? 172.21.15.46:0/866768825' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi046-94445-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-05-08T02:55:25.281 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-05-08T02:55:24.272321+0000 mon.a [INF] from='client.? 172.21.15.46:0/866768825' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi046-94445-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-05-08T02:55:25.281 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-05-08T02:55:25.228308+0000 client.admin [INF] onexx 2024-05-08T02:55:25.281 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-05-08T02:55:25.228441+0000 mon.a [INF] from='client.? 172.21.15.46:0/1002795576' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-05-08T02:55:26.282 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-05-08T02:55:25.278094+0000 mon.a [INF] from='client.? 172.21.15.46:0/1002795576' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-05-08T02:55:29.286 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-05-08T02:55:27.282553+0000 mon.a [INF] from='client.? 172.21.15.46:0/1002795576' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-05-08T02:55:29.338 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-05-08T02:55:29.283385+0000 client.admin [INF] threexx 2024-05-08T02:55:29.338 INFO:tasks.workunit.client.0.smithi046.stdout:got: 2024-05-08T02:55:29.283849+0000 mon.a [INF] from='client.? 172.21.15.46:0/1002795576' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-05-08T02:55:33.344 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.WatchLog (8139 ms) 2024-05-08T02:55:33.344 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosCmd (11046 ms total) 2024-05-08T02:55:33.344 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:33.345 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:55:33.345 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 4 tests from 1 test suite ran. (11046 ms total) 2024-05-08T02:55:33.345 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 4 tests. 2024-05-08T02:55:33.346 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:55:33.346 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:55:33.346 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_cmd_pp 2024-05-08T02:55:33.368 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:55:33.368 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 3 tests from 1 test suite. 2024-05-08T02:55:33.368 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:55:33.368 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosCmd 2024-05-08T02:55:33.368 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-05-08T02:55:33.404 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.MonDescribePP (36 ms) 2024-05-08T02:55:33.404 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-05-08T02:55:33.439 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.OSDCmdPP (36 ms) 2024-05-08T02:55:33.440 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-05-08T02:55:36.359 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCmd.PGCmdPP (2919 ms) 2024-05-08T02:55:36.359 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from LibRadosCmd (2991 ms total) 2024-05-08T02:55:36.359 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:36.360 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:55:36.360 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 3 tests from 1 test suite ran. (2991 ms total) 2024-05-08T02:55:36.360 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 3 tests. 2024-05-08T02:55:36.361 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:55:36.361 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:55:36.361 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_service 2024-05-08T02:55:36.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:55:36.396+0000 7f218825d840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:55:36.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:55:36.396+0000 7f218825d840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:55:36.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:55:36.396+0000 7f218825d840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:55:36.401 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 4 tests from 1 test suite. 2024-05-08T02:55:36.401 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:55:36.401 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosService 2024-05-08T02:55:36.401 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-05-08T02:55:41.452 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosService.RegisterEarly (5052 ms) 2024-05-08T02:55:41.452 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosService.RegisterLate 2024-05-08T02:55:41.483 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosService.RegisterLate (31 ms) 2024-05-08T02:55:41.483 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosService.StatusFormat 2024-05-08T02:55:41.649 INFO:tasks.workunit.client.0.smithi046.stdout: cluster: 2024-05-08T02:55:41.649 INFO:tasks.workunit.client.0.smithi046.stdout: id: 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:55:41.649 INFO:tasks.workunit.client.0.smithi046.stdout: health: HEALTH_WARN 2024-05-08T02:55:41.649 INFO:tasks.workunit.client.0.smithi046.stdout: 1 pool(s) do not have an application enabled 2024-05-08T02:55:41.649 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:41.649 INFO:tasks.workunit.client.0.smithi046.stdout: services: 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: mon: 1 daemons, quorum a (age 10m) 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: mgr: x(active, since 10m) 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: laundry: 1 daemon active (1 hosts) 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: data: 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: pools: 3 pools, 41 pgs 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: objects: 3 objects, 577 KiB 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: usage: 172 MiB used, 400 GiB / 400 GiB avail 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: pgs: 41 active+clean 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:41.650 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:43.680 INFO:tasks.workunit.client.0.smithi046.stdout: cluster: 2024-05-08T02:55:43.680 INFO:tasks.workunit.client.0.smithi046.stdout: id: 3c41076c-82d6-4569-8543-dcb021c14d35 2024-05-08T02:55:43.680 INFO:tasks.workunit.client.0.smithi046.stdout: health: HEALTH_WARN 2024-05-08T02:55:43.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 pool(s) do not have an application enabled 2024-05-08T02:55:43.680 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:43.680 INFO:tasks.workunit.client.0.smithi046.stdout: services: 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: mon: 1 daemons, quorum a (age 10m) 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: mgr: x(active, since 10m) 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: data: 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: pools: 3 pools, 41 pgs 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: objects: 3 objects, 577 KiB 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: usage: 175 MiB used, 400 GiB / 400 GiB avail 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: pgs: 41 active+clean 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:43.681 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:55:43.706 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosService.StatusFormat (2223 ms) 2024-05-08T02:55:43.706 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosService.Status 2024-05-08T02:56:03.737 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosService.Status (20031 ms) 2024-05-08T02:56:03.737 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosService (27337 ms total) 2024-05-08T02:56:03.737 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:56:03.737 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:56:03.737 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 4 tests from 1 test suite ran. (27337 ms total) 2024-05-08T02:56:03.737 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 4 tests. 2024-05-08T02:56:03.743 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:56:03.743 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:56:03.743 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_service_pp 2024-05-08T02:56:03.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:56:03.776+0000 7f9937e32840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:56:03.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:56:03.776+0000 7f9937e32840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:56:03.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:56:03.776+0000 7f9937e32840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:56:03.780 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 4 tests from 1 test suite. 2024-05-08T02:56:03.781 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:56:03.781 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosServicePP 2024-05-08T02:56:03.781 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-05-08T02:56:08.810 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5030 ms) 2024-05-08T02:56:08.810 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-05-08T02:56:08.858 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosServicePP.RegisterLate (48 ms) 2024-05-08T02:56:08.858 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosServicePP.Status 2024-05-08T02:56:28.889 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosServicePP.Status (20031 ms) 2024-05-08T02:56:28.889 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosServicePP.Close 2024-05-08T02:56:28.889 INFO:tasks.workunit.client.0.smithi046.stdout:attempt 0 of 20 2024-05-08T02:56:33.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosServicePP.Close (5061 ms) 2024-05-08T02:56:33.950 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from LibRadosServicePP (30170 ms total) 2024-05-08T02:56:33.951 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:56:33.951 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:56:33.951 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 4 tests from 1 test suite ran. (30170 ms total) 2024-05-08T02:56:33.951 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 4 tests. 2024-05-08T02:56:33.953 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:56:33.953 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:56:33.953 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_c_write_operations 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 8 tests from 2 test suites. 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibradosCWriteOps 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-05-08T02:56:33.975 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-05-08T02:56:36.749 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.assertExists (2774 ms) 2024-05-08T02:56:36.749 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-05-08T02:56:39.760 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3011 ms) 2024-05-08T02:56:39.760 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-05-08T02:56:42.774 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3014 ms) 2024-05-08T02:56:42.775 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-05-08T02:56:45.789 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.Write (3015 ms) 2024-05-08T02:56:45.789 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-05-08T02:56:48.804 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.Exec (3015 ms) 2024-05-08T02:56:48.805 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-05-08T02:56:51.230 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.WriteSame (2426 ms) 2024-05-08T02:56:51.230 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-05-08T02:57:01.253 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRadosCWriteOps.CmpExt (10023 ms) 2024-05-08T02:57:01.253 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from LibRadosCWriteOps (27278 ms total) 2024-05-08T02:57:01.254 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:57:01.254 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:57:01.254 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 8 tests from 2 test suites ran. (27278 ms total) 2024-05-08T02:57:01.254 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 8 tests. 2024-05-08T02:57:01.255 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:57:01.255 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:57:01.255 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_c_read_operations 2024-05-08T02:57:01.279 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:57:01.279 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 17 tests from 1 test suite. 2024-05-08T02:57:01.279 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:57:01.279 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 17 tests from CReadOpsTest 2024-05-08T02:57:03.261 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-05-08T02:57:03.261 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-05-08T02:57:03.261 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-05-08T02:57:03.641 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.SetOpFlags (380 ms) 2024-05-08T02:57:03.641 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-05-08T02:57:03.675 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.AssertExists (35 ms) 2024-05-08T02:57:03.676 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-05-08T02:57:03.730 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.AssertVersion (54 ms) 2024-05-08T02:57:03.730 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-05-08T02:57:03.897 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.CmpXattr (167 ms) 2024-05-08T02:57:03.897 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Read 2024-05-08T02:57:03.937 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Read (40 ms) 2024-05-08T02:57:03.937 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Checksum 2024-05-08T02:57:03.975 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Checksum (38 ms) 2024-05-08T02:57:03.975 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-05-08T02:57:04.002 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.RWOrderedRead (27 ms) 2024-05-08T02:57:04.002 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-05-08T02:57:04.043 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.ShortRead (41 ms) 2024-05-08T02:57:04.043 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Exec 2024-05-08T02:57:04.067 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Exec (24 ms) 2024-05-08T02:57:04.067 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-05-08T02:57:04.101 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.ExecUserBuf (34 ms) 2024-05-08T02:57:04.101 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Stat 2024-05-08T02:57:04.135 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Stat (34 ms) 2024-05-08T02:57:04.135 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Stat2 2024-05-08T02:57:04.170 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Stat2 (35 ms) 2024-05-08T02:57:04.170 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.Omap 2024-05-08T02:57:04.255 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.Omap (85 ms) 2024-05-08T02:57:04.255 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-05-08T02:57:04.335 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.OmapNuls (80 ms) 2024-05-08T02:57:04.335 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-05-08T02:57:04.449 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.GetXattrs (114 ms) 2024-05-08T02:57:04.449 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-05-08T02:57:04.478 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CReadOpsTest.CmpExt (29 ms) 2024-05-08T02:57:05.270 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 17 tests from CReadOpsTest (1217 ms total) 2024-05-08T02:57:05.270 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:57:05.270 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:57:05.270 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 17 tests from 1 test suite ran. (3991 ms total) 2024-05-08T02:57:05.270 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 17 tests. 2024-05-08T02:57:05.271 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:57:05.272 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:57:05.272 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_api_cls_remote_reads 2024-05-08T02:57:05.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:57:05.305+0000 7f2775c416c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:57:05.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:57:05.305+0000 7f2775c416c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:57:05.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T02:57:05.305+0000 7f2775c416c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 1 test from 1 test suite. 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from ClsTestRemoteReads 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsTestRemoteReads.TestGather 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3229-g4184b4e6/rpm/el9/BUILD/ceph-19.0.0-3229-g4184b4e6/src/test/librados/cls_remote_reads.cc:13: Skipped 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout:Not supported by crimson yet. Skipped 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] ClsTestRemoteReads.TestGather (0 ms) 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from ClsTestRemoteReads (0 ms total) 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:57:05.310 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:57:05.311 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 1 test from 1 test suite ran. (0 ms total) 2024-05-08T02:57:05.311 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 0 tests. 2024-05-08T02:57:05.311 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] 1 test, listed below: 2024-05-08T02:57:05.311 INFO:tasks.workunit.client.0.smithi046.stdout:[ SKIPPED ] ClsTestRemoteReads.TestGather 2024-05-08T02:57:05.311 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:57:05.311 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:57:05.311 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_list_parallel 2024-05-08T02:57:08.181 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95129]: starting. 2024-05-08T02:57:08.182 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95129]: creating pool ceph_test_rados_list_parallel.smithi046-95128 2024-05-08T02:57:08.182 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95129]: created object 0... 2024-05-08T02:57:08.182 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95129]: created object 25... 2024-05-08T02:57:08.182 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95129]: created object 49... 2024-05-08T02:57:08.182 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95129]: finishing. 2024-05-08T02:57:08.182 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95129]: shutting down. 2024-05-08T02:57:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95130]: starting. 2024-05-08T02:57:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95130]: listing objects. 2024-05-08T02:57:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95130]: listed object 0... 2024-05-08T02:57:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95130]: listed object 25... 2024-05-08T02:57:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95130]: saw 50 objects 2024-05-08T02:57:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95130]: shutting down. 2024-05-08T02:57:09.258 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:09.258 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95165]: starting. 2024-05-08T02:57:09.258 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95165]: creating pool ceph_test_rados_list_parallel.smithi046-95128 2024-05-08T02:57:09.259 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95165]: created object 0... 2024-05-08T02:57:09.259 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95165]: created object 25... 2024-05-08T02:57:09.259 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95165]: created object 49... 2024-05-08T02:57:09.259 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95165]: finishing. 2024-05-08T02:57:09.259 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95165]: shutting down. 2024-05-08T02:57:09.512 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:09.512 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95166]: starting. 2024-05-08T02:57:09.512 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95166]: listing objects. 2024-05-08T02:57:09.512 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95166]: listed object 0... 2024-05-08T02:57:09.513 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95166]: listed object 25... 2024-05-08T02:57:09.513 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95166]: saw 43 objects 2024-05-08T02:57:09.513 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95166]: shutting down. 2024-05-08T02:57:09.748 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:09.748 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95167]: starting. 2024-05-08T02:57:09.748 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95167]: removed 25 objects... 2024-05-08T02:57:09.748 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95167]: removed half of the objects 2024-05-08T02:57:09.748 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95167]: removed 50 objects... 2024-05-08T02:57:09.748 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95167]: removed 50 objects 2024-05-08T02:57:09.748 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95167]: shutting down. 2024-05-08T02:57:10.319 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:10.319 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:10.320 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[95216]: starting. 2024-05-08T02:57:10.320 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[95216]: creating pool ceph_test_rados_list_parallel.smithi046-95128 2024-05-08T02:57:10.320 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[95216]: created object 0... 2024-05-08T02:57:10.320 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[95216]: created object 25... 2024-05-08T02:57:10.320 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[95216]: created object 49... 2024-05-08T02:57:10.320 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[95216]: finishing. 2024-05-08T02:57:10.320 INFO:tasks.workunit.client.0.smithi046.stdout:process_6_[95216]: shutting down. 2024-05-08T02:57:10.607 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:10.607 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:10.607 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[95217]: starting. 2024-05-08T02:57:10.608 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[95217]: listing objects. 2024-05-08T02:57:10.608 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[95217]: listed object 0... 2024-05-08T02:57:10.608 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[95217]: listed object 25... 2024-05-08T02:57:10.608 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[95217]: listed object 50... 2024-05-08T02:57:10.608 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[95217]: saw 55 objects 2024-05-08T02:57:10.608 INFO:tasks.workunit.client.0.smithi046.stdout:process_7_[95217]: shutting down. 2024-05-08T02:57:10.868 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:10.869 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:10.869 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[95218]: starting. 2024-05-08T02:57:10.869 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[95218]: added 25 objects... 2024-05-08T02:57:10.869 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[95218]: added half of the objects 2024-05-08T02:57:10.869 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[95218]: added 50 objects... 2024-05-08T02:57:10.869 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[95218]: added 50 objects 2024-05-08T02:57:10.869 INFO:tasks.workunit.client.0.smithi046.stdout:process_8_[95218]: shutting down. 2024-05-08T02:57:11.431 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:11.431 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:11.432 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:11.432 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[95267]: starting. 2024-05-08T02:57:11.432 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[95267]: creating pool ceph_test_rados_list_parallel.smithi046-95128 2024-05-08T02:57:11.432 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[95267]: created object 0... 2024-05-08T02:57:11.432 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[95267]: created object 25... 2024-05-08T02:57:11.432 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[95267]: created object 49... 2024-05-08T02:57:11.432 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[95267]: finishing. 2024-05-08T02:57:11.432 INFO:tasks.workunit.client.0.smithi046.stdout:process_9_[95267]: shutting down. 2024-05-08T02:57:11.769 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:11.769 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:11.769 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:11.769 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[95268]: starting. 2024-05-08T02:57:11.770 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[95268]: listing objects. 2024-05-08T02:57:11.770 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[95268]: listed object 0... 2024-05-08T02:57:11.770 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[95268]: listed object 25... 2024-05-08T02:57:11.770 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[95268]: listed object 50... 2024-05-08T02:57:11.770 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[95268]: listed object 75... 2024-05-08T02:57:11.770 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[95268]: saw 98 objects 2024-05-08T02:57:11.770 INFO:tasks.workunit.client.0.smithi046.stdout:process_10_[95268]: shutting down. 2024-05-08T02:57:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[95271]: starting. 2024-05-08T02:57:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[95271]: removed 25 objects... 2024-05-08T02:57:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[95271]: removed half of the objects 2024-05-08T02:57:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[95271]: removed 50 objects... 2024-05-08T02:57:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[95271]: removed 50 objects 2024-05-08T02:57:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:process_13_[95271]: shutting down. 2024-05-08T02:57:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[95269]: starting. 2024-05-08T02:57:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[95269]: added 25 objects... 2024-05-08T02:57:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[95269]: added half of the objects 2024-05-08T02:57:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[95269]: added 50 objects... 2024-05-08T02:57:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[95269]: added 50 objects 2024-05-08T02:57:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:process_11_[95269]: shutting down. 2024-05-08T02:57:12.125 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.125 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.125 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.125 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[95270]: starting. 2024-05-08T02:57:12.125 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[95270]: added 25 objects... 2024-05-08T02:57:12.125 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[95270]: added half of the objects 2024-05-08T02:57:12.126 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[95270]: added 50 objects... 2024-05-08T02:57:12.126 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[95270]: added 50 objects 2024-05-08T02:57:12.126 INFO:tasks.workunit.client.0.smithi046.stdout:process_12_[95270]: shutting down. 2024-05-08T02:57:12.672 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.672 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[95352]: starting. 2024-05-08T02:57:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[95352]: creating pool ceph_test_rados_list_parallel.smithi046-95128 2024-05-08T02:57:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[95352]: created object 0... 2024-05-08T02:57:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[95352]: created object 25... 2024-05-08T02:57:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[95352]: created object 49... 2024-05-08T02:57:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[95352]: finishing. 2024-05-08T02:57:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:process_14_[95352]: shutting down. 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: starting. 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: listing objects. 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: listed object 0... 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: listed object 25... 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: listed object 50... 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: listed object 75... 2024-05-08T02:57:12.948 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: listed object 100... 2024-05-08T02:57:12.949 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: listed object 125... 2024-05-08T02:57:12.949 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: saw 150 objects 2024-05-08T02:57:12.949 INFO:tasks.workunit.client.0.smithi046.stdout:process_15_[95353]: shutting down. 2024-05-08T02:57:13.198 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:13.198 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:13.198 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:13.198 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:13.198 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[95354]: starting. 2024-05-08T02:57:13.198 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[95354]: added 25 objects... 2024-05-08T02:57:13.198 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[95354]: added half of the objects 2024-05-08T02:57:13.199 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[95354]: added 50 objects... 2024-05-08T02:57:13.199 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[95354]: added 50 objects 2024-05-08T02:57:13.199 INFO:tasks.workunit.client.0.smithi046.stdout:process_16_[95354]: shutting down. 2024-05-08T02:57:13.287 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:13.287 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:13.287 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:13.287 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:13.287 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:13.287 INFO:tasks.workunit.client.0.smithi046.stdout:******* SUCCESS ********** 2024-05-08T02:57:13.288 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:57:13.288 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:57:13.288 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_open_pools_parallel 2024-05-08T02:57:16.219 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95420]: starting. 2024-05-08T02:57:16.219 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95420]: creating pool ceph_test_rados_open_pools_parallel.smithi046-95419 2024-05-08T02:57:16.219 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95420]: created object 0... 2024-05-08T02:57:16.220 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95420]: created object 25... 2024-05-08T02:57:16.220 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95420]: created object 49... 2024-05-08T02:57:16.220 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95420]: finishing. 2024-05-08T02:57:16.220 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95420]: shutting down. 2024-05-08T02:57:16.298 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95421]: starting. 2024-05-08T02:57:16.298 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95421]: rados_pool_create. 2024-05-08T02:57:16.298 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95421]: rados_ioctx_create. 2024-05-08T02:57:16.298 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95421]: shutting down. 2024-05-08T02:57:19.200 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:19.200 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95456]: starting. 2024-05-08T02:57:19.200 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95456]: creating pool ceph_test_rados_open_pools_parallel.smithi046-95419 2024-05-08T02:57:19.200 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95456]: created object 0... 2024-05-08T02:57:19.200 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95456]: created object 25... 2024-05-08T02:57:19.200 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95456]: created object 49... 2024-05-08T02:57:19.200 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95456]: finishing. 2024-05-08T02:57:19.200 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95456]: shutting down. 2024-05-08T02:57:19.310 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:19.310 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95457]: starting. 2024-05-08T02:57:19.310 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95457]: rados_pool_create. 2024-05-08T02:57:19.310 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95457]: rados_ioctx_create. 2024-05-08T02:57:19.310 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95457]: shutting down. 2024-05-08T02:57:19.311 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:19.311 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:19.311 INFO:tasks.workunit.client.0.smithi046.stdout:******* SUCCESS ********** 2024-05-08T02:57:19.312 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-05-08T02:57:19.312 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:57:19.312 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_rados_delete_pools_parallel 2024-05-08T02:57:22.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95493]: starting. 2024-05-08T02:57:22.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95493]: creating pool ceph_test_rados_delete_pools_parallel.smithi046-95492 2024-05-08T02:57:22.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95493]: created object 0... 2024-05-08T02:57:22.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95493]: created object 25... 2024-05-08T02:57:22.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95493]: created object 49... 2024-05-08T02:57:22.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95493]: finishing. 2024-05-08T02:57:22.242 INFO:tasks.workunit.client.0.smithi046.stdout:process_1_[95493]: shutting down. 2024-05-08T02:57:22.317 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95494]: starting. 2024-05-08T02:57:22.318 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95494]: deleting pool ceph_test_rados_delete_pools_parallel.smithi046-95492 2024-05-08T02:57:22.318 INFO:tasks.workunit.client.0.smithi046.stdout:process_2_[95494]: shutting down. 2024-05-08T02:57:25.229 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:25.229 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95529]: starting. 2024-05-08T02:57:25.230 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95529]: creating pool ceph_test_rados_delete_pools_parallel.smithi046-95492 2024-05-08T02:57:25.230 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95529]: created object 0... 2024-05-08T02:57:25.230 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95529]: created object 25... 2024-05-08T02:57:25.230 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95529]: created object 49... 2024-05-08T02:57:25.230 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95529]: finishing. 2024-05-08T02:57:25.230 INFO:tasks.workunit.client.0.smithi046.stdout:process_3_[95529]: shutting down. 2024-05-08T02:57:25.334 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:25.334 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95531]: starting. 2024-05-08T02:57:25.334 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95531]: listing objects. 2024-05-08T02:57:25.334 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95531]: listed object 0... 2024-05-08T02:57:25.334 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95531]: listed object 25... 2024-05-08T02:57:25.335 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95531]: saw 50 objects 2024-05-08T02:57:25.335 INFO:tasks.workunit.client.0.smithi046.stdout:process_5_[95531]: shutting down. 2024-05-08T02:57:26.332 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:26.332 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95530]: starting. 2024-05-08T02:57:26.333 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95530]: deleting pool ceph_test_rados_delete_pools_parallel.smithi046-95492 2024-05-08T02:57:26.333 INFO:tasks.workunit.client.0.smithi046.stdout:process_4_[95530]: shutting down. 2024-05-08T02:57:26.334 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:26.334 INFO:tasks.workunit.client.0.smithi046.stdout:******************************* 2024-05-08T02:57:26.334 INFO:tasks.workunit.client.0.smithi046.stdout:******* SUCCESS ********** 2024-05-08T02:57:26.335 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:57:26.335 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:57:26.335 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:57:26.335 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' cls = ec_io ']' 2024-05-08T02:57:26.335 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' cls = ec_list ']' 2024-05-08T02:57:26.335 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_cls 2024-05-08T02:57:26.354 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:57:26.354 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 2 tests from 1 test suite. 2024-05-08T02:57:26.354 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:57:26.354 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from NeoRadosCls 2024-05-08T02:57:26.354 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosCls.DNE 2024-05-08T02:57:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosCls.DNE (2992 ms) 2024-05-08T02:57:29.346 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosCls.RemoteReads 2024-05-08T02:57:30.238 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-05-08T02:57:31.239 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosCls.RemoteReads (1893 ms) 2024-05-08T02:57:31.239 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from NeoRadosCls (4885 ms total) 2024-05-08T02:57:31.240 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:57:31.240 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:57:31.240 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 2 tests from 1 test suite ran. (4885 ms total) 2024-05-08T02:57:31.240 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 2 tests. 2024-05-08T02:57:31.242 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:57:31.242 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:57:31.242 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:57:31.242 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' cmd = ec_io ']' 2024-05-08T02:57:31.242 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' cmd = ec_list ']' 2024-05-08T02:57:31.242 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_cmd 2024-05-08T02:57:31.267 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:57:31.267 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 3 tests from 1 test suite. 2024-05-08T02:57:31.268 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:57:31.268 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from NeoRadosCmd 2024-05-08T02:57:31.268 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-05-08T02:57:33.249 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosCmd.MonDescribe (1981 ms) 2024-05-08T02:57:33.249 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-05-08T02:57:35.257 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosCmd.OSDCmd (2009 ms) 2024-05-08T02:57:35.257 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-05-08T02:57:38.268 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosCmd.PGCmd (3011 ms) 2024-05-08T02:57:38.268 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from NeoRadosCmd (7001 ms total) 2024-05-08T02:57:38.268 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:57:38.268 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:57:38.268 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 3 tests from 1 test suite ran. (7001 ms total) 2024-05-08T02:57:38.268 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 3 tests. 2024-05-08T02:57:38.270 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:57:38.270 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:57:38.270 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:57:38.271 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' handler_error = ec_io ']' 2024-05-08T02:57:38.271 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' handler_error = ec_list ']' 2024-05-08T02:57:38.271 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_handler_error 2024-05-08T02:57:38.288 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:57:38.288 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 1 test from 1 test suite. 2024-05-08T02:57:38.288 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:57:38.288 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from neocls_handler_error 2024-05-08T02:57:38.289 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-05-08T02:57:41.279 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] neocls_handler_error.test_handler_error (2990 ms) 2024-05-08T02:57:41.279 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from neocls_handler_error (2990 ms total) 2024-05-08T02:57:41.279 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:57:41.279 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:57:41.279 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 1 test from 1 test suite ran. (2990 ms total) 2024-05-08T02:57:41.279 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 1 test. 2024-05-08T02:57:41.280 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:57:41.280 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:57:41.280 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:57:41.280 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' io = ec_io ']' 2024-05-08T02:57:41.280 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' io = ec_list ']' 2024-05-08T02:57:41.280 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_io 2024-05-08T02:57:41.302 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:57:41.302 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 14 tests from 1 test suite. 2024-05-08T02:57:41.302 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:57:41.302 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from NeoRadosIo 2024-05-08T02:57:41.302 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.Limits 2024-05-08T02:57:42.282 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-05-08T02:57:43.287 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.Limits (1984 ms) 2024-05-08T02:57:43.287 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-05-08T02:57:46.300 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.SimpleWrite (3013 ms) 2024-05-08T02:57:46.300 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-05-08T02:57:49.312 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.ReadOp (3013 ms) 2024-05-08T02:57:49.312 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-05-08T02:57:52.319 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.SparseRead (3007 ms) 2024-05-08T02:57:52.320 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-05-08T02:57:55.332 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.RoundTrip (3013 ms) 2024-05-08T02:57:55.333 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-05-08T02:57:58.345 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3013 ms) 2024-05-08T02:57:58.345 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-05-08T02:58:01.354 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3009 ms) 2024-05-08T02:58:01.354 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-05-08T02:58:04.364 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3010 ms) 2024-05-08T02:58:04.364 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-05-08T02:58:07.378 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3014 ms) 2024-05-08T02:58:07.379 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.Trunc 2024-05-08T02:58:10.247 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.Trunc (2869 ms) 2024-05-08T02:58:10.247 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.Remove 2024-05-08T02:58:13.394 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.Remove (3147 ms) 2024-05-08T02:58:13.394 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-05-08T02:58:16.404 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3010 ms) 2024-05-08T02:58:16.404 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-05-08T02:58:19.420 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.RmXattr (3016 ms) 2024-05-08T02:58:19.420 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-05-08T02:58:22.421 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosIo.GetXattrs (3001 ms) 2024-05-08T02:58:22.422 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from NeoRadosIo (41119 ms total) 2024-05-08T02:58:22.422 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:58:22.422 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:58:22.422 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 14 tests from 1 test suite ran. (41119 ms total) 2024-05-08T02:58:22.422 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 14 tests. 2024-05-08T02:58:22.425 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:58:22.426 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:58:22.426 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:58:22.426 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' ec_io = ec_io ']' 2024-05-08T02:58:22.426 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo 'Skipping EC with Crimson' 2024-05-08T02:58:22.426 INFO:tasks.workunit.client.0.smithi046.stdout:Skipping EC with Crimson 2024-05-08T02:58:22.427 INFO:tasks.workunit.client.0.smithi046.stderr:+ continue 2024-05-08T02:58:22.427 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:58:22.427 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:58:22.427 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:58:22.427 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' list = ec_io ']' 2024-05-08T02:58:22.427 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' list = ec_list ']' 2024-05-08T02:58:22.427 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_list 2024-05-08T02:58:22.450 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:58:22.450 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 3 tests from 1 test suite. 2024-05-08T02:58:22.450 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:58:22.450 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from NeoradosList 2024-05-08T02:58:22.450 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoradosList.ListObjects 2024-05-08T02:58:25.434 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoradosList.ListObjects (2984 ms) 2024-05-08T02:58:25.435 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-05-08T02:58:28.445 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoradosList.ListObjectsNS (3011 ms) 2024-05-08T02:58:28.446 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-05-08T02:58:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoradosList.ListObjectsMany (8810 ms) 2024-05-08T02:58:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 3 tests from NeoradosList (14805 ms total) 2024-05-08T02:58:37.255 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:58:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:58:37.255 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 3 tests from 1 test suite ran. (14805 ms total) 2024-05-08T02:58:37.256 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 3 tests. 2024-05-08T02:58:37.258 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:58:37.258 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:58:37.259 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:58:37.259 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' ec_list = ec_io ']' 2024-05-08T02:58:37.259 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' ec_list = ec_list ']' 2024-05-08T02:58:37.259 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo 'Skipping EC with Crimson' 2024-05-08T02:58:37.259 INFO:tasks.workunit.client.0.smithi046.stdout:Skipping EC with Crimson 2024-05-08T02:58:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:+ continue 2024-05-08T02:58:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:58:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:58:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:58:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' misc = ec_io ']' 2024-05-08T02:58:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' misc = ec_list ']' 2024-05-08T02:58:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_misc 2024-05-08T02:58:37.286 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:58:37.287 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 12 tests from 1 test suite. 2024-05-08T02:58:37.287 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:58:37.287 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 12 tests from NeoRadosMisc 2024-05-08T02:58:37.287 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.Version 2024-05-08T02:58:39.261 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.Version (1974 ms) 2024-05-08T02:58:39.262 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-05-08T02:58:41.254 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (1993 ms) 2024-05-08T02:58:41.254 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.LongName 2024-05-08T02:58:44.273 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.LongName (3019 ms) 2024-05-08T02:58:44.273 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-05-08T02:58:45.277 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-05-08T02:58:46.282 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.LongLocator (2009 ms) 2024-05-08T02:58:46.282 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-05-08T02:58:49.296 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.LongNamespace (3014 ms) 2024-05-08T02:58:49.296 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-05-08T02:58:52.304 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.LongAttrName (3008 ms) 2024-05-08T02:58:52.304 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.Exec 2024-05-08T02:58:55.317 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.Exec (3013 ms) 2024-05-08T02:58:55.317 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-05-08T02:58:58.329 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.Operate1 (3012 ms) 2024-05-08T02:58:58.330 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-05-08T02:59:01.337 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.Operate2 (3008 ms) 2024-05-08T02:59:01.337 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-05-08T02:59:04.349 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.BigObject (3012 ms) 2024-05-08T02:59:04.349 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-05-08T02:59:06.356 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.BigAttr (2007 ms) 2024-05-08T02:59:06.357 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-05-08T02:59:07.364 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-05-08T02:59:08.368 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosMisc.WriteSame (2012 ms) 2024-05-08T02:59:08.369 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 12 tests from NeoRadosMisc (31081 ms total) 2024-05-08T02:59:08.369 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:59:08.369 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:59:08.369 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 12 tests from 1 test suite ran. (31081 ms total) 2024-05-08T02:59:08.369 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 12 tests. 2024-05-08T02:59:08.372 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:59:08.373 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:59:08.373 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:59:08.373 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' pool = ec_io ']' 2024-05-08T02:59:08.373 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' pool = ec_list ']' 2024-05-08T02:59:08.373 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_pool 2024-05-08T02:59:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:59:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 6 tests from 1 test suite. 2024-05-08T02:59:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:59:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from NeoRadosPools 2024-05-08T02:59:08.400 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolList 2024-05-08T02:59:10.263 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolList (1862 ms) 2024-05-08T02:59:10.263 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-05-08T02:59:12.270 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolLookup (2008 ms) 2024-05-08T02:59:12.271 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-05-08T02:59:14.274 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2004 ms) 2024-05-08T02:59:14.275 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-05-08T02:59:18.295 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolDelete (4021 ms) 2024-05-08T02:59:18.295 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-05-08T02:59:20.264 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (1969 ms) 2024-05-08T02:59:20.264 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-05-08T02:59:22.309 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2045 ms) 2024-05-08T02:59:22.309 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from NeoRadosPools (13909 ms total) 2024-05-08T02:59:22.309 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T02:59:22.310 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T02:59:22.310 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 6 tests from 1 test suite ran. (13909 ms total) 2024-05-08T02:59:22.310 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 6 tests. 2024-05-08T02:59:22.313 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T02:59:22.313 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T02:59:22.313 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T02:59:22.313 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' read_operations = ec_io ']' 2024-05-08T02:59:22.313 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' read_operations = ec_list ']' 2024-05-08T02:59:22.313 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_read_operations 2024-05-08T02:59:22.341 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T02:59:22.342 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 14 tests from 1 test suite. 2024-05-08T02:59:22.342 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T02:59:22.342 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from NeoRadosReadOps 2024-05-08T02:59:22.342 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-05-08T02:59:25.322 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2981 ms) 2024-05-08T02:59:25.322 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-05-08T02:59:28.332 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.AssertExists (3010 ms) 2024-05-08T02:59:28.333 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-05-08T02:59:31.343 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3011 ms) 2024-05-08T02:59:31.343 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-05-08T02:59:34.397 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3054 ms) 2024-05-08T02:59:34.398 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Read 2024-05-08T02:59:37.412 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Read (3015 ms) 2024-05-08T02:59:37.413 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-05-08T02:59:40.267 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Checksum (2854 ms) 2024-05-08T02:59:40.267 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-05-08T02:59:43.427 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3160 ms) 2024-05-08T02:59:43.427 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-05-08T02:59:46.438 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.ShortRead (3010 ms) 2024-05-08T02:59:46.438 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-05-08T02:59:49.452 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Exec (3015 ms) 2024-05-08T02:59:49.452 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-05-08T02:59:52.460 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Stat (3008 ms) 2024-05-08T02:59:52.460 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-05-08T02:59:55.473 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.Omap (3013 ms) 2024-05-08T02:59:55.474 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-05-08T02:59:58.484 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3011 ms) 2024-05-08T02:59:58.484 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-05-08T03:00:01.496 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3012 ms) 2024-05-08T03:00:01.496 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-05-08T03:00:04.507 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosReadOps.CmpExt (3011 ms) 2024-05-08T03:00:04.508 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 14 tests from NeoRadosReadOps (42166 ms total) 2024-05-08T03:00:04.508 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T03:00:04.508 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T03:00:04.508 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 14 tests from 1 test suite ran. (42166 ms total) 2024-05-08T03:00:04.508 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 14 tests. 2024-05-08T03:00:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T03:00:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T03:00:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T03:00:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' snapshots = ec_io ']' 2024-05-08T03:00:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' snapshots = ec_list ']' 2024-05-08T03:00:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_snapshots 2024-05-08T03:00:04.530 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T03:00:04.530 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 11 tests from 2 test suites. 2024-05-08T03:00:04.530 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T03:00:04.530 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-05-08T03:00:04.530 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-05-08T03:00:09.530 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.SnapList (4999 ms) 2024-05-08T03:00:09.530 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-05-08T03:00:14.537 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (5007 ms) 2024-05-08T03:00:14.537 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-05-08T03:00:18.556 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.Rollback (4020 ms) 2024-05-08T03:00:18.556 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-05-08T03:00:23.575 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5019 ms) 2024-05-08T03:00:23.576 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-05-08T03:00:30.281 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (6706 ms) 2024-05-08T03:00:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 5 tests from NeoRadosSnapshots (25751 ms total) 2024-05-08T03:00:30.282 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T03:00:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-05-08T03:00:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-05-08T03:00:35.299 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5018 ms) 2024-05-08T03:00:35.299 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-05-08T03:00:36.303 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-05-08T03:00:37.309 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2010 ms) 2024-05-08T03:00:37.309 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-05-08T03:00:38.312 INFO:tasks.workunit.client.0.smithi046.stderr:Not supported by crimson yet. Skipped 2024-05-08T03:00:39.316 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2007 ms) 2024-05-08T03:00:39.316 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-05-08T03:00:45.329 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6013 ms) 2024-05-08T03:00:45.329 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-05-08T03:00:49.347 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4017 ms) 2024-05-08T03:00:49.347 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-05-08T03:00:52.347 INFO:tasks.workunit.client.0.smithi046.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi046-96438-11. 2024-05-08T03:00:53.352 INFO:tasks.workunit.client.0.smithi046.stdout:Waiting for snaps to purge. 2024-05-08T03:01:09.300 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19953 ms) 2024-05-08T03:01:09.300 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (39018 ms total) 2024-05-08T03:01:09.300 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T03:01:09.300 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T03:01:09.300 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 11 tests from 2 test suites ran. (64769 ms total) 2024-05-08T03:01:09.300 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 11 tests. 2024-05-08T03:01:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T03:01:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T03:01:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T03:01:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' watch_notify = ec_io ']' 2024-05-08T03:01:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' watch_notify = ec_list ']' 2024-05-08T03:01:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_watch_notify 2024-05-08T03:01:09.326 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T03:01:09.326 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 2 tests from 1 test suite. 2024-05-08T03:01:09.326 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T03:01:09.326 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-05-08T03:01:09.327 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-05-08T03:01:11.836 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 17137296 notify_id 2813203578883 notifier_gid 15884 2024-05-08T03:01:12.307 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2980 ms) 2024-05-08T03:01:12.307 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-05-08T03:01:14.801 INFO:tasks.workunit.client.0.smithi046.stdout:Trying... 2024-05-08T03:01:14.804 INFO:tasks.workunit.client.0.smithi046.stdout:handle_notify cookie 29893536 notify_id 2826088480773 notifier_gid 15887 2024-05-08T03:01:14.805 INFO:tasks.workunit.client.0.smithi046.stdout:Waiting for 3.000000000s 2024-05-08T03:01:15.802 INFO:tasks.workunit.client.0.smithi046.stdout:Timed out. 2024-05-08T03:01:15.813 INFO:tasks.workunit.client.0.smithi046.stdout:Flushing... 2024-05-08T03:01:15.813 INFO:tasks.workunit.client.0.smithi046.stdout:Flushed... 2024-05-08T03:01:19.328 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7022 ms) 2024-05-08T03:01:19.328 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 2 tests from NeoRadosWatchNotify (10002 ms total) 2024-05-08T03:01:19.329 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T03:01:19.329 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T03:01:19.329 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 2 tests from 1 test suite ran. (10002 ms total) 2024-05-08T03:01:19.329 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 2 tests. 2024-05-08T03:01:19.331 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-05-08T03:01:19.331 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T03:01:19.331 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 1 -eq 1 ']' 2024-05-08T03:01:19.331 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' write_operations = ec_io ']' 2024-05-08T03:01:19.331 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' write_operations = ec_list ']' 2024-05-08T03:01:19.331 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph_test_neorados_write_operations 2024-05-08T03:01:19.355 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-05-08T03:01:19.355 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 7 tests from 1 test suite. 2024-05-08T03:01:19.355 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-05-08T03:01:19.355 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-05-08T03:01:19.355 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-05-08T03:01:22.339 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2984 ms) 2024-05-08T03:01:22.340 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-05-08T03:01:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3013 ms) 2024-05-08T03:01:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-05-08T03:01:28.364 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3012 ms) 2024-05-08T03:01:28.364 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-05-08T03:01:31.376 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.Write (3012 ms) 2024-05-08T03:01:31.376 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-05-08T03:01:34.384 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.Exec (3008 ms) 2024-05-08T03:01:34.384 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-05-08T03:01:37.397 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3013 ms) 2024-05-08T03:01:37.398 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-05-08T03:01:47.412 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] NeoRadosWriteOps.CmpExt (10015 ms) 2024-05-08T03:01:47.413 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 7 tests from NeoRadosWriteOps (28057 ms total) 2024-05-08T03:01:47.413 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-05-08T03:01:47.413 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-05-08T03:01:47.413 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 7 tests from 1 test suite ran. (28057 ms total) 2024-05-08T03:01:47.413 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 7 tests. 2024-05-08T03:01:47.415 INFO:tasks.workunit.client.0.smithi046.stderr:+ ret=0 2024-05-08T03:01:47.415 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -eq 1 ']' 2024-05-08T03:01:47.415 INFO:tasks.workunit.client.0.smithi046.stderr:+ exit 0 2024-05-08T03:01:47.415 INFO:tasks.workunit.client.0.smithi046.stderr:+ cleanup 2024-05-08T03:01:47.415 INFO:tasks.workunit.client.0.smithi046.stderr:+ pkill -P 30861 2024-05-08T03:01:47.431 INFO:tasks.workunit.client.0.smithi046.stderr:+ true 2024-05-08T03:01:47.431 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T03:01:47.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T03:01:47.504 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-05-08T03:01:47.505 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-05-08T03:01:47.506 DEBUG:teuthology.orchestra.run.smithi046:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4184b4e61afa6555ed712d5225eb247792c31f69 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-05-08T03:01:47.567 INFO:tasks.workunit.client.0.smithi046.stderr:++ uuidgen 2024-05-08T03:01:47.580 INFO:tasks.workunit.client.0.smithi046.stderr:+ p=008ce654-4211-4a2d-8916-631643828e06 2024-05-08T03:01:47.580 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool create 008ce654-4211-4a2d-8916-631643828e06 12 2024-05-08T03:01:47.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.669+0000 7f999a59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:47.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.678+0000 7f999a59d640 1 Processor -- start 2024-05-08T03:01:47.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.678+0000 7f999a59d640 1 -- start start 2024-05-08T03:01:47.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.679+0000 7f999a59d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9994134bd0 0x7f9994136ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:47.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.679+0000 7f999a59d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999412e3a0 con 0x7f999412e5d0 2024-05-08T03:01:47.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.679+0000 7f999a59d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f999409c590 con 0x7f9994134bd0 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.679+0000 7f99937fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9994134bd0 0x7f9994136ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.679+0000 7f9993fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f999412e5d0 0x7f999412e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51368/0 (socket says 172.21.15.46:51368) 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.679+0000 7f99937fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9994134bd0 0x7f9994136ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52154/0 (socket says 172.21.15.46:52154) 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.679+0000 7f9993fff640 1 -- 172.21.15.46:0/2796709794 learned_addr learned my addr 172.21.15.46:0/2796709794 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.680+0000 7f99937fe640 1 -- 172.21.15.46:0/2796709794 >> v1:172.21.15.46:6789/0 conn(0x7f999412e5d0 legacy=0x7f999412e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.680+0000 7f99937fe640 1 -- 172.21.15.46:0/2796709794 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9994070250 con 0x7f9994134bd0 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.680+0000 7f9992ffd640 1 -- 172.21.15.46:0/2796709794 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380632603 0 0) 0x7f999412e3a0 con 0x7f999412e5d0 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.680+0000 7f99937fe640 1 --2- 172.21.15.46:0/2796709794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9994134bd0 0x7f9994136ff0 crc :-1 s=READY pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd144b84ca8656b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.680+0000 7f9992ffd640 1 -- 172.21.15.46:0/2796709794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9988009d90 con 0x7f9994134bd0 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.680+0000 7f9992ffd640 1 -- 172.21.15.46:0/2796709794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f998800e230 con 0x7f9994134bd0 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.680+0000 7f9992ffd640 1 -- 172.21.15.46:0/2796709794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f998800e4d0 con 0x7f9994134bd0 2024-05-08T03:01:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.681+0000 7f999a59d640 1 -- 172.21.15.46:0/2796709794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9994134bd0 msgr2=0x7f9994136ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:47.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.681+0000 7f999a59d640 1 --2- 172.21.15.46:0/2796709794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9994134bd0 0x7f9994136ff0 crc :-1 s=READY pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:47.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.681+0000 7f999a59d640 1 -- 172.21.15.46:0/2796709794 shutdown_connections 2024-05-08T03:01:47.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.681+0000 7f999a59d640 1 --2- 172.21.15.46:0/2796709794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9994134bd0 0x7f9994136ff0 unknown :-1 s=CLOSED pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:47.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.681+0000 7f999a59d640 1 -- 172.21.15.46:0/2796709794 >> 172.21.15.46:0/2796709794 conn(0x7f99940a0810 msgr2=0x7f99940a0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:47.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.681+0000 7f999a59d640 1 -- 172.21.15.46:0/2796709794 shutdown_connections 2024-05-08T03:01:47.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.681+0000 7f999a59d640 1 -- 172.21.15.46:0/2796709794 wait complete. 2024-05-08T03:01:47.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.681+0000 7f999a59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:47.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.683+0000 7f999a59d640 1 Processor -- start 2024-05-08T03:01:47.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.683+0000 7f999a59d640 1 -- start start 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f999a59d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f999412e5d0 0x7f999411b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f999a59d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f999411ea50 con 0x7f999412e5d0 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f9993fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f999412e5d0 0x7f999411b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f9993fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f999412e5d0 0x7f999411b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52162/0 (socket says 172.21.15.46:52162) 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f9993fff640 1 -- 172.21.15.46:0/3633838149 learned_addr learned my addr 172.21.15.46:0/3633838149 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f9993fff640 1 -- 172.21.15.46:0/3633838149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999411af60 con 0x7f999412e5d0 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f9993fff640 1 --2- 172.21.15.46:0/3633838149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f999412e5d0 0x7f999411b420 crc :-1 s=READY pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f9990ff9640 1 -- 172.21.15.46:0/3633838149 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f998400ec00 con 0x7f999412e5d0 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f9990ff9640 1 -- 172.21.15.46:0/3633838149 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f998400ed60 con 0x7f999412e5d0 2024-05-08T03:01:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999411c640 con 0x7f999412e5d0 2024-05-08T03:01:47.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f9990ff9640 1 -- 172.21.15.46:0/3633838149 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9984004840 con 0x7f999412e5d0 2024-05-08T03:01:47.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.685+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f999411de10 con 0x7f999412e5d0 2024-05-08T03:01:47.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.687+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999411cff0 con 0x7f999412e5d0 2024-05-08T03:01:47.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.687+0000 7f9990ff9640 1 -- 172.21.15.46:0/3633838149 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f99840049f0 con 0x7f999412e5d0 2024-05-08T03:01:47.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.687+0000 7f9990ff9640 1 --2- 172.21.15.46:0/3633838149 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9980038980 0x7f998003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:47.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.687+0000 7f9990ff9640 1 -- 172.21.15.46:0/3633838149 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(683..683 src has 611..683) ==== 3403+0+0 (crc 0 0 0) 0x7f998404af60 con 0x7f999412e5d0 2024-05-08T03:01:47.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.687+0000 7f99937fe640 1 --2- 172.21.15.46:0/3633838149 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9980038980 0x7f998003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:47.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.688+0000 7f99937fe640 1 --2- 172.21.15.46:0/3633838149 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9980038980 0x7f998003ae90 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:47.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.693+0000 7f9990ff9640 1 -- 172.21.15.46:0/3633838149 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f999411cff0 con 0x7f999412e5d0 2024-05-08T03:01:47.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:47.881+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "008ce654-4211-4a2d-8916-631643828e06", "pg_num": 12} v 0) -- 0x7f999411cff0 con 0x7f999412e5d0 2024-05-08T03:01:48.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.411+0000 7f9990ff9640 1 -- 172.21.15.46:0/3633838149 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "008ce654-4211-4a2d-8916-631643828e06", "pg_num": 12}]=0 pool '008ce654-4211-4a2d-8916-631643828e06' created v684) ==== 176+0+0 (crc 0 0 0) 0x7f999411cff0 con 0x7f999412e5d0 2024-05-08T03:01:48.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.585+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "008ce654-4211-4a2d-8916-631643828e06", "pg_num": 12} v 0) -- 0x7f999411cff0 con 0x7f999412e5d0 2024-05-08T03:01:48.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.585+0000 7f9990ff9640 1 -- 172.21.15.46:0/3633838149 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "008ce654-4211-4a2d-8916-631643828e06", "pg_num": 12}]=0 pool '008ce654-4211-4a2d-8916-631643828e06' already exists v684) ==== 183+0+0 (crc 0 0 0) 0x7f999411cff0 con 0x7f999412e5d0 2024-05-08T03:01:48.590 INFO:tasks.workunit.client.0.smithi046.stderr:pool '008ce654-4211-4a2d-8916-631643828e06' already exists 2024-05-08T03:01:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.587+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9980038980 msgr2=0x7f998003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.587+0000 7f999a59d640 1 --2- 172.21.15.46:0/3633838149 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9980038980 0x7f998003ae90 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.587+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f999412e5d0 msgr2=0x7f999411b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.587+0000 7f999a59d640 1 --2- 172.21.15.46:0/3633838149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f999412e5d0 0x7f999411b420 crc :-1 s=READY pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.588+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 shutdown_connections 2024-05-08T03:01:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.588+0000 7f999a59d640 1 --2- 172.21.15.46:0/3633838149 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9980038980 0x7f998003ae90 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.588+0000 7f999a59d640 1 --2- 172.21.15.46:0/3633838149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f999412e5d0 0x7f999411b420 unknown :-1 s=CLOSED pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.588+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 >> 172.21.15.46:0/3633838149 conn(0x7f99940a0810 msgr2=0x7f99941316b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.588+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 shutdown_connections 2024-05-08T03:01:48.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.588+0000 7f999a59d640 1 -- 172.21.15.46:0/3633838149 wait complete. 2024-05-08T03:01:48.605 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota 008ce654-4211-4a2d-8916-631643828e06 max_objects 10 2024-05-08T03:01:48.732 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.717+0000 7f01e786d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:48.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.729+0000 7f01e786d640 1 Processor -- start 2024-05-08T03:01:48.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.730+0000 7f01e786d640 1 -- start start 2024-05-08T03:01:48.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.731+0000 7f01e786d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f01e0135060 0x7f01e0135470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:48.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.731+0000 7f01e786d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e01359b0 con 0x7f01e00a25b0 2024-05-08T03:01:48.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.731+0000 7f01e786d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f01e009be70 con 0x7f01e0135060 2024-05-08T03:01:48.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.732+0000 7f01e5609640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f01e0135060 0x7f01e0135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:48.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.732+0000 7f01e4e08640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f01e00a25b0 0x7f01e00a29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51378/0 (socket says 172.21.15.46:51378) 2024-05-08T03:01:48.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.732+0000 7f01e4e08640 1 -- 172.21.15.46:0/3200148626 learned_addr learned my addr 172.21.15.46:0/3200148626 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:01:48.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.732+0000 7f01e5609640 1 -- 172.21.15.46:0/3200148626 >> v1:172.21.15.46:6789/0 conn(0x7f01e00a25b0 legacy=0x7f01e00a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:48.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.732+0000 7f01e5609640 1 -- 172.21.15.46:0/3200148626 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e0134c30 con 0x7f01e0135060 2024-05-08T03:01:48.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.732+0000 7f01e5609640 1 --2- 172.21.15.46:0/3200148626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0135060 0x7f01e0135470 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42075a8d59779e15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:48.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.733+0000 7f01d7fff640 1 -- 172.21.15.46:0/3200148626 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f01dc00e040 con 0x7f01e0135060 2024-05-08T03:01:48.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.733+0000 7f01d7fff640 1 -- 172.21.15.46:0/3200148626 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f01dc007670 con 0x7f01e0135060 2024-05-08T03:01:48.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.733+0000 7f01d7fff640 1 -- 172.21.15.46:0/3200148626 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f01dc007910 con 0x7f01e0135060 2024-05-08T03:01:48.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.734+0000 7f01e786d640 1 -- 172.21.15.46:0/3200148626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0135060 msgr2=0x7f01e0135470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:48.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.734+0000 7f01e786d640 1 --2- 172.21.15.46:0/3200148626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0135060 0x7f01e0135470 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:48.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.734+0000 7f01e786d640 1 -- 172.21.15.46:0/3200148626 shutdown_connections 2024-05-08T03:01:48.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.734+0000 7f01e786d640 1 --2- 172.21.15.46:0/3200148626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e0135060 0x7f01e0135470 unknown :-1 s=CLOSED pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:48.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.734+0000 7f01e786d640 1 -- 172.21.15.46:0/3200148626 >> 172.21.15.46:0/3200148626 conn(0x7f01e006d420 msgr2=0x7f01e006d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:48.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.734+0000 7f01e786d640 1 -- 172.21.15.46:0/3200148626 shutdown_connections 2024-05-08T03:01:48.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.734+0000 7f01e786d640 1 -- 172.21.15.46:0/3200148626 wait complete. 2024-05-08T03:01:48.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.734+0000 7f01e786d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:48.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.736+0000 7f01e786d640 1 Processor -- start 2024-05-08T03:01:48.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.736+0000 7f01e786d640 1 -- start start 2024-05-08T03:01:48.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.738+0000 7f01e786d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e00a25b0 0x7f01e009e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:48.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.738+0000 7f01e786d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f01e011d3f0 con 0x7f01e00a25b0 2024-05-08T03:01:48.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.738+0000 7f01e5609640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e00a25b0 0x7f01e009e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:48.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.738+0000 7f01e5609640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e00a25b0 0x7f01e009e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52176/0 (socket says 172.21.15.46:52176) 2024-05-08T03:01:48.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.738+0000 7f01e5609640 1 -- 172.21.15.46:0/1698360137 learned_addr learned my addr 172.21.15.46:0/1698360137 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:48.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.738+0000 7f01e5609640 1 -- 172.21.15.46:0/1698360137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e00a0350 con 0x7f01e00a25b0 2024-05-08T03:01:48.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.739+0000 7f01e5609640 1 --2- 172.21.15.46:0/1698360137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e00a25b0 0x7f01e009e6f0 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:48.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.739+0000 7f01d5ffb640 1 -- 172.21.15.46:0/1698360137 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f01dc00e040 con 0x7f01e00a25b0 2024-05-08T03:01:48.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.739+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e012ee40 con 0x7f01e00a25b0 2024-05-08T03:01:48.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.739+0000 7f01d5ffb640 1 -- 172.21.15.46:0/1698360137 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f01dc012a90 con 0x7f01e00a25b0 2024-05-08T03:01:48.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.739+0000 7f01d5ffb640 1 -- 172.21.15.46:0/1698360137 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f01dc012d30 con 0x7f01e00a25b0 2024-05-08T03:01:48.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.739+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e011dab0 con 0x7f01e00a25b0 2024-05-08T03:01:48.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.740+0000 7f01d5ffb640 1 -- 172.21.15.46:0/1698360137 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f01dc0153f0 con 0x7f01e00a25b0 2024-05-08T03:01:48.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.740+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e009fc20 con 0x7f01e00a25b0 2024-05-08T03:01:48.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.741+0000 7f01d5ffb640 1 --2- 172.21.15.46:0/1698360137 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f01c4038930 0x7f01c403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:48.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.741+0000 7f01d5ffb640 1 -- 172.21.15.46:0/1698360137 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(684..684 src has 611..684) ==== 3778+0+0 (crc 0 0 0) 0x7f01dc049fe0 con 0x7f01e00a25b0 2024-05-08T03:01:48.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.741+0000 7f01e4e08640 1 --2- 172.21.15.46:0/1698360137 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f01c4038930 0x7f01c403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:48.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.742+0000 7f01e4e08640 1 --2- 172.21.15.46:0/1698360137 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f01c4038930 0x7f01c403ae40 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:48.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.751+0000 7f01d5ffb640 1 -- 172.21.15.46:0/1698360137 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f01dc00fc80 con 0x7f01e00a25b0 2024-05-08T03:01:48.950 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:48.946+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "10"} v 0) -- 0x7f01e011ef80 con 0x7f01e00a25b0 2024-05-08T03:01:49.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:49.415+0000 7f01d5ffb640 1 -- 172.21.15.46:0/1698360137 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 008ce654-4211-4a2d-8916-631643828e06 v685) ==== 223+0+0 (crc 0 0 0) 0x7f01dc010280 con 0x7f01e00a25b0 2024-05-08T03:01:49.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:49.586+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "10"} v 0) -- 0x7f01e011d1f0 con 0x7f01e00a25b0 2024-05-08T03:01:50.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.296+0000 7f01d5ffb640 1 -- 172.21.15.46:0/1698360137 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 008ce654-4211-4a2d-8916-631643828e06 v686) ==== 223+0+0 (crc 0 0 0) 0x7f01dc00faa0 con 0x7f01e00a25b0 2024-05-08T03:01:50.300 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 10 for pool 008ce654-4211-4a2d-8916-631643828e06 2024-05-08T03:01:50.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.298+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f01c4038930 msgr2=0x7f01c403ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:50.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.298+0000 7f01e786d640 1 --2- 172.21.15.46:0/1698360137 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f01c4038930 0x7f01c403ae40 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:50.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.298+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e00a25b0 msgr2=0x7f01e009e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:50.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.298+0000 7f01e786d640 1 --2- 172.21.15.46:0/1698360137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e00a25b0 0x7f01e009e6f0 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:50.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.298+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 shutdown_connections 2024-05-08T03:01:50.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.299+0000 7f01e786d640 1 --2- 172.21.15.46:0/1698360137 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f01c4038930 0x7f01c403ae40 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:50.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.299+0000 7f01e786d640 1 --2- 172.21.15.46:0/1698360137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01e00a25b0 0x7f01e009e6f0 unknown :-1 s=CLOSED pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:50.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.299+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 >> 172.21.15.46:0/1698360137 conn(0x7f01e006d420 msgr2=0x7f01e01328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:50.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.299+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 shutdown_connections 2024-05-08T03:01:50.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.299+0000 7f01e786d640 1 -- 172.21.15.46:0/1698360137 wait complete. 2024-05-08T03:01:50.319 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool application enable 008ce654-4211-4a2d-8916-631643828e06 rados 2024-05-08T03:01:50.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.452+0000 7f3c7939d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:50.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.463+0000 7f3c7939d640 1 Processor -- start 2024-05-08T03:01:50.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.463+0000 7f3c7939d640 1 -- start start 2024-05-08T03:01:50.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.464+0000 7f3c7939d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c74135060 0x7f3c74135470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:50.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.464+0000 7f3c7939d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c741359b0 con 0x7f3c740a25b0 2024-05-08T03:01:50.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.464+0000 7f3c7939d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f3c7409be70 con 0x7f3c74135060 2024-05-08T03:01:50.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.464+0000 7f3c72ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3c74135060 0x7f3c74135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:50.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.464+0000 7f3c727fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3c740a25b0 0x7f3c740a29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51380/0 (socket says 172.21.15.46:51380) 2024-05-08T03:01:50.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.464+0000 7f3c727fc640 1 -- 172.21.15.46:0/3966995355 learned_addr learned my addr 172.21.15.46:0/3966995355 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:01:50.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.465+0000 7f3c72ffd640 1 -- 172.21.15.46:0/3966995355 >> v1:172.21.15.46:6789/0 conn(0x7f3c740a25b0 legacy=0x7f3c740a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:50.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.465+0000 7f3c72ffd640 1 -- 172.21.15.46:0/3966995355 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c74134c30 con 0x7f3c74135060 2024-05-08T03:01:50.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.465+0000 7f3c72ffd640 1 --2- 172.21.15.46:0/3966995355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c74135060 0x7f3c74135470 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1b8f27c6394668 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:50.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.465+0000 7f3c71ffb640 1 -- 172.21.15.46:0/3966995355 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c64009d90 con 0x7f3c74135060 2024-05-08T03:01:50.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.465+0000 7f3c71ffb640 1 -- 172.21.15.46:0/3966995355 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3c6400e230 con 0x7f3c74135060 2024-05-08T03:01:50.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.465+0000 7f3c71ffb640 1 -- 172.21.15.46:0/3966995355 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c6400e4d0 con 0x7f3c74135060 2024-05-08T03:01:50.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.467+0000 7f3c7939d640 1 -- 172.21.15.46:0/3966995355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c74135060 msgr2=0x7f3c74135470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:50.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.467+0000 7f3c7939d640 1 --2- 172.21.15.46:0/3966995355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c74135060 0x7f3c74135470 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:50.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.467+0000 7f3c7939d640 1 -- 172.21.15.46:0/3966995355 shutdown_connections 2024-05-08T03:01:50.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.467+0000 7f3c7939d640 1 --2- 172.21.15.46:0/3966995355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c74135060 0x7f3c74135470 unknown :-1 s=CLOSED pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:50.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.467+0000 7f3c7939d640 1 -- 172.21.15.46:0/3966995355 >> 172.21.15.46:0/3966995355 conn(0x7f3c7406d420 msgr2=0x7f3c7406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:50.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.467+0000 7f3c7939d640 1 -- 172.21.15.46:0/3966995355 shutdown_connections 2024-05-08T03:01:50.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.467+0000 7f3c7939d640 1 -- 172.21.15.46:0/3966995355 wait complete. 2024-05-08T03:01:50.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.467+0000 7f3c7939d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:50.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.470+0000 7f3c7939d640 1 Processor -- start 2024-05-08T03:01:50.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.470+0000 7f3c7939d640 1 -- start start 2024-05-08T03:01:50.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.473+0000 7f3c7939d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c740a25b0 0x7f3c7409e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:50.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.473+0000 7f3c7939d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3c7411d3f0 con 0x7f3c740a25b0 2024-05-08T03:01:50.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.473+0000 7f3c72ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c740a25b0 0x7f3c7409e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:50.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.473+0000 7f3c72ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c740a25b0 0x7f3c7409e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52202/0 (socket says 172.21.15.46:52202) 2024-05-08T03:01:50.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.473+0000 7f3c72ffd640 1 -- 172.21.15.46:0/2253390404 learned_addr learned my addr 172.21.15.46:0/2253390404 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:50.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.473+0000 7f3c72ffd640 1 -- 172.21.15.46:0/2253390404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c740a0350 con 0x7f3c740a25b0 2024-05-08T03:01:50.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.473+0000 7f3c72ffd640 1 --2- 172.21.15.46:0/2253390404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c740a25b0 0x7f3c7409e6f0 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:50.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.474+0000 7f3c5b7fe640 1 -- 172.21.15.46:0/2253390404 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c64014540 con 0x7f3c740a25b0 2024-05-08T03:01:50.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.474+0000 7f3c5b7fe640 1 -- 172.21.15.46:0/2253390404 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3c640146a0 con 0x7f3c740a25b0 2024-05-08T03:01:50.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.474+0000 7f3c5b7fe640 1 -- 172.21.15.46:0/2253390404 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c64014940 con 0x7f3c740a25b0 2024-05-08T03:01:50.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.474+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7412ee40 con 0x7f3c740a25b0 2024-05-08T03:01:50.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.474+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c7411dab0 con 0x7f3c740a25b0 2024-05-08T03:01:50.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.475+0000 7f3c5b7fe640 1 -- 172.21.15.46:0/2253390404 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f3c64014af0 con 0x7f3c740a25b0 2024-05-08T03:01:50.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.475+0000 7f3c5b7fe640 1 --2- 172.21.15.46:0/2253390404 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3c60038980 0x7f3c6003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:50.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.475+0000 7f3c5b7fe640 1 -- 172.21.15.46:0/2253390404 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(686..686 src has 611..686) ==== 3778+0+0 (crc 0 0 0) 0x7f3c64019040 con 0x7f3c740a25b0 2024-05-08T03:01:50.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.475+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c7409fc20 con 0x7f3c740a25b0 2024-05-08T03:01:50.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.475+0000 7f3c727fc640 1 --2- 172.21.15.46:0/2253390404 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3c60038980 0x7f3c6003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:50.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.476+0000 7f3c727fc640 1 --2- 172.21.15.46:0/2253390404 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3c60038980 0x7f3c6003ae90 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:50.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.481+0000 7f3c5b7fe640 1 -- 172.21.15.46:0/2253390404 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f3c64014df0 con 0x7f3c740a25b0 2024-05-08T03:01:50.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:50.691+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "008ce654-4211-4a2d-8916-631643828e06", "app": "rados"} v 0) -- 0x7f3c7411ef80 con 0x7f3c740a25b0 2024-05-08T03:01:51.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:51.419+0000 7f3c5b7fe640 1 -- 172.21.15.46:0/2253390404 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "008ce654-4211-4a2d-8916-631643828e06", "app": "rados"}]=0 enabled application 'rados' on pool '008ce654-4211-4a2d-8916-631643828e06' v687) ==== 213+0+0 (crc 0 0 0) 0x7f3c6400fb30 con 0x7f3c740a25b0 2024-05-08T03:01:51.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:51.535+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "008ce654-4211-4a2d-8916-631643828e06", "app": "rados"} v 0) -- 0x7f3c7411d1f0 con 0x7f3c740a25b0 2024-05-08T03:01:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.420+0000 7f3c5b7fe640 1 -- 172.21.15.46:0/2253390404 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "008ce654-4211-4a2d-8916-631643828e06", "app": "rados"}]=0 enabled application 'rados' on pool '008ce654-4211-4a2d-8916-631643828e06' v688) ==== 213+0+0 (crc 0 0 0) 0x7f3c6400fd10 con 0x7f3c740a25b0 2024-05-08T03:01:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:enabled application 'rados' on pool '008ce654-4211-4a2d-8916-631643828e06' 2024-05-08T03:01:52.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3c60038980 msgr2=0x7f3c6003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:52.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 --2- 172.21.15.46:0/2253390404 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3c60038980 0x7f3c6003ae90 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c740a25b0 msgr2=0x7f3c7409e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:52.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 --2- 172.21.15.46:0/2253390404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c740a25b0 0x7f3c7409e6f0 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 shutdown_connections 2024-05-08T03:01:52.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 --2- 172.21.15.46:0/2253390404 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3c60038980 0x7f3c6003ae90 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 --2- 172.21.15.46:0/2253390404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3c740a25b0 0x7f3c7409e6f0 unknown :-1 s=CLOSED pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 >> 172.21.15.46:0/2253390404 conn(0x7f3c7406d420 msgr2=0x7f3c741328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:52.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 shutdown_connections 2024-05-08T03:01:52.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.423+0000 7f3c7939d640 1 -- 172.21.15.46:0/2253390404 wait complete. 2024-05-08T03:01:52.440 INFO:tasks.workunit.client.0.smithi046.stderr:++ seq 1 10 2024-05-08T03:01:52.449 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:52.449 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj1 /etc/passwd 2024-05-08T03:01:52.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.486+0000 7f5c220fcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:52.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.492+0000 7f5c220fcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:52.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.492+0000 7f5c220fcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:52.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.493+0000 7f5c220fcec0 1 Processor -- start 2024-05-08T03:01:52.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.493+0000 7f5c220fcec0 1 -- start start 2024-05-08T03:01:52.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c220fcec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0x9d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:52.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c220fcec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x938950 con 0x9ce770 2024-05-08T03:01:52.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c1a59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0x9d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c1a59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0x9d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52220/0 (socket says 172.21.15.46:52220) 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c1a59b640 1 -- 172.21.15.46:0/1400700558 learned_addr learned my addr 172.21.15.46:0/1400700558 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c1a59b640 1 -- 172.21.15.46:0/1400700558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x8d71e0 con 0x9ce770 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c1a59b640 1 --2- 172.21.15.46:0/1400700558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0x9d1c70 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30799a324017f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c18d98640 1 -- 172.21.15.46:0/1400700558 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5c0402fb80 con 0x9ce770 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c18d98640 1 -- 172.21.15.46:0/1400700558 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5c0402fce0 con 0x9ce770 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.495+0000 7f5c18d98640 1 -- 172.21.15.46:0/1400700558 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5c04034410 con 0x9ce770 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.496+0000 7f5c220fcec0 1 -- 172.21.15.46:0/1400700558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 msgr2=0x9d1c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.496+0000 7f5c220fcec0 1 --2- 172.21.15.46:0/1400700558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0x9d1c70 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.496+0000 7f5c220fcec0 1 -- 172.21.15.46:0/1400700558 shutdown_connections 2024-05-08T03:01:52.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.496+0000 7f5c220fcec0 1 --2- 172.21.15.46:0/1400700558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0x9d1c70 unknown :-1 s=CLOSED pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.502 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.496+0000 7f5c220fcec0 1 -- 172.21.15.46:0/1400700558 >> 172.21.15.46:0/1400700558 conn(0x8ef960 msgr2=0x9c9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:52.502 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.496+0000 7f5c220fcec0 1 -- 172.21.15.46:0/1400700558 shutdown_connections 2024-05-08T03:01:52.502 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.496+0000 7f5c220fcec0 1 -- 172.21.15.46:0/1400700558 wait complete. 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.497+0000 7f5c220fcec0 1 Processor -- start 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.497+0000 7f5c220fcec0 1 -- start start 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.499+0000 7f5c220fcec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0xafab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.499+0000 7f5c220fcec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x9363d0 con 0x9ce770 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.499+0000 7f5c1a59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0xafab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.499+0000 7f5c1a59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0xafab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52224/0 (socket says 172.21.15.46:52224) 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.499+0000 7f5c1a59b640 1 -- 172.21.15.46:0/2724303301 learned_addr learned my addr 172.21.15.46:0/2724303301 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.499+0000 7f5c1a59b640 1 -- 172.21.15.46:0/2724303301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x8c9e30 con 0x9ce770 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.499+0000 7f5c1a59b640 1 --2- 172.21.15.46:0/2724303301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0xafab20 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.499+0000 7f5c137fe640 1 -- 172.21.15.46:0/2724303301 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5c04039040 con 0x9ce770 2024-05-08T03:01:52.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.500+0000 7f5c137fe640 1 -- 172.21.15.46:0/2724303301 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5c0402fe50 con 0x9ce770 2024-05-08T03:01:52.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.500+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x8c9890 con 0x9ce770 2024-05-08T03:01:52.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.500+0000 7f5c137fe640 1 -- 172.21.15.46:0/2724303301 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5c0402fb80 con 0x9ce770 2024-05-08T03:01:52.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.500+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xafa5d0 con 0x9ce770 2024-05-08T03:01:52.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.501+0000 7f5c137fe640 1 -- 172.21.15.46:0/2724303301 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f5c0403c040 con 0x9ce770 2024-05-08T03:01:52.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.501+0000 7f5c137fe640 1 --2- 172.21.15.46:0/2724303301 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f5bf4037210 0x7f5bf4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:52.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.501+0000 7f5c137fe640 1 -- 172.21.15.46:0/2724303301 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7f5c0406c120 con 0x9ce770 2024-05-08T03:01:52.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.501+0000 7f5c220fcec0 1 --2- 172.21.15.46:0/2724303301 >> v2:172.21.15.80:6807/3216858417 conn(0x9cf0c0 0xad7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:52.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.501+0000 7f5c19d9a640 1 --2- 172.21.15.46:0/2724303301 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f5bf4037210 0x7f5bf4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:52.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.501+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 --> v2:172.21.15.80:6807/3216858417 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0xad7d40 con 0x9cf0c0 2024-05-08T03:01:52.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.502+0000 7f5c19d9a640 1 --2- 172.21.15.46:0/2724303301 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f5bf4037210 0x7f5bf4039720 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:52.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.502+0000 7f5c1ad9c640 1 --2- 172.21.15.46:0/2724303301 >> v2:172.21.15.80:6807/3216858417 conn(0x9cf0c0 0xad7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:52.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.507+0000 7f5c1ad9c640 1 --2- 172.21.15.46:0/2724303301 >> v2:172.21.15.80:6807/3216858417 conn(0x9cf0c0 0xad7800 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:52.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c1ad9c640 1 -- 172.21.15.46:0/2724303301 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== osd_op_reply(1 obj1 [writefull 0~11982] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5c0c00c430 con 0x9cf0c0 2024-05-08T03:01:52.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 >> v2:172.21.15.80:6807/3216858417 conn(0x9cf0c0 msgr2=0xad7800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:52.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 --2- 172.21.15.46:0/2724303301 >> v2:172.21.15.80:6807/3216858417 conn(0x9cf0c0 0xad7800 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f5bf4037210 msgr2=0x7f5bf4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:52.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 --2- 172.21.15.46:0/2724303301 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f5bf4037210 0x7f5bf4039720 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 msgr2=0xafab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:52.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 --2- 172.21.15.46:0/2724303301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0xafab20 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 shutdown_connections 2024-05-08T03:01:52.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 --2- 172.21.15.46:0/2724303301 >> v2:172.21.15.80:6807/3216858417 conn(0x9cf0c0 0xad7800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 --2- 172.21.15.46:0/2724303301 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f5bf4037210 0x7f5bf4039720 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 --2- 172.21.15.46:0/2724303301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x9ce770 0xafab20 unknown :-1 s=CLOSED pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:52.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 >> 172.21.15.46:0/2724303301 conn(0x8ef960 msgr2=0x9cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:52.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 shutdown_connections 2024-05-08T03:01:52.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:52.963+0000 7f5c220fcec0 1 -- 172.21.15.46:0/2724303301 wait complete. 2024-05-08T03:01:52.970 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:52.970 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj2 /etc/passwd 2024-05-08T03:01:53.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.009+0000 7f6207a3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.015+0000 7f6207a3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.015+0000 7f6207a3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.016+0000 7f6207a3aec0 1 Processor -- start 2024-05-08T03:01:53.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.016+0000 7f6207a3aec0 1 -- start start 2024-05-08T03:01:53.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.017+0000 7f6207a3aec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xcb4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.017+0000 7f6207a3aec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xc20950 con 0xcb9be0 2024-05-08T03:01:53.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.017+0000 7f61faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xcb4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.018+0000 7f61faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xcb4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34768/0 (socket says 172.21.15.46:34768) 2024-05-08T03:01:53.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.018+0000 7f61faffd640 1 -- 172.21.15.46:0/1943999359 learned_addr learned my addr 172.21.15.46:0/1943999359 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.018+0000 7f61faffd640 1 -- 172.21.15.46:0/1943999359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xbbf1e0 con 0xcb9be0 2024-05-08T03:01:53.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.018+0000 7f61faffd640 1 --2- 172.21.15.46:0/1943999359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xcb4fe0 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdc7d22e1c57359 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.018+0000 7f61f97fa640 1 -- 172.21.15.46:0/1943999359 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f61ec00c5e0 con 0xcb9be0 2024-05-08T03:01:53.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.018+0000 7f61f97fa640 1 -- 172.21.15.46:0/1943999359 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f61ec00c740 con 0xcb9be0 2024-05-08T03:01:53.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.018+0000 7f61f97fa640 1 -- 172.21.15.46:0/1943999359 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f61ec00c9e0 con 0xcb9be0 2024-05-08T03:01:53.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.019+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1943999359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 msgr2=0xcb4fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.019+0000 7f6207a3aec0 1 --2- 172.21.15.46:0/1943999359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xcb4fe0 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.019+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1943999359 shutdown_connections 2024-05-08T03:01:53.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.019+0000 7f6207a3aec0 1 --2- 172.21.15.46:0/1943999359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xcb4fe0 unknown :-1 s=CLOSED pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.019+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1943999359 >> 172.21.15.46:0/1943999359 conn(0xbd7960 msgr2=0xcb2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.019+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1943999359 shutdown_connections 2024-05-08T03:01:53.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.019+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1943999359 wait complete. 2024-05-08T03:01:53.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.020+0000 7f6207a3aec0 1 Processor -- start 2024-05-08T03:01:53.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.020+0000 7f6207a3aec0 1 -- start start 2024-05-08T03:01:53.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f6207a3aec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xdbd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f6207a3aec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xc1e3d0 con 0xcb9be0 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f61faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xdbd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f61faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xdbd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34782/0 (socket says 172.21.15.46:34782) 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f61faffd640 1 -- 172.21.15.46:0/1487077715 learned_addr learned my addr 172.21.15.46:0/1487077715 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f61faffd640 1 -- 172.21.15.46:0/1487077715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xbb1e30 con 0xcb9be0 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f61faffd640 1 --2- 172.21.15.46:0/1487077715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xdbd6e0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f61f3fff640 1 -- 172.21.15.46:0/1487077715 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f61ec013a10 con 0xcb9be0 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f61f3fff640 1 -- 172.21.15.46:0/1487077715 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f61ec013b70 con 0xcb9be0 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xbb1890 con 0xcb9be0 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f61f3fff640 1 -- 172.21.15.46:0/1487077715 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f61ec013e10 con 0xcb9be0 2024-05-08T03:01:53.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.022+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xdbd320 con 0xcb9be0 2024-05-08T03:01:53.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.023+0000 7f61f3fff640 1 -- 172.21.15.46:0/1487077715 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f61ec010400 con 0xcb9be0 2024-05-08T03:01:53.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.024+0000 7f61f3fff640 1 --2- 172.21.15.46:0/1487077715 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f61dc037210 0x7f61dc039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.024+0000 7f61f3fff640 1 -- 172.21.15.46:0/1487077715 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7f61ec008040 con 0xcb9be0 2024-05-08T03:01:53.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.024+0000 7f6207a3aec0 1 --2- 172.21.15.46:0/1487077715 >> v2:172.21.15.80:6807/3216858417 conn(0xcbbc50 0xde4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.024+0000 7f61fa7fc640 1 --2- 172.21.15.46:0/1487077715 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f61dc037210 0x7f61dc039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.024+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 --> v2:172.21.15.80:6807/3216858417 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0xdc4190 con 0xcbbc50 2024-05-08T03:01:53.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.025+0000 7f61fa7fc640 1 --2- 172.21.15.46:0/1487077715 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f61dc037210 0x7f61dc039720 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.025+0000 7f61fb7fe640 1 --2- 172.21.15.46:0/1487077715 >> v2:172.21.15.80:6807/3216858417 conn(0xcbbc50 0xde4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:53.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.027+0000 7f61fb7fe640 1 --2- 172.21.15.46:0/1487077715 >> v2:172.21.15.80:6807/3216858417 conn(0xcbbc50 0xde4e60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.037+0000 7f61fb7fe640 1 -- 172.21.15.46:0/1487077715 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== osd_op_reply(1 obj2 [writefull 0~11982] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f61f400a430 con 0xcbbc50 2024-05-08T03:01:53.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 >> v2:172.21.15.80:6807/3216858417 conn(0xcbbc50 msgr2=0xde4e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 --2- 172.21.15.46:0/1487077715 >> v2:172.21.15.80:6807/3216858417 conn(0xcbbc50 0xde4e60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f61dc037210 msgr2=0x7f61dc039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 --2- 172.21.15.46:0/1487077715 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f61dc037210 0x7f61dc039720 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 msgr2=0xdbd6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 --2- 172.21.15.46:0/1487077715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xdbd6e0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 shutdown_connections 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 --2- 172.21.15.46:0/1487077715 >> v2:172.21.15.80:6807/3216858417 conn(0xcbbc50 0xde4e60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 --2- 172.21.15.46:0/1487077715 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f61dc037210 0x7f61dc039720 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 --2- 172.21.15.46:0/1487077715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcb9be0 0xdbd6e0 unknown :-1 s=CLOSED pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 >> 172.21.15.46:0/1487077715 conn(0xbd7960 msgr2=0xcb2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 shutdown_connections 2024-05-08T03:01:53.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.038+0000 7f6207a3aec0 1 -- 172.21.15.46:0/1487077715 wait complete. 2024-05-08T03:01:53.045 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:53.045 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj3 /etc/passwd 2024-05-08T03:01:53.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.079+0000 7ff163efcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.085+0000 7ff163efcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.085+0000 7ff163efcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.086+0000 7ff163efcec0 1 Processor -- start 2024-05-08T03:01:53.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.086+0000 7ff163efcec0 1 -- start start 2024-05-08T03:01:53.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.087+0000 7ff163efcec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1d3dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.087+0000 7ff163efcec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1ca9950 con 0x1d42be0 2024-05-08T03:01:53.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.087+0000 7ff1577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1d3dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.088+0000 7ff1577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1d3dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34798/0 (socket says 172.21.15.46:34798) 2024-05-08T03:01:53.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.088+0000 7ff1577fe640 1 -- 172.21.15.46:0/3310090561 learned_addr learned my addr 172.21.15.46:0/3310090561 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.088+0000 7ff1577fe640 1 -- 172.21.15.46:0/3310090561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c481e0 con 0x1d42be0 2024-05-08T03:01:53.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.088+0000 7ff1577fe640 1 --2- 172.21.15.46:0/3310090561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1d3dfe0 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a65eb2068fde04 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.088+0000 7ff155ffb640 1 -- 172.21.15.46:0/3310090561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff14800d500 con 0x1d42be0 2024-05-08T03:01:53.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.088+0000 7ff155ffb640 1 -- 172.21.15.46:0/3310090561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff14800d660 con 0x1d42be0 2024-05-08T03:01:53.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.088+0000 7ff155ffb640 1 -- 172.21.15.46:0/3310090561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff14800d900 con 0x1d42be0 2024-05-08T03:01:53.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.089+0000 7ff163efcec0 1 -- 172.21.15.46:0/3310090561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 msgr2=0x1d3dfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.089+0000 7ff163efcec0 1 --2- 172.21.15.46:0/3310090561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1d3dfe0 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.089+0000 7ff163efcec0 1 -- 172.21.15.46:0/3310090561 shutdown_connections 2024-05-08T03:01:53.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.089+0000 7ff163efcec0 1 --2- 172.21.15.46:0/3310090561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1d3dfe0 unknown :-1 s=CLOSED pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.089+0000 7ff163efcec0 1 -- 172.21.15.46:0/3310090561 >> 172.21.15.46:0/3310090561 conn(0x1c60960 msgr2=0x1d3b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.089+0000 7ff163efcec0 1 -- 172.21.15.46:0/3310090561 shutdown_connections 2024-05-08T03:01:53.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.089+0000 7ff163efcec0 1 -- 172.21.15.46:0/3310090561 wait complete. 2024-05-08T03:01:53.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.090+0000 7ff163efcec0 1 Processor -- start 2024-05-08T03:01:53.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.090+0000 7ff163efcec0 1 -- start start 2024-05-08T03:01:53.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.091+0000 7ff163efcec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1e466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.091+0000 7ff163efcec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1ca73d0 con 0x1d42be0 2024-05-08T03:01:53.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.091+0000 7ff1577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1e466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.091+0000 7ff1577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1e466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34804/0 (socket says 172.21.15.46:34804) 2024-05-08T03:01:53.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.091+0000 7ff1577fe640 1 -- 172.21.15.46:0/3328397868 learned_addr learned my addr 172.21.15.46:0/3328397868 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.092+0000 7ff1577fe640 1 -- 172.21.15.46:0/3328397868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c3ae30 con 0x1d42be0 2024-05-08T03:01:53.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.092+0000 7ff1577fe640 1 --2- 172.21.15.46:0/3328397868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1e466f0 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.092+0000 7ff154ff9640 1 -- 172.21.15.46:0/3328397868 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff14800fb60 con 0x1d42be0 2024-05-08T03:01:53.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.092+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c3a890 con 0x1d42be0 2024-05-08T03:01:53.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.092+0000 7ff154ff9640 1 -- 172.21.15.46:0/3328397868 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff14800fcc0 con 0x1d42be0 2024-05-08T03:01:53.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.092+0000 7ff154ff9640 1 -- 172.21.15.46:0/3328397868 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1480183d0 con 0x1d42be0 2024-05-08T03:01:53.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.092+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1e497c0 con 0x1d42be0 2024-05-08T03:01:53.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.093+0000 7ff154ff9640 1 -- 172.21.15.46:0/3328397868 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff148018610 con 0x1d42be0 2024-05-08T03:01:53.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.093+0000 7ff154ff9640 1 --2- 172.21.15.46:0/3328397868 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff1440371c0 0x7ff1440396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.093+0000 7ff154ff9640 1 -- 172.21.15.46:0/3328397868 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7ff14804b9b0 con 0x1d42be0 2024-05-08T03:01:53.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.093+0000 7ff163efcec0 1 --2- 172.21.15.46:0/3328397868 >> v2:172.21.15.46:6806/2291706666 conn(0x1d44c50 0x1e59860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.093+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1e49e60 con 0x1d44c50 2024-05-08T03:01:53.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.094+0000 7ff156ffd640 1 --2- 172.21.15.46:0/3328397868 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff1440371c0 0x7ff1440396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.094+0000 7ff156ffd640 1 --2- 172.21.15.46:0/3328397868 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff1440371c0 0x7ff1440396d0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.094+0000 7ff15cb9c640 1 --2- 172.21.15.46:0/3328397868 >> v2:172.21.15.46:6806/2291706666 conn(0x1d44c50 0x1e59860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:53.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.097+0000 7ff15cb9c640 1 --2- 172.21.15.46:0/3328397868 >> v2:172.21.15.46:6806/2291706666 conn(0x1d44c50 0x1e59860 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff15cb9c640 1 -- 172.21.15.46:0/3328397868 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(1 obj3 [writefull 0~11982] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff15000a430 con 0x1d44c50 2024-05-08T03:01:53.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 >> v2:172.21.15.46:6806/2291706666 conn(0x1d44c50 msgr2=0x1e59860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 --2- 172.21.15.46:0/3328397868 >> v2:172.21.15.46:6806/2291706666 conn(0x1d44c50 0x1e59860 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff1440371c0 msgr2=0x7ff1440396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 --2- 172.21.15.46:0/3328397868 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff1440371c0 0x7ff1440396d0 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 msgr2=0x1e466f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 --2- 172.21.15.46:0/3328397868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1e466f0 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 shutdown_connections 2024-05-08T03:01:53.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 --2- 172.21.15.46:0/3328397868 >> v2:172.21.15.46:6806/2291706666 conn(0x1d44c50 0x1e59860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 --2- 172.21.15.46:0/3328397868 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ff1440371c0 0x7ff1440396d0 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 --2- 172.21.15.46:0/3328397868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1d42be0 0x1e466f0 unknown :-1 s=CLOSED pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 >> 172.21.15.46:0/3328397868 conn(0x1c60960 msgr2=0x1d3b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 shutdown_connections 2024-05-08T03:01:53.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.310+0000 7ff163efcec0 1 -- 172.21.15.46:0/3328397868 wait complete. 2024-05-08T03:01:53.317 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:53.317 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj4 /etc/passwd 2024-05-08T03:01:53.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.350+0000 7f4899238ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.355+0000 7f4899238ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.355+0000 7f4899238ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.356+0000 7f4899238ec0 1 Processor -- start 2024-05-08T03:01:53.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.356+0000 7f4899238ec0 1 -- start start 2024-05-08T03:01:53.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f4899238ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xa086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f4899238ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x973950 con 0xa0cbe0 2024-05-08T03:01:53.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f489139b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xa086e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f489139b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xa086e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34820/0 (socket says 172.21.15.46:34820) 2024-05-08T03:01:53.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f489139b640 1 -- 172.21.15.46:0/2429583065 learned_addr learned my addr 172.21.15.46:0/2429583065 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f489139b640 1 -- 172.21.15.46:0/2429583065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9121e0 con 0xa0cbe0 2024-05-08T03:01:53.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f489139b640 1 --2- 172.21.15.46:0/2429583065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xa086e0 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe33403034ad3667 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f488affd640 1 -- 172.21.15.46:0/2429583065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f487c02fb90 con 0xa0cbe0 2024-05-08T03:01:53.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f488affd640 1 -- 172.21.15.46:0/2429583065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f487c02fcf0 con 0xa0cbe0 2024-05-08T03:01:53.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.358+0000 7f488affd640 1 -- 172.21.15.46:0/2429583065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f487c034410 con 0xa0cbe0 2024-05-08T03:01:53.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.359+0000 7f4899238ec0 1 -- 172.21.15.46:0/2429583065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 msgr2=0xa086e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.359+0000 7f4899238ec0 1 --2- 172.21.15.46:0/2429583065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xa086e0 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.359+0000 7f4899238ec0 1 -- 172.21.15.46:0/2429583065 shutdown_connections 2024-05-08T03:01:53.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.359+0000 7f4899238ec0 1 --2- 172.21.15.46:0/2429583065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xa086e0 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.359+0000 7f4899238ec0 1 -- 172.21.15.46:0/2429583065 >> 172.21.15.46:0/2429583065 conn(0x92a960 msgr2=0xa05350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.359+0000 7f4899238ec0 1 -- 172.21.15.46:0/2429583065 shutdown_connections 2024-05-08T03:01:53.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.359+0000 7f4899238ec0 1 -- 172.21.15.46:0/2429583065 wait complete. 2024-05-08T03:01:53.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.360+0000 7f4899238ec0 1 Processor -- start 2024-05-08T03:01:53.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.360+0000 7f4899238ec0 1 -- start start 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f4899238ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xb37f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f4899238ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x9713d0 con 0xa0cbe0 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f489139b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xb37f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f489139b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xb37f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34826/0 (socket says 172.21.15.46:34826) 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f489139b640 1 -- 172.21.15.46:0/873676537 learned_addr learned my addr 172.21.15.46:0/873676537 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f489139b640 1 -- 172.21.15.46:0/873676537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x904e30 con 0xa0cbe0 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f489139b640 1 --2- 172.21.15.46:0/873676537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xb37f20 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f4889ffb640 1 -- 172.21.15.46:0/873676537 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f487c039040 con 0xa0cbe0 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f4889ffb640 1 -- 172.21.15.46:0/873676537 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f487c034bd0 con 0xa0cbe0 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x904890 con 0xa0cbe0 2024-05-08T03:01:53.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f4889ffb640 1 -- 172.21.15.46:0/873676537 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f487c034e70 con 0xa0cbe0 2024-05-08T03:01:53.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.362+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb15fe0 con 0xa0cbe0 2024-05-08T03:01:53.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.363+0000 7f4889ffb640 1 -- 172.21.15.46:0/873676537 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f487c03f3e0 con 0xa0cbe0 2024-05-08T03:01:53.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.364+0000 7f4889ffb640 1 --2- 172.21.15.46:0/873676537 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4878037210 0x7f4878039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.364+0000 7f4889ffb640 1 -- 172.21.15.46:0/873676537 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7f487c06c4d0 con 0xa0cbe0 2024-05-08T03:01:53.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.364+0000 7f4899238ec0 1 --2- 172.21.15.46:0/873676537 >> v2:172.21.15.80:6807/3216858417 conn(0xa0ea80 0xb149c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.364+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 --> v2:172.21.15.80:6807/3216858417 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0xb17660 con 0xa0ea80 2024-05-08T03:01:53.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.364+0000 7f4890b9a640 1 --2- 172.21.15.46:0/873676537 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4878037210 0x7f4878039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.365+0000 7f4890b9a640 1 --2- 172.21.15.46:0/873676537 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4878037210 0x7f4878039720 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.365+0000 7f4891b9c640 1 --2- 172.21.15.46:0/873676537 >> v2:172.21.15.80:6807/3216858417 conn(0xa0ea80 0xb149c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:53.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.368+0000 7f4891b9c640 1 --2- 172.21.15.46:0/873676537 >> v2:172.21.15.80:6807/3216858417 conn(0xa0ea80 0xb149c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4891b9c640 1 -- 172.21.15.46:0/873676537 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== osd_op_reply(1 obj4 [writefull 0~11982] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f488400c430 con 0xa0ea80 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 >> v2:172.21.15.80:6807/3216858417 conn(0xa0ea80 msgr2=0xb149c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 --2- 172.21.15.46:0/873676537 >> v2:172.21.15.80:6807/3216858417 conn(0xa0ea80 0xb149c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4878037210 msgr2=0x7f4878039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 --2- 172.21.15.46:0/873676537 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4878037210 0x7f4878039720 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 msgr2=0xb37f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 --2- 172.21.15.46:0/873676537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xb37f20 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 shutdown_connections 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 --2- 172.21.15.46:0/873676537 >> v2:172.21.15.80:6807/3216858417 conn(0xa0ea80 0xb149c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 --2- 172.21.15.46:0/873676537 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4878037210 0x7f4878039720 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 --2- 172.21.15.46:0/873676537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa0cbe0 0xb37f20 unknown :-1 s=CLOSED pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 >> 172.21.15.46:0/873676537 conn(0x92a960 msgr2=0xa05350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 shutdown_connections 2024-05-08T03:01:53.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.379+0000 7f4899238ec0 1 -- 172.21.15.46:0/873676537 wait complete. 2024-05-08T03:01:53.386 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:53.386 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj5 /etc/passwd 2024-05-08T03:01:53.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.418+0000 7fa479a37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.427+0000 7fa479a37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.427+0000 7fa479a37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.428+0000 7fa479a37ec0 1 Processor -- start 2024-05-08T03:01:53.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.428+0000 7fa479a37ec0 1 -- start start 2024-05-08T03:01:53.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.429+0000 7fa479a37ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x165cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.429+0000 7fa479a37ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x15c3950 con 0x1659770 2024-05-08T03:01:53.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.429+0000 7fa471b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x165cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.429+0000 7fa471b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x165cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34852/0 (socket says 172.21.15.46:34852) 2024-05-08T03:01:53.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.429+0000 7fa471b9b640 1 -- 172.21.15.46:0/781077900 learned_addr learned my addr 172.21.15.46:0/781077900 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.430+0000 7fa471b9b640 1 -- 172.21.15.46:0/781077900 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x15621e0 con 0x1659770 2024-05-08T03:01:53.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.430+0000 7fa471b9b640 1 --2- 172.21.15.46:0/781077900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x165cc70 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af68dc4b5d29052 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.430+0000 7fa46b7fe640 1 -- 172.21.15.46:0/781077900 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa45c032040 con 0x1659770 2024-05-08T03:01:53.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.430+0000 7fa46b7fe640 1 -- 172.21.15.46:0/781077900 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa45c00a040 con 0x1659770 2024-05-08T03:01:53.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.430+0000 7fa46b7fe640 1 -- 172.21.15.46:0/781077900 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa45c00a2e0 con 0x1659770 2024-05-08T03:01:53.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.431+0000 7fa479a37ec0 1 -- 172.21.15.46:0/781077900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 msgr2=0x165cc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.431+0000 7fa479a37ec0 1 --2- 172.21.15.46:0/781077900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x165cc70 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.431+0000 7fa479a37ec0 1 -- 172.21.15.46:0/781077900 shutdown_connections 2024-05-08T03:01:53.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.431+0000 7fa479a37ec0 1 --2- 172.21.15.46:0/781077900 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x165cc70 unknown :-1 s=CLOSED pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.431+0000 7fa479a37ec0 1 -- 172.21.15.46:0/781077900 >> 172.21.15.46:0/781077900 conn(0x157a960 msgr2=0x1654a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.431+0000 7fa479a37ec0 1 -- 172.21.15.46:0/781077900 shutdown_connections 2024-05-08T03:01:53.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.431+0000 7fa479a37ec0 1 -- 172.21.15.46:0/781077900 wait complete. 2024-05-08T03:01:53.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.432+0000 7fa479a37ec0 1 Processor -- start 2024-05-08T03:01:53.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.432+0000 7fa479a37ec0 1 -- start start 2024-05-08T03:01:53.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.433+0000 7fa479a37ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x176ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.433+0000 7fa479a37ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x15c13d0 con 0x1659770 2024-05-08T03:01:53.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.433+0000 7fa471b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x176ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.433+0000 7fa471b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x176ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34864/0 (socket says 172.21.15.46:34864) 2024-05-08T03:01:53.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.433+0000 7fa471b9b640 1 -- 172.21.15.46:0/3196469380 learned_addr learned my addr 172.21.15.46:0/3196469380 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.434+0000 7fa471b9b640 1 -- 172.21.15.46:0/3196469380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1554e30 con 0x1659770 2024-05-08T03:01:53.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.434+0000 7fa471b9b640 1 --2- 172.21.15.46:0/3196469380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x176ac00 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.434+0000 7fa46a7fc640 1 -- 172.21.15.46:0/3196469380 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa45c02d650 con 0x1659770 2024-05-08T03:01:53.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.434+0000 7fa46a7fc640 1 -- 172.21.15.46:0/3196469380 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa45c02d7b0 con 0x1659770 2024-05-08T03:01:53.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.434+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1554890 con 0x1659770 2024-05-08T03:01:53.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.434+0000 7fa46a7fc640 1 -- 172.21.15.46:0/3196469380 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa45c02da50 con 0x1659770 2024-05-08T03:01:53.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.434+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1768180 con 0x1659770 2024-05-08T03:01:53.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.435+0000 7fa46a7fc640 1 -- 172.21.15.46:0/3196469380 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa45c02dc40 con 0x1659770 2024-05-08T03:01:53.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.435+0000 7fa46a7fc640 1 --2- 172.21.15.46:0/3196469380 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa458037210 0x7fa458039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.435+0000 7fa46a7fc640 1 -- 172.21.15.46:0/3196469380 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7fa45c032040 con 0x1659770 2024-05-08T03:01:53.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.435+0000 7fa479a37ec0 1 --2- 172.21.15.46:0/3196469380 >> v2:172.21.15.80:6807/3216858417 conn(0x165a0c0 0x17878e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.435+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 --> v2:172.21.15.80:6807/3216858417 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1787e20 con 0x165a0c0 2024-05-08T03:01:53.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.436+0000 7fa47139a640 1 --2- 172.21.15.46:0/3196469380 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa458037210 0x7fa458039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.436+0000 7fa47139a640 1 --2- 172.21.15.46:0/3196469380 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa458037210 0x7fa458039720 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.436+0000 7fa47239c640 1 --2- 172.21.15.46:0/3196469380 >> v2:172.21.15.80:6807/3216858417 conn(0x165a0c0 0x17878e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:53.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.439+0000 7fa47239c640 1 --2- 172.21.15.46:0/3196469380 >> v2:172.21.15.80:6807/3216858417 conn(0x165a0c0 0x17878e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.448+0000 7fa47239c640 1 -- 172.21.15.46:0/3196469380 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== osd_op_reply(1 obj5 [writefull 0~11982] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa46400a430 con 0x165a0c0 2024-05-08T03:01:53.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 >> v2:172.21.15.80:6807/3216858417 conn(0x165a0c0 msgr2=0x17878e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 --2- 172.21.15.46:0/3196469380 >> v2:172.21.15.80:6807/3216858417 conn(0x165a0c0 0x17878e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa458037210 msgr2=0x7fa458039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 --2- 172.21.15.46:0/3196469380 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa458037210 0x7fa458039720 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 msgr2=0x176ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 --2- 172.21.15.46:0/3196469380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x176ac00 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 shutdown_connections 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 --2- 172.21.15.46:0/3196469380 >> v2:172.21.15.80:6807/3216858417 conn(0x165a0c0 0x17878e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 --2- 172.21.15.46:0/3196469380 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa458037210 0x7fa458039720 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 --2- 172.21.15.46:0/3196469380 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1659770 0x176ac00 unknown :-1 s=CLOSED pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 >> 172.21.15.46:0/3196469380 conn(0x157a960 msgr2=0x165cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 shutdown_connections 2024-05-08T03:01:53.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.449+0000 7fa479a37ec0 1 -- 172.21.15.46:0/3196469380 wait complete. 2024-05-08T03:01:53.455 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:53.455 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj6 /etc/passwd 2024-05-08T03:01:53.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.488+0000 7f296ba2cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.494+0000 7f296ba2cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.494+0000 7f296ba2cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.495+0000 7f296ba2cec0 1 Processor -- start 2024-05-08T03:01:53.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.495+0000 7f296ba2cec0 1 -- start start 2024-05-08T03:01:53.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.496+0000 7f296ba2cec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.496+0000 7f296ba2cec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x9a4950 con 0xa3dbe0 2024-05-08T03:01:53.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.496+0000 7f295f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.496+0000 7f295f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34884/0 (socket says 172.21.15.46:34884) 2024-05-08T03:01:53.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.496+0000 7f295f7fe640 1 -- 172.21.15.46:0/3062580128 learned_addr learned my addr 172.21.15.46:0/3062580128 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.496+0000 7f295f7fe640 1 -- 172.21.15.46:0/3062580128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9431e0 con 0xa3dbe0 2024-05-08T03:01:53.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.497+0000 7f295f7fe640 1 --2- 172.21.15.46:0/3062580128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb561f0 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4e6d012e75b5e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.497+0000 7f295dffb640 1 -- 172.21.15.46:0/3062580128 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f294c02fb90 con 0xa3dbe0 2024-05-08T03:01:53.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.497+0000 7f295dffb640 1 -- 172.21.15.46:0/3062580128 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f294c02fcf0 con 0xa3dbe0 2024-05-08T03:01:53.502 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.497+0000 7f295dffb640 1 -- 172.21.15.46:0/3062580128 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f294c034410 con 0xa3dbe0 2024-05-08T03:01:53.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.497+0000 7f296ba2cec0 1 -- 172.21.15.46:0/3062580128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 msgr2=0xb561f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.497+0000 7f296ba2cec0 1 --2- 172.21.15.46:0/3062580128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb561f0 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.498+0000 7f296ba2cec0 1 -- 172.21.15.46:0/3062580128 shutdown_connections 2024-05-08T03:01:53.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.498+0000 7f296ba2cec0 1 --2- 172.21.15.46:0/3062580128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb561f0 unknown :-1 s=CLOSED pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.498+0000 7f296ba2cec0 1 -- 172.21.15.46:0/3062580128 >> 172.21.15.46:0/3062580128 conn(0x95b960 msgr2=0xa36350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.498+0000 7f296ba2cec0 1 -- 172.21.15.46:0/3062580128 shutdown_connections 2024-05-08T03:01:53.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.498+0000 7f296ba2cec0 1 -- 172.21.15.46:0/3062580128 wait complete. 2024-05-08T03:01:53.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.499+0000 7f296ba2cec0 1 Processor -- start 2024-05-08T03:01:53.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.499+0000 7f296ba2cec0 1 -- start start 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.500+0000 7f296ba2cec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb43270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.500+0000 7f296ba2cec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x9a23d0 con 0xa3dbe0 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.500+0000 7f295f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb43270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.500+0000 7f295f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb43270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34898/0 (socket says 172.21.15.46:34898) 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.500+0000 7f295f7fe640 1 -- 172.21.15.46:0/212021353 learned_addr learned my addr 172.21.15.46:0/212021353 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.500+0000 7f295f7fe640 1 -- 172.21.15.46:0/212021353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x935e30 con 0xa3dbe0 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.501+0000 7f295f7fe640 1 --2- 172.21.15.46:0/212021353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb43270 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.501+0000 7f295cff9640 1 -- 172.21.15.46:0/212021353 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f294c02fe60 con 0xa3dbe0 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.501+0000 7f295cff9640 1 -- 172.21.15.46:0/212021353 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f294c034e10 con 0xa3dbe0 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.501+0000 7f295cff9640 1 -- 172.21.15.46:0/212021353 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f294c033530 con 0xa3dbe0 2024-05-08T03:01:53.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.501+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x935890 con 0xa3dbe0 2024-05-08T03:01:53.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.501+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb46540 con 0xa3dbe0 2024-05-08T03:01:53.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.502+0000 7f295cff9640 1 -- 172.21.15.46:0/212021353 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f294c03c040 con 0xa3dbe0 2024-05-08T03:01:53.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.502+0000 7f295cff9640 1 --2- 172.21.15.46:0/212021353 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2948037210 0x7f2948039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.502+0000 7f295cff9640 1 -- 172.21.15.46:0/212021353 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7f294c039040 con 0xa3dbe0 2024-05-08T03:01:53.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.502+0000 7f296ba2cec0 1 --2- 172.21.15.46:0/212021353 >> v2:172.21.15.46:6806/2291706666 conn(0xa3fa80 0xb66850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.502+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0xb46be0 con 0xa3fa80 2024-05-08T03:01:53.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.502+0000 7f295effd640 1 --2- 172.21.15.46:0/212021353 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2948037210 0x7f2948039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.503+0000 7f295ffff640 1 --2- 172.21.15.46:0/212021353 >> v2:172.21.15.46:6806/2291706666 conn(0xa3fa80 0xb66850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:53.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.503+0000 7f295effd640 1 --2- 172.21.15.46:0/212021353 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2948037210 0x7f2948039720 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.505+0000 7f295ffff640 1 --2- 172.21.15.46:0/212021353 >> v2:172.21.15.46:6806/2291706666 conn(0xa3fa80 0xb66850 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.515+0000 7f295ffff640 1 -- 172.21.15.46:0/212021353 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(1 obj6 [writefull 0~11982] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f295400c430 con 0xa3fa80 2024-05-08T03:01:53.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 >> v2:172.21.15.46:6806/2291706666 conn(0xa3fa80 msgr2=0xb66850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 --2- 172.21.15.46:0/212021353 >> v2:172.21.15.46:6806/2291706666 conn(0xa3fa80 0xb66850 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2948037210 msgr2=0x7f2948039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 --2- 172.21.15.46:0/212021353 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2948037210 0x7f2948039720 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 msgr2=0xb43270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 --2- 172.21.15.46:0/212021353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb43270 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 shutdown_connections 2024-05-08T03:01:53.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 --2- 172.21.15.46:0/212021353 >> v2:172.21.15.46:6806/2291706666 conn(0xa3fa80 0xb66850 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 --2- 172.21.15.46:0/212021353 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2948037210 0x7f2948039720 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 --2- 172.21.15.46:0/212021353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa3dbe0 0xb43270 unknown :-1 s=CLOSED pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 >> 172.21.15.46:0/212021353 conn(0x95b960 msgr2=0xa36350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 shutdown_connections 2024-05-08T03:01:53.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.516+0000 7f296ba2cec0 1 -- 172.21.15.46:0/212021353 wait complete. 2024-05-08T03:01:53.522 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:53.522 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj7 /etc/passwd 2024-05-08T03:01:53.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.555+0000 7f374ed2aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.560+0000 7f374ed2aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.561+0000 7f374ed2aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.562+0000 7f374ed2aec0 1 Processor -- start 2024-05-08T03:01:53.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.562+0000 7f374ed2aec0 1 -- start start 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.563+0000 7f374ed2aec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xdf90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.563+0000 7f374ed2aec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xd79950 con 0xe12be0 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.563+0000 7f374719b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xdf90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.563+0000 7f374719b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xdf90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34916/0 (socket says 172.21.15.46:34916) 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.563+0000 7f374719b640 1 -- 172.21.15.46:0/268359735 learned_addr learned my addr 172.21.15.46:0/268359735 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f374719b640 1 -- 172.21.15.46:0/268359735 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd181e0 con 0xe12be0 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f374719b640 1 --2- 172.21.15.46:0/268359735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xdf90c0 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0e899fb8a3744a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f3745998640 1 -- 172.21.15.46:0/268359735 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f373800d500 con 0xe12be0 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f3745998640 1 -- 172.21.15.46:0/268359735 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f373800d660 con 0xe12be0 2024-05-08T03:01:53.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f3745998640 1 -- 172.21.15.46:0/268359735 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f373800d900 con 0xe12be0 2024-05-08T03:01:53.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f374ed2aec0 1 -- 172.21.15.46:0/268359735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 msgr2=0xdf90c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f374ed2aec0 1 --2- 172.21.15.46:0/268359735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xdf90c0 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f374ed2aec0 1 -- 172.21.15.46:0/268359735 shutdown_connections 2024-05-08T03:01:53.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f374ed2aec0 1 --2- 172.21.15.46:0/268359735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xdf90c0 unknown :-1 s=CLOSED pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f374ed2aec0 1 -- 172.21.15.46:0/268359735 >> 172.21.15.46:0/268359735 conn(0xd30960 msgr2=0xe0b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.564+0000 7f374ed2aec0 1 -- 172.21.15.46:0/268359735 shutdown_connections 2024-05-08T03:01:53.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.565+0000 7f374ed2aec0 1 -- 172.21.15.46:0/268359735 wait complete. 2024-05-08T03:01:53.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.565+0000 7f374ed2aec0 1 Processor -- start 2024-05-08T03:01:53.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.566+0000 7f374ed2aec0 1 -- start start 2024-05-08T03:01:53.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.567+0000 7f374ed2aec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xf1a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.567+0000 7f374ed2aec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xd773d0 con 0xe12be0 2024-05-08T03:01:53.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.567+0000 7f374719b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xf1a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.567+0000 7f374719b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xf1a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34932/0 (socket says 172.21.15.46:34932) 2024-05-08T03:01:53.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.567+0000 7f374719b640 1 -- 172.21.15.46:0/1015320639 learned_addr learned my addr 172.21.15.46:0/1015320639 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.567+0000 7f374719b640 1 -- 172.21.15.46:0/1015320639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd0ae30 con 0xe12be0 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.568+0000 7f374719b640 1 --2- 172.21.15.46:0/1015320639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xf1a4b0 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.568+0000 7f3744996640 1 -- 172.21.15.46:0/1015320639 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f373800fa30 con 0xe12be0 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.568+0000 7f3744996640 1 -- 172.21.15.46:0/1015320639 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f373800fb90 con 0xe12be0 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.568+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd0a890 con 0xe12be0 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.568+0000 7f3744996640 1 -- 172.21.15.46:0/1015320639 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f373800fe30 con 0xe12be0 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.568+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xf1d760 con 0xe12be0 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.569+0000 7f3744996640 1 -- 172.21.15.46:0/1015320639 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f373800c360 con 0xe12be0 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.569+0000 7f3744996640 1 --2- 172.21.15.46:0/1015320639 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f37200371b0 0x7f37200396c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.569+0000 7f3744996640 1 -- 172.21.15.46:0/1015320639 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7f3738048b80 con 0xe12be0 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.569+0000 7f374ed2aec0 1 --2- 172.21.15.46:0/1015320639 >> v2:172.21.15.46:6801/3562168766 conn(0xe14c50 0xf3c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.569+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 --> v2:172.21.15.46:6801/3562168766 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0xf2b1e0 con 0xe14c50 2024-05-08T03:01:53.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.569+0000 7f374699a640 1 --2- 172.21.15.46:0/1015320639 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f37200371b0 0x7f37200396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.570+0000 7f374699a640 1 --2- 172.21.15.46:0/1015320639 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f37200371b0 0x7f37200396c0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.570+0000 7f374799c640 1 --2- 172.21.15.46:0/1015320639 >> v2:172.21.15.46:6801/3562168766 conn(0xe14c50 0xf3c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:53.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.572+0000 7f374799c640 1 --2- 172.21.15.46:0/1015320639 >> v2:172.21.15.46:6801/3562168766 conn(0xe14c50 0xf3c860 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374799c640 1 -- 172.21.15.46:0/1015320639 <== osd.0 v2:172.21.15.46:6801/3562168766 1 ==== osd_op_reply(1 obj7 [writefull 0~11982] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f373000a430 con 0xe14c50 2024-05-08T03:01:53.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 >> v2:172.21.15.46:6801/3562168766 conn(0xe14c50 msgr2=0xf3c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 --2- 172.21.15.46:0/1015320639 >> v2:172.21.15.46:6801/3562168766 conn(0xe14c50 0xf3c860 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f37200371b0 msgr2=0x7f37200396c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 --2- 172.21.15.46:0/1015320639 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f37200371b0 0x7f37200396c0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 msgr2=0xf1a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 --2- 172.21.15.46:0/1015320639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xf1a4b0 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 shutdown_connections 2024-05-08T03:01:53.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 --2- 172.21.15.46:0/1015320639 >> v2:172.21.15.46:6801/3562168766 conn(0xe14c50 0xf3c860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 --2- 172.21.15.46:0/1015320639 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f37200371b0 0x7f37200396c0 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 --2- 172.21.15.46:0/1015320639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xe12be0 0xf1a4b0 unknown :-1 s=CLOSED pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 >> 172.21.15.46:0/1015320639 conn(0xd30960 msgr2=0xe0b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 shutdown_connections 2024-05-08T03:01:53.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.912+0000 7f374ed2aec0 1 -- 172.21.15.46:0/1015320639 wait complete. 2024-05-08T03:01:53.919 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:53.919 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj8 /etc/passwd 2024-05-08T03:01:53.955 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.951+0000 7f8ac668cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.957+0000 7f8ac668cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.957+0000 7f8ac668cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:53.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.958+0000 7f8ac668cec0 1 Processor -- start 2024-05-08T03:01:53.962 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.958+0000 7f8ac668cec0 1 -- start start 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.959+0000 7f8ac668cec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x21d7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.959+0000 7f8ac668cec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x201e950 con 0x209e260 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.959+0000 7f8abe79b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x21d7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.959+0000 7f8abe79b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x21d7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34942/0 (socket says 172.21.15.46:34942) 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.959+0000 7f8abe79b640 1 -- 172.21.15.46:0/2776259381 learned_addr learned my addr 172.21.15.46:0/2776259381 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.959+0000 7f8abe79b640 1 -- 172.21.15.46:0/2776259381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1fbd1e0 con 0x209e260 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8abe79b640 1 --2- 172.21.15.46:0/2776259381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x21d7ee0 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c29b891dda686d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8abcf98640 1 -- 172.21.15.46:0/2776259381 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8aa80061e0 con 0x209e260 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8abcf98640 1 -- 172.21.15.46:0/2776259381 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8aa8006340 con 0x209e260 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8abcf98640 1 -- 172.21.15.46:0/2776259381 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8aa8001af0 con 0x209e260 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8ac668cec0 1 -- 172.21.15.46:0/2776259381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 msgr2=0x21d7ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8ac668cec0 1 --2- 172.21.15.46:0/2776259381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x21d7ee0 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8ac668cec0 1 -- 172.21.15.46:0/2776259381 shutdown_connections 2024-05-08T03:01:53.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8ac668cec0 1 --2- 172.21.15.46:0/2776259381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x21d7ee0 unknown :-1 s=CLOSED pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8ac668cec0 1 -- 172.21.15.46:0/2776259381 >> 172.21.15.46:0/2776259381 conn(0x1fd5960 msgr2=0x20bd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8ac668cec0 1 -- 172.21.15.46:0/2776259381 shutdown_connections 2024-05-08T03:01:53.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.960+0000 7f8ac668cec0 1 -- 172.21.15.46:0/2776259381 wait complete. 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.961+0000 7f8ac668cec0 1 Processor -- start 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.962+0000 7f8ac668cec0 1 -- start start 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.963+0000 7f8ac668cec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x2148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.963+0000 7f8ac668cec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x201c3d0 con 0x209e260 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.963+0000 7f8abe79b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x2148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.963+0000 7f8abe79b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x2148760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34952/0 (socket says 172.21.15.46:34952) 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.963+0000 7f8abe79b640 1 -- 172.21.15.46:0/1071624410 learned_addr learned my addr 172.21.15.46:0/1071624410 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.963+0000 7f8abe79b640 1 -- 172.21.15.46:0/1071624410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1fafe30 con 0x209e260 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.964+0000 7f8abe79b640 1 --2- 172.21.15.46:0/1071624410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x2148760 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.964+0000 7f8ab6ffd640 1 -- 172.21.15.46:0/1071624410 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8aa8004830 con 0x209e260 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.964+0000 7f8ab6ffd640 1 -- 172.21.15.46:0/1071624410 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8aa8004990 con 0x209e260 2024-05-08T03:01:53.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.964+0000 7f8ab6ffd640 1 -- 172.21.15.46:0/1071624410 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8aa8004c30 con 0x209e260 2024-05-08T03:01:53.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.964+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1faf890 con 0x209e260 2024-05-08T03:01:53.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.964+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20b3f20 con 0x209e260 2024-05-08T03:01:53.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.965+0000 7f8ab6ffd640 1 -- 172.21.15.46:0/1071624410 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f8aa80143b0 con 0x209e260 2024-05-08T03:01:53.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.965+0000 7f8ab6ffd640 1 --2- 172.21.15.46:0/1071624410 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8aa4037210 0x7f8aa4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.965+0000 7f8ab6ffd640 1 -- 172.21.15.46:0/1071624410 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7f8aa8048440 con 0x209e260 2024-05-08T03:01:53.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.965+0000 7f8ac668cec0 1 --2- 172.21.15.46:0/1071624410 >> v2:172.21.15.46:6801/3562168766 conn(0x209ed80 0x21e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:53.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.965+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 --> v2:172.21.15.46:6801/3562168766 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x20b3620 con 0x209ed80 2024-05-08T03:01:53.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.965+0000 7f8abdf9a640 1 --2- 172.21.15.46:0/1071624410 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8aa4037210 0x7f8aa4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:53.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.966+0000 7f8abdf9a640 1 --2- 172.21.15.46:0/1071624410 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8aa4037210 0x7f8aa4039720 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.966+0000 7f8abef9c640 1 --2- 172.21.15.46:0/1071624410 >> v2:172.21.15.46:6801/3562168766 conn(0x209ed80 0x21e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:53.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.968+0000 7f8abef9c640 1 --2- 172.21.15.46:0/1071624410 >> v2:172.21.15.46:6801/3562168766 conn(0x209ed80 0x21e2dc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:53.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8abef9c640 1 -- 172.21.15.46:0/1071624410 <== osd.0 v2:172.21.15.46:6801/3562168766 1 ==== osd_op_reply(1 obj8 [writefull 0~11982] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8ab000c430 con 0x209ed80 2024-05-08T03:01:53.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 >> v2:172.21.15.46:6801/3562168766 conn(0x209ed80 msgr2=0x21e2dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 --2- 172.21.15.46:0/1071624410 >> v2:172.21.15.46:6801/3562168766 conn(0x209ed80 0x21e2dc0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8aa4037210 msgr2=0x7f8aa4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 --2- 172.21.15.46:0/1071624410 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8aa4037210 0x7f8aa4039720 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 msgr2=0x2148760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:53.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 --2- 172.21.15.46:0/1071624410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x2148760 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 shutdown_connections 2024-05-08T03:01:53.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 --2- 172.21.15.46:0/1071624410 >> v2:172.21.15.46:6801/3562168766 conn(0x209ed80 0x21e2dc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 --2- 172.21.15.46:0/1071624410 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8aa4037210 0x7f8aa4039720 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 --2- 172.21.15.46:0/1071624410 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x209e260 0x2148760 unknown :-1 s=CLOSED pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:53.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 >> 172.21.15.46:0/1071624410 conn(0x1fd5960 msgr2=0x21d7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:53.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 shutdown_connections 2024-05-08T03:01:53.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:53.978+0000 7f8ac668cec0 1 -- 172.21.15.46:0/1071624410 wait complete. 2024-05-08T03:01:53.985 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:53.985 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj9 /etc/passwd 2024-05-08T03:01:54.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.018+0000 7f62b3836ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:54.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.024+0000 7f62b3836ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:54.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.024+0000 7f62b3836ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:54.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.025+0000 7f62b3836ec0 1 Processor -- start 2024-05-08T03:01:54.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.025+0000 7f62b3836ec0 1 -- start start 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.026+0000 7f62b3836ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x1231cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.026+0000 7f62b3836ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x119e950 con 0x1237be0 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.026+0000 7f62a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x1231cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.026+0000 7f62a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x1231cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34962/0 (socket says 172.21.15.46:34962) 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.026+0000 7f62a77fe640 1 -- 172.21.15.46:0/481285246 learned_addr learned my addr 172.21.15.46:0/481285246 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.026+0000 7f62a77fe640 1 -- 172.21.15.46:0/481285246 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x113d1e0 con 0x1237be0 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62a77fe640 1 --2- 172.21.15.46:0/481285246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x1231cf0 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7290e04640a6a5a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62a5ffb640 1 -- 172.21.15.46:0/481285246 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62940061e0 con 0x1237be0 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62a5ffb640 1 -- 172.21.15.46:0/481285246 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6294006340 con 0x1237be0 2024-05-08T03:01:54.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62a5ffb640 1 -- 172.21.15.46:0/481285246 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6294004880 con 0x1237be0 2024-05-08T03:01:54.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62b3836ec0 1 -- 172.21.15.46:0/481285246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 msgr2=0x1231cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:54.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62b3836ec0 1 --2- 172.21.15.46:0/481285246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x1231cf0 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62b3836ec0 1 -- 172.21.15.46:0/481285246 shutdown_connections 2024-05-08T03:01:54.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62b3836ec0 1 --2- 172.21.15.46:0/481285246 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x1231cf0 unknown :-1 s=CLOSED pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62b3836ec0 1 -- 172.21.15.46:0/481285246 >> 172.21.15.46:0/481285246 conn(0x1155960 msgr2=0x1352200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:54.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.027+0000 7f62b3836ec0 1 -- 172.21.15.46:0/481285246 shutdown_connections 2024-05-08T03:01:54.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.028+0000 7f62b3836ec0 1 -- 172.21.15.46:0/481285246 wait complete. 2024-05-08T03:01:54.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.028+0000 7f62b3836ec0 1 Processor -- start 2024-05-08T03:01:54.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.029+0000 7f62b3836ec0 1 -- start start 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.030+0000 7f62b3836ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x135e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.030+0000 7f62b3836ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x119c3d0 con 0x1237be0 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.030+0000 7f62a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x135e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.030+0000 7f62a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x135e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34968/0 (socket says 172.21.15.46:34968) 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.030+0000 7f62a77fe640 1 -- 172.21.15.46:0/1751257039 learned_addr learned my addr 172.21.15.46:0/1751257039 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.030+0000 7f62a77fe640 1 -- 172.21.15.46:0/1751257039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x112fe30 con 0x1237be0 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.030+0000 7f62a77fe640 1 --2- 172.21.15.46:0/1751257039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x135e9e0 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.031+0000 7f62a4ff9640 1 -- 172.21.15.46:0/1751257039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6294001920 con 0x1237be0 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.031+0000 7f62a4ff9640 1 -- 172.21.15.46:0/1751257039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6294001a80 con 0x1237be0 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.031+0000 7f62a4ff9640 1 -- 172.21.15.46:0/1751257039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6294001d20 con 0x1237be0 2024-05-08T03:01:54.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.031+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x112f890 con 0x1237be0 2024-05-08T03:01:54.036 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.031+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x133e330 con 0x1237be0 2024-05-08T03:01:54.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.032+0000 7f62a4ff9640 1 -- 172.21.15.46:0/1751257039 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f6294001f10 con 0x1237be0 2024-05-08T03:01:54.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.032+0000 7f62a4ff9640 1 --2- 172.21.15.46:0/1751257039 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f6284037210 0x7f6284039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:54.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.032+0000 7f62a4ff9640 1 -- 172.21.15.46:0/1751257039 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7f62940484d0 con 0x1237be0 2024-05-08T03:01:54.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.032+0000 7f62b3836ec0 1 --2- 172.21.15.46:0/1751257039 >> v2:172.21.15.80:6807/3216858417 conn(0x1239c50 0x133d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:54.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.032+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 --> v2:172.21.15.80:6807/3216858417 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1351ba0 con 0x1239c50 2024-05-08T03:01:54.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.032+0000 7f62a6ffd640 1 --2- 172.21.15.46:0/1751257039 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f6284037210 0x7f6284039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:54.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.033+0000 7f62a6ffd640 1 --2- 172.21.15.46:0/1751257039 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f6284037210 0x7f6284039720 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:54.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.033+0000 7f62a7fff640 1 --2- 172.21.15.46:0/1751257039 >> v2:172.21.15.80:6807/3216858417 conn(0x1239c50 0x133d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:54.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.038+0000 7f62a7fff640 1 --2- 172.21.15.46:0/1751257039 >> v2:172.21.15.80:6807/3216858417 conn(0x1239c50 0x133d1a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:54.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62a7fff640 1 -- 172.21.15.46:0/1751257039 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== osd_op_reply(1 obj9 [writefull 0~11982] v688'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f629c00c430 con 0x1239c50 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 >> v2:172.21.15.80:6807/3216858417 conn(0x1239c50 msgr2=0x133d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 --2- 172.21.15.46:0/1751257039 >> v2:172.21.15.80:6807/3216858417 conn(0x1239c50 0x133d1a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f6284037210 msgr2=0x7f6284039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 --2- 172.21.15.46:0/1751257039 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f6284037210 0x7f6284039720 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 msgr2=0x135e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 --2- 172.21.15.46:0/1751257039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x135e9e0 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 shutdown_connections 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 --2- 172.21.15.46:0/1751257039 >> v2:172.21.15.80:6807/3216858417 conn(0x1239c50 0x133d1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 --2- 172.21.15.46:0/1751257039 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f6284037210 0x7f6284039720 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 --2- 172.21.15.46:0/1751257039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1237be0 0x135e9e0 unknown :-1 s=CLOSED pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 >> 172.21.15.46:0/1751257039 conn(0x1155960 msgr2=0x1352200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 shutdown_connections 2024-05-08T03:01:54.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.050+0000 7f62b3836ec0 1 -- 172.21.15.46:0/1751257039 wait complete. 2024-05-08T03:01:54.056 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:01:54.056 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put obj10 /etc/passwd 2024-05-08T03:01:54.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.089+0000 7f7098034ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:54.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.095+0000 7f7098034ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:54.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.095+0000 7f7098034ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:01:54.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.096+0000 7f7098034ec0 1 Processor -- start 2024-05-08T03:01:54.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.096+0000 7f7098034ec0 1 -- start start 2024-05-08T03:01:54.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.097+0000 7f7098034ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1ba68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:54.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.097+0000 7f7098034ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1a75950 con 0x1ba2660 2024-05-08T03:01:54.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.097+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1ba68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:54.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.097+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1ba68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34982/0 (socket says 172.21.15.46:34982) 2024-05-08T03:01:54.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.097+0000 7f708b7fe640 1 -- 172.21.15.46:0/331725698 learned_addr learned my addr 172.21.15.46:0/331725698 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:54.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.098+0000 7f708b7fe640 1 -- 172.21.15.46:0/331725698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a141e0 con 0x1ba2660 2024-05-08T03:01:54.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.098+0000 7f708b7fe640 1 --2- 172.21.15.46:0/331725698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1ba68a0 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab944094f5e9a742 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:54.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.098+0000 7f7089ffb640 1 -- 172.21.15.46:0/331725698 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f707c0061e0 con 0x1ba2660 2024-05-08T03:01:54.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.098+0000 7f7089ffb640 1 -- 172.21.15.46:0/331725698 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f707c006340 con 0x1ba2660 2024-05-08T03:01:54.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.098+0000 7f7089ffb640 1 -- 172.21.15.46:0/331725698 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f707c004880 con 0x1ba2660 2024-05-08T03:01:54.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.098+0000 7f7098034ec0 1 -- 172.21.15.46:0/331725698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 msgr2=0x1ba68a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:54.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.098+0000 7f7098034ec0 1 --2- 172.21.15.46:0/331725698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1ba68a0 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.098+0000 7f7098034ec0 1 -- 172.21.15.46:0/331725698 shutdown_connections 2024-05-08T03:01:54.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.098+0000 7f7098034ec0 1 --2- 172.21.15.46:0/331725698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1ba68a0 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.099+0000 7f7098034ec0 1 -- 172.21.15.46:0/331725698 >> 172.21.15.46:0/331725698 conn(0x1a2c960 msgr2=0x1b127b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:54.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.099+0000 7f7098034ec0 1 -- 172.21.15.46:0/331725698 shutdown_connections 2024-05-08T03:01:54.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.099+0000 7f7098034ec0 1 -- 172.21.15.46:0/331725698 wait complete. 2024-05-08T03:01:54.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.100+0000 7f7098034ec0 1 Processor -- start 2024-05-08T03:01:54.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.100+0000 7f7098034ec0 1 -- start start 2024-05-08T03:01:54.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.101+0000 7f7098034ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1b0b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:54.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.101+0000 7f7098034ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1a733d0 con 0x1ba2660 2024-05-08T03:01:54.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.101+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1b0b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:54.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.101+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1b0b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34998/0 (socket says 172.21.15.46:34998) 2024-05-08T03:01:54.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.101+0000 7f708b7fe640 1 -- 172.21.15.46:0/776549566 learned_addr learned my addr 172.21.15.46:0/776549566 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:01:54.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.102+0000 7f708b7fe640 1 -- 172.21.15.46:0/776549566 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a06e30 con 0x1ba2660 2024-05-08T03:01:54.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.102+0000 7f708b7fe640 1 --2- 172.21.15.46:0/776549566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1b0b400 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:54.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.102+0000 7f7088ff9640 1 -- 172.21.15.46:0/776549566 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f707c001b70 con 0x1ba2660 2024-05-08T03:01:54.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.102+0000 7f7088ff9640 1 -- 172.21.15.46:0/776549566 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f707c001cd0 con 0x1ba2660 2024-05-08T03:01:54.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.102+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1a06890 con 0x1ba2660 2024-05-08T03:01:54.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.102+0000 7f7088ff9640 1 -- 172.21.15.46:0/776549566 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f707c001f70 con 0x1ba2660 2024-05-08T03:01:54.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.102+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1b91e90 con 0x1ba2660 2024-05-08T03:01:54.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.103+0000 7f7088ff9640 1 -- 172.21.15.46:0/776549566 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f707c014410 con 0x1ba2660 2024-05-08T03:01:54.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.103+0000 7f7088ff9640 1 --2- 172.21.15.46:0/776549566 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f7078037210 0x7f7078039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:54.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.103+0000 7f7088ff9640 1 -- 172.21.15.46:0/776549566 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(688..688 src has 611..688) ==== 3791+0+0 (crc 0 0 0) 0x7f707c048820 con 0x1ba2660 2024-05-08T03:01:54.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.103+0000 7f7098034ec0 1 --2- 172.21.15.46:0/776549566 >> v2:172.21.15.46:6801/3562168766 conn(0x1ba3180 0x1b9ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:01:54.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.103+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 --> v2:172.21.15.46:6801/3562168766 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1b925e0 con 0x1ba3180 2024-05-08T03:01:54.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.104+0000 7f708affd640 1 --2- 172.21.15.46:0/776549566 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f7078037210 0x7f7078039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:01:54.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.104+0000 7f709099c640 1 --2- 172.21.15.46:0/776549566 >> v2:172.21.15.46:6801/3562168766 conn(0x1ba3180 0x1b9ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:01:54.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.104+0000 7f708affd640 1 --2- 172.21.15.46:0/776549566 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f7078037210 0x7f7078039720 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:54.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.107+0000 7f709099c640 1 --2- 172.21.15.46:0/776549566 >> v2:172.21.15.46:6801/3562168766 conn(0x1ba3180 0x1b9ff30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:01:54.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f709099c640 1 -- 172.21.15.46:0/776549566 <== osd.0 v2:172.21.15.46:6801/3562168766 1 ==== osd_op_reply(1 obj10 [writefull 0~11982] v688'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f708400c430 con 0x1ba3180 2024-05-08T03:01:54.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 >> v2:172.21.15.46:6801/3562168766 conn(0x1ba3180 msgr2=0x1b9ff30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:54.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 --2- 172.21.15.46:0/776549566 >> v2:172.21.15.46:6801/3562168766 conn(0x1ba3180 0x1b9ff30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f7078037210 msgr2=0x7f7078039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:54.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 --2- 172.21.15.46:0/776549566 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f7078037210 0x7f7078039720 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 msgr2=0x1b0b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:01:54.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 --2- 172.21.15.46:0/776549566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1b0b400 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 shutdown_connections 2024-05-08T03:01:54.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 --2- 172.21.15.46:0/776549566 >> v2:172.21.15.46:6801/3562168766 conn(0x1ba3180 0x1b9ff30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 --2- 172.21.15.46:0/776549566 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f7078037210 0x7f7078039720 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 --2- 172.21.15.46:0/776549566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1ba2660 0x1b0b400 unknown :-1 s=CLOSED pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:01:54.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 >> 172.21.15.46:0/776549566 conn(0x1a2c960 msgr2=0x1b126c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:01:54.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 shutdown_connections 2024-05-08T03:01:54.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:01:54.118+0000 7f7098034ec0 1 -- 172.21.15.46:0/776549566 wait complete. 2024-05-08T03:01:54.125 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-05-08T03:02:24.127 INFO:tasks.workunit.client.0.smithi046.stderr:+ pid=97101 2024-05-08T03:02:24.127 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota 008ce654-4211-4a2d-8916-631643828e06 max_objects 100 2024-05-08T03:02:24.128 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put onemore /etc/passwd 2024-05-08T03:02:24.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.167+0000 7f37082d0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:24.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.174+0000 7f37082d0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:24.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.174+0000 7f37082d0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:24.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.175+0000 7f37082d0ec0 1 Processor -- start 2024-05-08T03:02:24.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.175+0000 7f37082d0ec0 1 -- start start 2024-05-08T03:02:24.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.176+0000 7f37082d0ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xbc8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:24.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.176+0000 7f37082d0ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xa9c950 con 0xbc9660 2024-05-08T03:02:24.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.176+0000 7f36fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xbc8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:24.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.176+0000 7f36fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xbc8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33936/0 (socket says 172.21.15.46:33936) 2024-05-08T03:02:24.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.176+0000 7f36fb7fe640 1 -- 172.21.15.46:0/4066928730 learned_addr learned my addr 172.21.15.46:0/4066928730 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:02:24.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.177+0000 7f36fb7fe640 1 -- 172.21.15.46:0/4066928730 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa3b1e0 con 0xbc9660 2024-05-08T03:02:24.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.177+0000 7f36fb7fe640 1 --2- 172.21.15.46:0/4066928730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xbc8650 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0151b0772f20c99 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:24.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.177+0000 7f36f9ffb640 1 -- 172.21.15.46:0/4066928730 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f36ec00a040 con 0xbc9660 2024-05-08T03:02:24.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.177+0000 7f36f9ffb640 1 -- 172.21.15.46:0/4066928730 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f36ec00a1a0 con 0xbc9660 2024-05-08T03:02:24.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.177+0000 7f36f9ffb640 1 -- 172.21.15.46:0/4066928730 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f36ec006820 con 0xbc9660 2024-05-08T03:02:24.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.178+0000 7f37082d0ec0 1 -- 172.21.15.46:0/4066928730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 msgr2=0xbc8650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:24.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.178+0000 7f37082d0ec0 1 --2- 172.21.15.46:0/4066928730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xbc8650 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:24.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.178+0000 7f37082d0ec0 1 -- 172.21.15.46:0/4066928730 shutdown_connections 2024-05-08T03:02:24.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.178+0000 7f37082d0ec0 1 --2- 172.21.15.46:0/4066928730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xbc8650 unknown :-1 s=CLOSED pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:24.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.178+0000 7f37082d0ec0 1 -- 172.21.15.46:0/4066928730 >> 172.21.15.46:0/4066928730 conn(0xa53960 msgr2=0xbced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:02:24.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.178+0000 7f37082d0ec0 1 -- 172.21.15.46:0/4066928730 shutdown_connections 2024-05-08T03:02:24.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.178+0000 7f37082d0ec0 1 -- 172.21.15.46:0/4066928730 wait complete. 2024-05-08T03:02:24.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.180+0000 7f37082d0ec0 1 Processor -- start 2024-05-08T03:02:24.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.180+0000 7f37082d0ec0 1 -- start start 2024-05-08T03:02:24.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.181+0000 7f37082d0ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xc58ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:24.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.181+0000 7f37082d0ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xa9a3d0 con 0xbc9660 2024-05-08T03:02:24.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.182+0000 7f36fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xc58ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:24.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.182+0000 7f36fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xc58ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33942/0 (socket says 172.21.15.46:33942) 2024-05-08T03:02:24.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.182+0000 7f36fb7fe640 1 -- 172.21.15.46:0/186079549 learned_addr learned my addr 172.21.15.46:0/186079549 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:02:24.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.182+0000 7f36fb7fe640 1 -- 172.21.15.46:0/186079549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa2de30 con 0xbc9660 2024-05-08T03:02:24.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.182+0000 7f36fb7fe640 1 --2- 172.21.15.46:0/186079549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xc58ad0 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:24.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.182+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f36ec035580 con 0xbc9660 2024-05-08T03:02:24.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.182+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f36ec0356e0 con 0xbc9660 2024-05-08T03:02:24.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.182+0000 7f37082d0ec0 1 -- 172.21.15.46:0/186079549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xa2d890 con 0xbc9660 2024-05-08T03:02:24.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.183+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f36ec035980 con 0xbc9660 2024-05-08T03:02:24.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.183+0000 7f37082d0ec0 1 -- 172.21.15.46:0/186079549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xc59ee0 con 0xbc9660 2024-05-08T03:02:24.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.184+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0xb367b0 con 0xbc9660 2024-05-08T03:02:24.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.184+0000 7f36f8ff9640 1 --2- 172.21.15.46:0/186079549 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f36e8037210 0x7f36e8039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:24.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.184+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(690..690 src has 611..690) ==== 3791+0+0 (crc 0 0 0) 0x7f36ec02e040 con 0xbc9660 2024-05-08T03:02:24.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.184+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=691}) -- 0x7f36e803d420 con 0xbc9660 2024-05-08T03:02:24.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.185+0000 7f37082d0ec0 1 --2- 172.21.15.46:0/186079549 >> v2:172.21.15.46:6801/3562168766 conn(0xbc9fb0 0xc59520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:24.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.185+0000 7f36faffd640 1 --2- 172.21.15.46:0/186079549 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f36e8037210 0x7f36e8039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:24.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.185+0000 7f36faffd640 1 --2- 172.21.15.46:0/186079549 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f36e8037210 0x7f36e8039720 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:24.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.186+0000 7f3700f9c640 1 --2- 172.21.15.46:0/186079549 >> v2:172.21.15.46:6801/3562168766 conn(0xbc9fb0 0xc59520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:02:24.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.191+0000 7f3700f9c640 1 --2- 172.21.15.46:0/186079549 >> v2:172.21.15.46:6801/3562168766 conn(0xbc9fb0 0xc59520 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:24.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.227+0000 7f9399d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:24.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.236+0000 7f9399d9d640 1 Processor -- start 2024-05-08T03:02:24.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.236+0000 7f9399d9d640 1 -- start start 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.238+0000 7f9399d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93940a2dc0 0x7f939413a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.238+0000 7f9399d9d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f939409f110 con 0x7f939406dff0 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.238+0000 7f9399d9d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f939409dfd0 con 0x7f93940a2dc0 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.238+0000 7f93937fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f939406dff0 0x7f93940a26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59868/0 (socket says 172.21.15.46:59868) 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.238+0000 7f93937fe640 1 -- 172.21.15.46:0/1996529656 learned_addr learned my addr 172.21.15.46:0/1996529656 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.238+0000 7f9392ffd640 1 --2- 172.21.15.46:0/1996529656 >> v2:172.21.15.46:3300/0 conn(0x7f93940a2dc0 0x7f939413a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.238+0000 7f93927fc640 1 -- 172.21.15.46:0/1996529656 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96755609 0 0) 0x7f939409f110 con 0x7f939406dff0 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.238+0000 7f93927fc640 1 -- 172.21.15.46:0/1996529656 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f937c003580 con 0x7f939406dff0 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.239+0000 7f9392ffd640 1 -- 172.21.15.46:0/1996529656 >> v1:172.21.15.46:6789/0 conn(0x7f939406dff0 legacy=0x7f93940a26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.239+0000 7f9392ffd640 1 -- 172.21.15.46:0/1996529656 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93940a0280 con 0x7f93940a2dc0 2024-05-08T03:02:24.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.239+0000 7f9392ffd640 1 --2- 172.21.15.46:0/1996529656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93940a2dc0 0x7f939413a4a0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e13aa7a81ecb9e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:24.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.239+0000 7f93927fc640 1 -- 172.21.15.46:0/1996529656 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9388009d90 con 0x7f93940a2dc0 2024-05-08T03:02:24.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.239+0000 7f93927fc640 1 -- 172.21.15.46:0/1996529656 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f938800e230 con 0x7f93940a2dc0 2024-05-08T03:02:24.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.239+0000 7f93927fc640 1 -- 172.21.15.46:0/1996529656 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f938800e4d0 con 0x7f93940a2dc0 2024-05-08T03:02:24.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.240+0000 7f9399d9d640 1 -- 172.21.15.46:0/1996529656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93940a2dc0 msgr2=0x7f939413a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:24.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.240+0000 7f9399d9d640 1 --2- 172.21.15.46:0/1996529656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93940a2dc0 0x7f939413a4a0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:24.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.240+0000 7f9399d9d640 1 -- 172.21.15.46:0/1996529656 shutdown_connections 2024-05-08T03:02:24.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.240+0000 7f9399d9d640 1 --2- 172.21.15.46:0/1996529656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93940a2dc0 0x7f939413a4a0 unknown :-1 s=CLOSED pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:24.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.240+0000 7f9399d9d640 1 -- 172.21.15.46:0/1996529656 >> 172.21.15.46:0/1996529656 conn(0x7f939406d4d0 msgr2=0x7f939406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:02:24.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.240+0000 7f9399d9d640 1 -- 172.21.15.46:0/1996529656 shutdown_connections 2024-05-08T03:02:24.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.240+0000 7f9399d9d640 1 -- 172.21.15.46:0/1996529656 wait complete. 2024-05-08T03:02:24.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.240+0000 7f9399d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:24.246 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.242+0000 7f9399d9d640 1 Processor -- start 2024-05-08T03:02:24.246 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.242+0000 7f9399d9d640 1 -- start start 2024-05-08T03:02:24.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.243+0000 7f9399d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939406dff0 0x7f93941c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:24.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.243+0000 7f9399d9d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f93941ab0f0 con 0x7f939406dff0 2024-05-08T03:02:24.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f93937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939406dff0 0x7f93941c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:24.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f93937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939406dff0 0x7f93941c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33974/0 (socket says 172.21.15.46:33974) 2024-05-08T03:02:24.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f93937fe640 1 -- 172.21.15.46:0/1375005515 learned_addr learned my addr 172.21.15.46:0/1375005515 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:02:24.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f93937fe640 1 -- 172.21.15.46:0/1375005515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93941ad550 con 0x7f939406dff0 2024-05-08T03:02:24.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f93937fe640 1 --2- 172.21.15.46:0/1375005515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939406dff0 0x7f93941c6120 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:24.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9384005a60 con 0x7f939406dff0 2024-05-08T03:02:24.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9384005bc0 con 0x7f939406dff0 2024-05-08T03:02:24.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9384005e60 con 0x7f939406dff0 2024-05-08T03:02:24.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93941c5e10 con 0x7f939406dff0 2024-05-08T03:02:24.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.244+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93941acac0 con 0x7f939406dff0 2024-05-08T03:02:24.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.245+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9394069870 con 0x7f939406dff0 2024-05-08T03:02:24.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.245+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f93840070b0 con 0x7f939406dff0 2024-05-08T03:02:24.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.246+0000 7f937bfff640 1 --2- 172.21.15.46:0/1375005515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9380038920 0x7f938003ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:24.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.246+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(690..690 src has 611..690) ==== 3791+0+0 (crc 0 0 0) 0x7f9384048640 con 0x7f939406dff0 2024-05-08T03:02:24.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.246+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=691}) -- 0x7f938003eb90 con 0x7f939406dff0 2024-05-08T03:02:24.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.246+0000 7f9392ffd640 1 --2- 172.21.15.46:0/1375005515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9380038920 0x7f938003ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:24.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.246+0000 7f9392ffd640 1 --2- 172.21.15.46:0/1375005515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9380038920 0x7f938003ae30 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:24.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.251+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f938400d510 con 0x7f939406dff0 2024-05-08T03:02:24.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:24.439+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "100"} v 0) -- 0x7f9394068300 con 0x7f939406dff0 2024-05-08T03:02:25.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:25.318+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 008ce654-4211-4a2d-8916-631643828e06 v691) ==== 225+0+0 (crc 0 0 0) 0x7f938400d150 con 0x7f939406dff0 2024-05-08T03:02:25.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:25.318+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(691..691 src has 611..691) ==== 628+0+0 (crc 0 0 0) 0x7f938400fe20 con 0x7f939406dff0 2024-05-08T03:02:25.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:25.318+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 <== mon.0 v2:172.21.15.46:3300/0 6 ==== osd_map(691..691 src has 611..691) ==== 628+0+0 (crc 0 0 0) 0x7f36ec033950 con 0xbc9660 2024-05-08T03:02:25.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:25.318+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=692}) -- 0x7f938003fa60 con 0x7f939406dff0 2024-05-08T03:02:25.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:25.318+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=692}) -- 0x7f36e803dab0 con 0xbc9660 2024-05-08T03:02:25.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:25.434+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "100"} v 0) -- 0x7f93940a2dc0 con 0x7f939406dff0 2024-05-08T03:02:26.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.319+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 008ce654-4211-4a2d-8916-631643828e06 v692) ==== 225+0+0 (crc 0 0 0) 0x7f938400d330 con 0x7f939406dff0 2024-05-08T03:02:26.323 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 100 for pool 008ce654-4211-4a2d-8916-631643828e06 2024-05-08T03:02:26.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.319+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(692..692 src has 611..692) ==== 628+0+0 (crc 0 0 0) 0x7f938400e970 con 0x7f939406dff0 2024-05-08T03:02:26.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.319+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 <== mon.0 v2:172.21.15.46:3300/0 7 ==== osd_map(692..692 src has 611..692) ==== 628+0+0 (crc 0 0 0) 0x7f36ec033b70 con 0xbc9660 2024-05-08T03:02:26.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.319+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=693}) -- 0x7f36e803dcd0 con 0xbc9660 2024-05-08T03:02:26.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.319+0000 7f937bfff640 1 -- 172.21.15.46:0/1375005515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=693}) -- 0x7f938003fb80 con 0x7f939406dff0 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.321+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9380038920 msgr2=0x7f938003ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.321+0000 7f9399d9d640 1 --2- 172.21.15.46:0/1375005515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9380038920 0x7f938003ae30 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.321+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939406dff0 msgr2=0x7f93941c6120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.321+0000 7f9399d9d640 1 --2- 172.21.15.46:0/1375005515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939406dff0 0x7f93941c6120 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.321+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 shutdown_connections 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.321+0000 7f9399d9d640 1 --2- 172.21.15.46:0/1375005515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9380038920 0x7f938003ae30 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.321+0000 7f9399d9d640 1 --2- 172.21.15.46:0/1375005515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f939406dff0 0x7f93941c6120 unknown :-1 s=CLOSED pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.321+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 >> 172.21.15.46:0/1375005515 conn(0x7f939406d4d0 msgr2=0x7f939409bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.322+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 shutdown_connections 2024-05-08T03:02:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:26.322+0000 7f9399d9d640 1 -- 172.21.15.46:0/1375005515 wait complete. 2024-05-08T03:02:26.337 INFO:tasks.workunit.client.0.smithi046.stderr:+ wait 97101 2024-05-08T03:02:29.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:29.184+0000 7f37021fe640 1 -- 172.21.15.46:0/186079549 --> v2:172.21.15.46:6801/3562168766 -- ping magic: 0 -- 0x7f36d8000b90 con 0xbc9fb0 2024-05-08T03:02:30.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.305+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(693..693 src has 611..693) ==== 628+0+0 (crc 0 0 0) 0x7f36ec009f60 con 0xbc9660 2024-05-08T03:02:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.305+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=694}) -- 0x7f36e803dcd0 con 0xbc9660 2024-05-08T03:02:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.305+0000 7f36f8ff9640 1 -- 172.21.15.46:0/186079549 --> v2:172.21.15.46:6801/3562168766 -- osd_op(unknown.0.0:1 200.5 200:b9ff7440:::onemore:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e693) -- 0x7f36e803df20 con 0xbc9fb0 2024-05-08T03:02:30.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f3700f9c640 1 -- 172.21.15.46:0/186079549 <== osd.0 v2:172.21.15.46:6801/3562168766 1 ==== osd_op_reply(1 onemore [writefull 0~11982] v693'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f36f400a430 con 0xbc9fb0 2024-05-08T03:02:30.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 -- 172.21.15.46:0/186079549 >> v2:172.21.15.46:6801/3562168766 conn(0xbc9fb0 msgr2=0xc59520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:30.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 --2- 172.21.15.46:0/186079549 >> v2:172.21.15.46:6801/3562168766 conn(0xbc9fb0 0xc59520 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 -- 172.21.15.46:0/186079549 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f36e8037210 msgr2=0x7f36e8039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:30.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 --2- 172.21.15.46:0/186079549 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f36e8037210 0x7f36e8039720 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 -- 172.21.15.46:0/186079549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 msgr2=0xc58ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:30.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 --2- 172.21.15.46:0/186079549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xc58ad0 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 -- 172.21.15.46:0/186079549 shutdown_connections 2024-05-08T03:02:30.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 --2- 172.21.15.46:0/186079549 >> v2:172.21.15.46:6801/3562168766 conn(0xbc9fb0 0xc59520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 --2- 172.21.15.46:0/186079549 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f36e8037210 0x7f36e8039720 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 --2- 172.21.15.46:0/186079549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xbc9660 0xc58ad0 unknown :-1 s=CLOSED pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.632+0000 7f37082d0ec0 1 -- 172.21.15.46:0/186079549 >> 172.21.15.46:0/186079549 conn(0xa53960 msgr2=0xbced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:02:30.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.633+0000 7f37082d0ec0 1 -- 172.21.15.46:0/186079549 shutdown_connections 2024-05-08T03:02:30.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.633+0000 7f37082d0ec0 1 -- 172.21.15.46:0/186079549 wait complete. 2024-05-08T03:02:30.640 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -ne 0 ']' 2024-05-08T03:02:30.640 INFO:tasks.workunit.client.0.smithi046.stderr:+ true 2024-05-08T03:02:30.640 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put twomore /etc/passwd 2024-05-08T03:02:30.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.672+0000 7f575ca3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:30.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.678+0000 7f575ca3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:30.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.678+0000 7f575ca3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:30.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.679+0000 7f575ca3aec0 1 Processor -- start 2024-05-08T03:02:30.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.679+0000 7f575ca3aec0 1 -- start start 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.680+0000 7f575ca3aec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x136e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.680+0000 7f575ca3aec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x123f950 con 0x136cab0 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.680+0000 7f5754b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x136e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.680+0000 7f5754b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x136e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33990/0 (socket says 172.21.15.46:33990) 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.680+0000 7f5754b9b640 1 -- 172.21.15.46:0/2729376989 learned_addr learned my addr 172.21.15.46:0/2729376989 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.681+0000 7f5754b9b640 1 -- 172.21.15.46:0/2729376989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x11de1e0 con 0x136cab0 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.681+0000 7f5754b9b640 1 --2- 172.21.15.46:0/2729376989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x136e970 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c11ec36890ff2c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.681+0000 7f574e7fc640 1 -- 172.21.15.46:0/2729376989 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f574000b500 con 0x136cab0 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.681+0000 7f574e7fc640 1 -- 172.21.15.46:0/2729376989 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f574000b660 con 0x136cab0 2024-05-08T03:02:30.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.681+0000 7f574e7fc640 1 -- 172.21.15.46:0/2729376989 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f574000b900 con 0x136cab0 2024-05-08T03:02:30.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.682+0000 7f575ca3aec0 1 -- 172.21.15.46:0/2729376989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 msgr2=0x136e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:30.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.682+0000 7f575ca3aec0 1 --2- 172.21.15.46:0/2729376989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x136e970 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.682+0000 7f575ca3aec0 1 -- 172.21.15.46:0/2729376989 shutdown_connections 2024-05-08T03:02:30.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.682+0000 7f575ca3aec0 1 --2- 172.21.15.46:0/2729376989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x136e970 unknown :-1 s=CLOSED pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.682+0000 7f575ca3aec0 1 -- 172.21.15.46:0/2729376989 >> 172.21.15.46:0/2729376989 conn(0x11f6960 msgr2=0x136a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:02:30.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.682+0000 7f575ca3aec0 1 -- 172.21.15.46:0/2729376989 shutdown_connections 2024-05-08T03:02:30.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.682+0000 7f575ca3aec0 1 -- 172.21.15.46:0/2729376989 wait complete. 2024-05-08T03:02:30.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.683+0000 7f575ca3aec0 1 Processor -- start 2024-05-08T03:02:30.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.683+0000 7f575ca3aec0 1 -- start start 2024-05-08T03:02:30.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.684+0000 7f575ca3aec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x1357290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:30.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.684+0000 7f575ca3aec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x123d3d0 con 0x136cab0 2024-05-08T03:02:30.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.684+0000 7f5754b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x1357290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:30.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.684+0000 7f5754b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x1357290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34000/0 (socket says 172.21.15.46:34000) 2024-05-08T03:02:30.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.684+0000 7f5754b9b640 1 -- 172.21.15.46:0/1784504855 learned_addr learned my addr 172.21.15.46:0/1784504855 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:02:30.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.685+0000 7f5754b9b640 1 -- 172.21.15.46:0/1784504855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x11d0e30 con 0x136cab0 2024-05-08T03:02:30.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.685+0000 7f5754b9b640 1 --2- 172.21.15.46:0/1784504855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x1357290 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:30.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.685+0000 7f574d7fa640 1 -- 172.21.15.46:0/1784504855 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57400111e0 con 0x136cab0 2024-05-08T03:02:30.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.685+0000 7f574d7fa640 1 -- 172.21.15.46:0/1784504855 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57400119d0 con 0x136cab0 2024-05-08T03:02:30.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.685+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x11d0890 con 0x136cab0 2024-05-08T03:02:30.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.685+0000 7f574d7fa640 1 -- 172.21.15.46:0/1784504855 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5740011b40 con 0x136cab0 2024-05-08T03:02:30.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.685+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x135a650 con 0x136cab0 2024-05-08T03:02:30.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.686+0000 7f574d7fa640 1 -- 172.21.15.46:0/1784504855 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f5740011d40 con 0x136cab0 2024-05-08T03:02:30.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.686+0000 7f574d7fa640 1 --2- 172.21.15.46:0/1784504855 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f573c0371c0 0x7f573c0396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:30.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.686+0000 7f574d7fa640 1 -- 172.21.15.46:0/1784504855 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(693..693 src has 611..693) ==== 3791+0+0 (crc 0 0 0) 0x7f5740048cf0 con 0x136cab0 2024-05-08T03:02:30.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.686+0000 7f575ca3aec0 1 --2- 172.21.15.46:0/1784504855 >> v2:172.21.15.46:6806/2291706666 conn(0x136f8f0 0x1805b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:30.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.686+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:1 200.6 200:7019d845:::twomore:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e693) -- 0x135ad80 con 0x136f8f0 2024-05-08T03:02:30.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.687+0000 7f574f7fe640 1 --2- 172.21.15.46:0/1784504855 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f573c0371c0 0x7f573c0396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:30.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.687+0000 7f574f7fe640 1 --2- 172.21.15.46:0/1784504855 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f573c0371c0 0x7f573c0396d0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:30.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.687+0000 7f575539c640 1 --2- 172.21.15.46:0/1784504855 >> v2:172.21.15.46:6806/2291706666 conn(0x136f8f0 0x1805b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:02:30.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.691+0000 7f575539c640 1 --2- 172.21.15.46:0/1784504855 >> v2:172.21.15.46:6806/2291706666 conn(0x136f8f0 0x1805b10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:30.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.701+0000 7f575539c640 1 -- 172.21.15.46:0/1784504855 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(1 twomore [writefull 0~11982] v693'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f574800a430 con 0x136f8f0 2024-05-08T03:02:30.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.701+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 >> v2:172.21.15.46:6806/2291706666 conn(0x136f8f0 msgr2=0x1805b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:30.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.701+0000 7f575ca3aec0 1 --2- 172.21.15.46:0/1784504855 >> v2:172.21.15.46:6806/2291706666 conn(0x136f8f0 0x1805b10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f573c0371c0 msgr2=0x7f573c0396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:30.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 --2- 172.21.15.46:0/1784504855 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f573c0371c0 0x7f573c0396d0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 msgr2=0x1357290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:30.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 --2- 172.21.15.46:0/1784504855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x1357290 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 shutdown_connections 2024-05-08T03:02:30.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 --2- 172.21.15.46:0/1784504855 >> v2:172.21.15.46:6806/2291706666 conn(0x136f8f0 0x1805b10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 --2- 172.21.15.46:0/1784504855 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f573c0371c0 0x7f573c0396d0 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 --2- 172.21.15.46:0/1784504855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x136cab0 0x1357290 unknown :-1 s=CLOSED pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 >> 172.21.15.46:0/1784504855 conn(0x11f6960 msgr2=0x136a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:02:30.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 shutdown_connections 2024-05-08T03:02:30.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.702+0000 7f575ca3aec0 1 -- 172.21.15.46:0/1784504855 wait complete. 2024-05-08T03:02:30.708 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota 008ce654-4211-4a2d-8916-631643828e06 max_bytes 100 2024-05-08T03:02:30.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.793+0000 7f143ad54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:30.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.803+0000 7f143ad54640 1 Processor -- start 2024-05-08T03:02:30.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.803+0000 7f143ad54640 1 -- start start 2024-05-08T03:02:30.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f143ad54640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f143406dff0 0x7f14340a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:30.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f143ad54640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143409f110 con 0x7f14340a2bf0 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f143ad54640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f143409dfd0 con 0x7f143406dff0 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f1438af0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f143406dff0 0x7f14340a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f1433fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f14340a2bf0 0x7f1434139490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59874/0 (socket says 172.21.15.46:59874) 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f1433fff640 1 -- 172.21.15.46:0/1714987842 learned_addr learned my addr 172.21.15.46:0/1714987842 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f1438af0640 1 -- 172.21.15.46:0/1714987842 >> v1:172.21.15.46:6789/0 conn(0x7f14340a2bf0 legacy=0x7f1434139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f1438af0640 1 -- 172.21.15.46:0/1714987842 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14340a0280 con 0x7f143406dff0 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f14337fe640 1 -- 172.21.15.46:0/1714987842 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207178557 0 0) 0x7f143409f110 con 0x7f14340a2bf0 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f1438af0640 1 --2- 172.21.15.46:0/1714987842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 0x7f14340a26b0 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b943166561dd3510 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f14337fe640 1 -- 172.21.15.46:0/1714987842 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1428009d90 con 0x7f143406dff0 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f14337fe640 1 -- 172.21.15.46:0/1714987842 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f142800e230 con 0x7f143406dff0 2024-05-08T03:02:30.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.805+0000 7f14337fe640 1 -- 172.21.15.46:0/1714987842 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f142800e4d0 con 0x7f143406dff0 2024-05-08T03:02:30.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.806+0000 7f143ad54640 1 -- 172.21.15.46:0/1714987842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 msgr2=0x7f14340a26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:30.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.806+0000 7f143ad54640 1 --2- 172.21.15.46:0/1714987842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 0x7f14340a26b0 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.806+0000 7f143ad54640 1 -- 172.21.15.46:0/1714987842 shutdown_connections 2024-05-08T03:02:30.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.806+0000 7f143ad54640 1 --2- 172.21.15.46:0/1714987842 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 0x7f14340a26b0 unknown :-1 s=CLOSED pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:30.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.806+0000 7f143ad54640 1 -- 172.21.15.46:0/1714987842 >> 172.21.15.46:0/1714987842 conn(0x7f143406d4d0 msgr2=0x7f143406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:02:30.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.806+0000 7f143ad54640 1 -- 172.21.15.46:0/1714987842 shutdown_connections 2024-05-08T03:02:30.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.806+0000 7f143ad54640 1 -- 172.21.15.46:0/1714987842 wait complete. 2024-05-08T03:02:30.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.806+0000 7f143ad54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:02:30.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.808+0000 7f143ad54640 1 Processor -- start 2024-05-08T03:02:30.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.808+0000 7f143ad54640 1 -- start start 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.810+0000 7f143ad54640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 0x7f14341acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.810+0000 7f143ad54640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f14341acad0 con 0x7f143406dff0 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.810+0000 7f1438af0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 0x7f14341acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.810+0000 7f1438af0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 0x7f14341acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34016/0 (socket says 172.21.15.46:34016) 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.810+0000 7f1438af0640 1 -- 172.21.15.46:0/818927441 learned_addr learned my addr 172.21.15.46:0/818927441 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.810+0000 7f1438af0640 1 -- 172.21.15.46:0/818927441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14341ac100 con 0x7f143406dff0 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.811+0000 7f1438af0640 1 --2- 172.21.15.46:0/818927441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 0x7f14341acd60 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.811+0000 7f14317fa640 1 -- 172.21.15.46:0/818927441 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1428013610 con 0x7f143406dff0 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.811+0000 7f14317fa640 1 -- 172.21.15.46:0/818927441 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1428013770 con 0x7f143406dff0 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.811+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14341abcc0 con 0x7f143406dff0 2024-05-08T03:02:30.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.811+0000 7f14317fa640 1 -- 172.21.15.46:0/818927441 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1428013a10 con 0x7f143406dff0 2024-05-08T03:02:30.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.811+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14341ac750 con 0x7f143406dff0 2024-05-08T03:02:30.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.812+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f143409fed0 con 0x7f143406dff0 2024-05-08T03:02:30.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.812+0000 7f14317fa640 1 -- 172.21.15.46:0/818927441 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1428013bc0 con 0x7f143406dff0 2024-05-08T03:02:30.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.812+0000 7f14317fa640 1 --2- 172.21.15.46:0/818927441 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1418038980 0x7f141803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:02:30.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.812+0000 7f14317fa640 1 -- 172.21.15.46:0/818927441 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(693..693 src has 611..693) ==== 3791+0+0 (crc 0 0 0) 0x7f1428018040 con 0x7f143406dff0 2024-05-08T03:02:30.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.812+0000 7f1433fff640 1 --2- 172.21.15.46:0/818927441 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1418038980 0x7f141803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:02:30.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.813+0000 7f1433fff640 1 --2- 172.21.15.46:0/818927441 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1418038980 0x7f141803ae90 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:02:30.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:30.817+0000 7f14317fa640 1 -- 172.21.15.46:0/818927441 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f1428018c30 con 0x7f143406dff0 2024-05-08T03:02:31.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:31.004+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "100"} v 0) -- 0x7f14341abee0 con 0x7f143406dff0 2024-05-08T03:02:31.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:31.331+0000 7f14317fa640 1 -- 172.21.15.46:0/818927441 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 008ce654-4211-4a2d-8916-631643828e06 v694) ==== 221+0+0 (crc 0 0 0) 0x7f1428018a50 con 0x7f143406dff0 2024-05-08T03:02:31.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:31.441+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "100"} v 0) -- 0x7f1434069870 con 0x7f143406dff0 2024-05-08T03:02:32.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.334+0000 7f14317fa640 1 -- 172.21.15.46:0/818927441 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 008ce654-4211-4a2d-8916-631643828e06 v695) ==== 221+0+0 (crc 0 0 0) 0x7f1428018c30 con 0x7f143406dff0 2024-05-08T03:02:32.339 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_bytes = 100 for pool 008ce654-4211-4a2d-8916-631643828e06 2024-05-08T03:02:32.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.336+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1418038980 msgr2=0x7f141803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:32.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.336+0000 7f143ad54640 1 --2- 172.21.15.46:0/818927441 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1418038980 0x7f141803ae90 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:32.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.336+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 msgr2=0x7f14341acd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:02:32.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.336+0000 7f143ad54640 1 --2- 172.21.15.46:0/818927441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 0x7f14341acd60 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:32.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.337+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 shutdown_connections 2024-05-08T03:02:32.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.337+0000 7f143ad54640 1 --2- 172.21.15.46:0/818927441 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1418038980 0x7f141803ae90 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:32.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.337+0000 7f143ad54640 1 --2- 172.21.15.46:0/818927441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f143406dff0 0x7f14341acd60 unknown :-1 s=CLOSED pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:02:32.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.337+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 >> 172.21.15.46:0/818927441 conn(0x7f143406d4d0 msgr2=0x7f14340a4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:02:32.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.337+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 shutdown_connections 2024-05-08T03:02:32.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:02:32.337+0000 7f143ad54640 1 -- 172.21.15.46:0/818927441 wait complete. 2024-05-08T03:02:32.353 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-05-08T03:03:02.355 INFO:tasks.workunit.client.0.smithi046.stderr:+ pid=97192 2024-05-08T03:03:02.356 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota 008ce654-4211-4a2d-8916-631643828e06 max_bytes 0 2024-05-08T03:03:02.356 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put two /etc/passwd 2024-05-08T03:03:02.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.398+0000 7fa0f3cfeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:02.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.405+0000 7fa0f3cfeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:02.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.405+0000 7fa0f3cfeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:02.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.407+0000 7fa0f3cfeec0 1 Processor -- start 2024-05-08T03:03:02.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.407+0000 7fa0f3cfeec0 1 -- start start 2024-05-08T03:03:02.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.409+0000 7fa0f3cfeec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xcd49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:02.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.409+0000 7fa0f3cfeec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xc3f950 con 0xcd9050 2024-05-08T03:03:02.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.410+0000 7fa0e77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xcd49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:02.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.410+0000 7fa0e77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xcd49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39142/0 (socket says 172.21.15.46:39142) 2024-05-08T03:03:02.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.410+0000 7fa0e77fe640 1 -- 172.21.15.46:0/2233853503 learned_addr learned my addr 172.21.15.46:0/2233853503 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:02.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.410+0000 7fa0e77fe640 1 -- 172.21.15.46:0/2233853503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xbde1e0 con 0xcd9050 2024-05-08T03:03:02.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.410+0000 7fa0e77fe640 1 --2- 172.21.15.46:0/2233853503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xcd49f0 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a962cf330699b8ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:02.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.410+0000 7fa0e5ffb640 1 -- 172.21.15.46:0/2233853503 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa0d8032040 con 0xcd9050 2024-05-08T03:03:02.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.410+0000 7fa0e5ffb640 1 -- 172.21.15.46:0/2233853503 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa0d800a040 con 0xcd9050 2024-05-08T03:03:02.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.410+0000 7fa0e5ffb640 1 -- 172.21.15.46:0/2233853503 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa0d800a2e0 con 0xcd9050 2024-05-08T03:03:02.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.411+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/2233853503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 msgr2=0xcd49f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:02.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.411+0000 7fa0f3cfeec0 1 --2- 172.21.15.46:0/2233853503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xcd49f0 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:02.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.411+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/2233853503 shutdown_connections 2024-05-08T03:03:02.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.411+0000 7fa0f3cfeec0 1 --2- 172.21.15.46:0/2233853503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xcd49f0 unknown :-1 s=CLOSED pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:02.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.412+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/2233853503 >> 172.21.15.46:0/2233853503 conn(0xbf6960 msgr2=0xdf24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:02.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.412+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/2233853503 shutdown_connections 2024-05-08T03:03:02.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.412+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/2233853503 wait complete. 2024-05-08T03:03:02.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.413+0000 7fa0f3cfeec0 1 Processor -- start 2024-05-08T03:03:02.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.413+0000 7fa0f3cfeec0 1 -- start start 2024-05-08T03:03:02.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.414+0000 7fa0f3cfeec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xd57760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:02.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.414+0000 7fa0f3cfeec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xc3d3d0 con 0xcd9050 2024-05-08T03:03:02.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.415+0000 7fa0e77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xd57760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:02.419 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.415+0000 7fa0e77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xd57760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39156/0 (socket says 172.21.15.46:39156) 2024-05-08T03:03:02.419 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.415+0000 7fa0e77fe640 1 -- 172.21.15.46:0/724102918 learned_addr learned my addr 172.21.15.46:0/724102918 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:02.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.415+0000 7fa0e77fe640 1 -- 172.21.15.46:0/724102918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xbd0e30 con 0xcd9050 2024-05-08T03:03:02.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.415+0000 7fa0e77fe640 1 --2- 172.21.15.46:0/724102918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xd57760 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:02.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.416+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa0d802d650 con 0xcd9050 2024-05-08T03:03:02.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.416+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa0d802d7b0 con 0xcd9050 2024-05-08T03:03:02.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.416+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa0d802da50 con 0xcd9050 2024-05-08T03:03:02.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.416+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/724102918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xbd0890 con 0xcd9050 2024-05-08T03:03:02.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.416+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/724102918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd6ba80 con 0xcd9050 2024-05-08T03:03:02.421 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.417+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa0d802dc00 con 0xcd9050 2024-05-08T03:03:02.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.417+0000 7fa0e4ff9640 1 --2- 172.21.15.46:0/724102918 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa0d4037210 0x7fa0d4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:02.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.418+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(696..696 src has 611..696) ==== 3791+0+0 (crc 0 0 0) 0x7fa0d8032040 con 0xcd9050 2024-05-08T03:03:02.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.418+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7fa0d403d480 con 0xcd9050 2024-05-08T03:03:02.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.418+0000 7fa0f3cfeec0 1 --2- 172.21.15.46:0/724102918 >> v2:172.21.15.46:6806/2291706666 conn(0xcd9e20 0xd6a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:02.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.418+0000 7fa0e6ffd640 1 --2- 172.21.15.46:0/724102918 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa0d4037210 0x7fa0d4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:02.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.418+0000 7fa0e6ffd640 1 --2- 172.21.15.46:0/724102918 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa0d4037210 0x7fa0d4039720 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:02.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.419+0000 7fa0ec99c640 1 --2- 172.21.15.46:0/724102918 >> v2:172.21.15.46:6806/2291706666 conn(0xcd9e20 0xd6a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:02.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.422+0000 7fa0ec99c640 1 --2- 172.21.15.46:0/724102918 >> v2:172.21.15.46:6806/2291706666 conn(0xcd9e20 0xd6a9e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:02.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.454+0000 7fd6cba2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:02.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.464+0000 7fd6cba2d640 1 Processor -- start 2024-05-08T03:03:02.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.464+0000 7fd6cba2d640 1 -- start start 2024-05-08T03:03:02.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.465+0000 7fd6cba2d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6c4131f80 0x7fd6c4132390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:02.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.465+0000 7fd6cba2d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6c409d610 con 0x7fd6c409b720 2024-05-08T03:03:02.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.465+0000 7fd6cba2d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c41328d0 con 0x7fd6c4131f80 2024-05-08T03:03:02.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6c97c9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6c4131f80 0x7fd6c4132390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:02.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6c97c9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6c4131f80 0x7fd6c4132390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39170/0 (socket says 172.21.15.46:39170) 2024-05-08T03:03:02.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6c8fc8640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd6c409b720 0x7fd6c409bb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52818/0 (socket says 172.21.15.46:52818) 2024-05-08T03:03:02.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6c97c9640 1 -- 172.21.15.46:0/1011093898 learned_addr learned my addr 172.21.15.46:0/1011093898 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:02.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6c97c9640 1 -- 172.21.15.46:0/1011093898 >> v1:172.21.15.46:6789/0 conn(0x7fd6c409b720 legacy=0x7fd6c409bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:02.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6c97c9640 1 -- 172.21.15.46:0/1011093898 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c409cf60 con 0x7fd6c4131f80 2024-05-08T03:03:02.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6c97c9640 1 --2- 172.21.15.46:0/1011093898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c4131f80 0x7fd6c4132390 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fda881d08d3d9f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:02.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6bbfff640 1 -- 172.21.15.46:0/1011093898 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6c0009e50 con 0x7fd6c4131f80 2024-05-08T03:03:02.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6bbfff640 1 -- 172.21.15.46:0/1011093898 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd6c000e230 con 0x7fd6c4131f80 2024-05-08T03:03:02.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.466+0000 7fd6bbfff640 1 -- 172.21.15.46:0/1011093898 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6c000e4d0 con 0x7fd6c4131f80 2024-05-08T03:03:02.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.467+0000 7fd6cba2d640 1 -- 172.21.15.46:0/1011093898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c4131f80 msgr2=0x7fd6c4132390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:02.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.467+0000 7fd6cba2d640 1 --2- 172.21.15.46:0/1011093898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c4131f80 0x7fd6c4132390 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:02.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.467+0000 7fd6cba2d640 1 -- 172.21.15.46:0/1011093898 shutdown_connections 2024-05-08T03:03:02.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.467+0000 7fd6cba2d640 1 --2- 172.21.15.46:0/1011093898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c4131f80 0x7fd6c4132390 unknown :-1 s=CLOSED pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:02.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.467+0000 7fd6cba2d640 1 -- 172.21.15.46:0/1011093898 >> 172.21.15.46:0/1011093898 conn(0x7fd6c40a1010 msgr2=0x7fd6c40a1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:02.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.467+0000 7fd6cba2d640 1 -- 172.21.15.46:0/1011093898 shutdown_connections 2024-05-08T03:03:02.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.467+0000 7fd6cba2d640 1 -- 172.21.15.46:0/1011093898 wait complete. 2024-05-08T03:03:02.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.467+0000 7fd6cba2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:02.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.469+0000 7fd6cba2d640 1 Processor -- start 2024-05-08T03:03:02.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.469+0000 7fd6cba2d640 1 -- start start 2024-05-08T03:03:02.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.471+0000 7fd6cba2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c409b720 0x7fd6c41c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:02.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.471+0000 7fd6cba2d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c412bf30 con 0x7fd6c409b720 2024-05-08T03:03:02.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.471+0000 7fd6c97c9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c409b720 0x7fd6c41c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:02.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.471+0000 7fd6c97c9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c409b720 0x7fd6c41c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39174/0 (socket says 172.21.15.46:39174) 2024-05-08T03:03:02.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.471+0000 7fd6c97c9640 1 -- 172.21.15.46:0/2124392949 learned_addr learned my addr 172.21.15.46:0/2124392949 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:02.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.471+0000 7fd6c97c9640 1 -- 172.21.15.46:0/2124392949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c412b530 con 0x7fd6c409b720 2024-05-08T03:03:02.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.471+0000 7fd6c97c9640 1 --2- 172.21.15.46:0/2124392949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c409b720 0x7fd6c41c7e20 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:02.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.471+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6c000eda0 con 0x7fd6c409b720 2024-05-08T03:03:02.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.472+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd6c0015420 con 0x7fd6c409b720 2024-05-08T03:03:02.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.472+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6c00156c0 con 0x7fd6c409b720 2024-05-08T03:03:02.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.472+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c412f070 con 0x7fd6c409b720 2024-05-08T03:03:02.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.472+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c412b970 con 0x7fd6c409b720 2024-05-08T03:03:02.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.473+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fd6c0015870 con 0x7fd6c409b720 2024-05-08T03:03:02.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.473+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c4069870 con 0x7fd6c409b720 2024-05-08T03:03:02.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.473+0000 7fd6b9ffb640 1 --2- 172.21.15.46:0/2124392949 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd6a8038980 0x7fd6a803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:02.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.473+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(696..696 src has 611..696) ==== 3791+0+0 (crc 0 0 0) 0x7fd6c0049c70 con 0x7fd6c409b720 2024-05-08T03:03:02.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.473+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7fd6a803ebf0 con 0x7fd6c409b720 2024-05-08T03:03:02.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.473+0000 7fd6c8fc8640 1 --2- 172.21.15.46:0/2124392949 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd6a8038980 0x7fd6a803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:02.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.474+0000 7fd6c8fc8640 1 --2- 172.21.15.46:0/2124392949 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd6a8038980 0x7fd6a803ae90 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:02.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.478+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fd6c0010c00 con 0x7fd6c409b720 2024-05-08T03:03:02.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:02.668+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "0"} v 0) -- 0x7fd6c4131b30 con 0x7fd6c409b720 2024-05-08T03:03:03.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:03.365+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 v697) ==== 217+0+0 (crc 0 0 0) 0x7fd6c0010820 con 0x7fd6c409b720 2024-05-08T03:03:03.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:03.366+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 <== mon.0 v2:172.21.15.46:3300/0 6 ==== osd_map(697..697 src has 611..697) ==== 628+0+0 (crc 0 0 0) 0x7fa0d8035290 con 0xcd9050 2024-05-08T03:03:03.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:03.366+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(697..697 src has 611..697) ==== 628+0+0 (crc 0 0 0) 0x7fd6c0010e30 con 0x7fd6c409b720 2024-05-08T03:03:03.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:03.366+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7fd6a803fb30 con 0x7fd6c409b720 2024-05-08T03:03:03.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:03.366+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7fa0d403db10 con 0xcd9050 2024-05-08T03:03:03.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:03.483+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "0"} v 0) -- 0x7fd6c40008d0 con 0x7fd6c409b720 2024-05-08T03:03:04.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.366+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 v698) ==== 217+0+0 (crc 0 0 0) 0x7fd6c0010a00 con 0x7fd6c409b720 2024-05-08T03:03:04.371 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_bytes = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 2024-05-08T03:03:04.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.367+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(698..698 src has 611..698) ==== 628+0+0 (crc 0 0 0) 0x7fd6c0007d80 con 0x7fd6c409b720 2024-05-08T03:03:04.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.367+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 <== mon.0 v2:172.21.15.46:3300/0 7 ==== osd_map(698..698 src has 611..698) ==== 628+0+0 (crc 0 0 0) 0x7fa0d806abd0 con 0xcd9050 2024-05-08T03:03:04.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.367+0000 7fd6b9ffb640 1 -- 172.21.15.46:0/2124392949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7fd6a803fc50 con 0x7fd6c409b720 2024-05-08T03:03:04.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.367+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7fa0d403dd30 con 0xcd9050 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.370+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd6a8038980 msgr2=0x7fd6a803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.370+0000 7fd6cba2d640 1 --2- 172.21.15.46:0/2124392949 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd6a8038980 0x7fd6a803ae90 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.370+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c409b720 msgr2=0x7fd6c41c7e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.370+0000 7fd6cba2d640 1 --2- 172.21.15.46:0/2124392949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c409b720 0x7fd6c41c7e20 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.370+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 shutdown_connections 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.370+0000 7fd6cba2d640 1 --2- 172.21.15.46:0/2124392949 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd6a8038980 0x7fd6a803ae90 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.370+0000 7fd6cba2d640 1 --2- 172.21.15.46:0/2124392949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6c409b720 0x7fd6c41c7e20 unknown :-1 s=CLOSED pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.370+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 >> 172.21.15.46:0/2124392949 conn(0x7fd6c40a1010 msgr2=0x7fd6c41baa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.371+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 shutdown_connections 2024-05-08T03:03:04.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.371+0000 7fd6cba2d640 1 -- 172.21.15.46:0/2124392949 wait complete. 2024-05-08T03:03:04.389 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota 008ce654-4211-4a2d-8916-631643828e06 max_objects 0 2024-05-08T03:03:04.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.487+0000 7fdd48a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:04.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.497+0000 7fdd48a2d640 1 Processor -- start 2024-05-08T03:03:04.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.497+0000 7fdd48a2d640 1 -- start start 2024-05-08T03:03:04.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd48a2d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd44137de0 0x7fdd4413a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:04.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd48a2d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd44134c30 con 0x7fdd44135060 2024-05-08T03:03:04.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd48a2d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4409be70 con 0x7fdd44137de0 2024-05-08T03:03:04.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd39d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd44137de0 0x7fdd4413a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:04.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd4259c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdd44135060 0x7fdd44135470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52222/0 (socket says 172.21.15.46:52222) 2024-05-08T03:03:04.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd39d9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd44137de0 0x7fdd4413a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52498/0 (socket says 172.21.15.46:52498) 2024-05-08T03:03:04.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd4259c640 1 -- 172.21.15.46:0/3545769631 learned_addr learned my addr 172.21.15.46:0/3545769631 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:03:04.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd39d9b640 1 -- 172.21.15.46:0/3545769631 >> v1:172.21.15.46:6789/0 conn(0x7fdd44135060 legacy=0x7fdd44135470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:04.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd39d9b640 1 -- 172.21.15.46:0/3545769631 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4409c840 con 0x7fdd44137de0 2024-05-08T03:03:04.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd41d9b640 1 -- 172.21.15.46:0/3545769631 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426657137 0 0) 0x7fdd44134c30 con 0x7fdd44135060 2024-05-08T03:03:04.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.499+0000 7fdd39d9b640 1 --2- 172.21.15.46:0/3545769631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44137de0 0x7fdd4413a200 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0e8fd87bd1ba76 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:04.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.500+0000 7fdd41d9b640 1 -- 172.21.15.46:0/3545769631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd2c009d90 con 0x7fdd44137de0 2024-05-08T03:03:04.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.500+0000 7fdd41d9b640 1 -- 172.21.15.46:0/3545769631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdd2c00e230 con 0x7fdd44137de0 2024-05-08T03:03:04.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.500+0000 7fdd41d9b640 1 -- 172.21.15.46:0/3545769631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd2c00e4d0 con 0x7fdd44137de0 2024-05-08T03:03:04.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.501+0000 7fdd48a2d640 1 -- 172.21.15.46:0/3545769631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44137de0 msgr2=0x7fdd4413a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:04.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.501+0000 7fdd48a2d640 1 --2- 172.21.15.46:0/3545769631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44137de0 0x7fdd4413a200 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:04.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.501+0000 7fdd48a2d640 1 -- 172.21.15.46:0/3545769631 shutdown_connections 2024-05-08T03:03:04.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.501+0000 7fdd48a2d640 1 --2- 172.21.15.46:0/3545769631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44137de0 0x7fdd4413a200 unknown :-1 s=CLOSED pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:04.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.501+0000 7fdd48a2d640 1 -- 172.21.15.46:0/3545769631 >> 172.21.15.46:0/3545769631 conn(0x7fdd4406d420 msgr2=0x7fdd4406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:04.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.501+0000 7fdd48a2d640 1 -- 172.21.15.46:0/3545769631 shutdown_connections 2024-05-08T03:03:04.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.501+0000 7fdd48a2d640 1 -- 172.21.15.46:0/3545769631 wait complete. 2024-05-08T03:03:04.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.501+0000 7fdd48a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:04.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.504+0000 7fdd48a2d640 1 Processor -- start 2024-05-08T03:03:04.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.504+0000 7fdd48a2d640 1 -- start start 2024-05-08T03:03:04.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.505+0000 7fdd48a2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44135060 0x7fdd4411d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:04.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.505+0000 7fdd48a2d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4411e340 con 0x7fdd44135060 2024-05-08T03:03:04.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.505+0000 7fdd4259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44135060 0x7fdd4411d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:04.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.505+0000 7fdd4259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44135060 0x7fdd4411d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52514/0 (socket says 172.21.15.46:52514) 2024-05-08T03:03:04.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.505+0000 7fdd4259c640 1 -- 172.21.15.46:0/942096325 learned_addr learned my addr 172.21.15.46:0/942096325 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:04.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.506+0000 7fdd4259c640 1 -- 172.21.15.46:0/942096325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4411e620 con 0x7fdd44135060 2024-05-08T03:03:04.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.506+0000 7fdd4259c640 1 --2- 172.21.15.46:0/942096325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44135060 0x7fdd4411d1f0 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:04.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.506+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd34004cf0 con 0x7fdd44135060 2024-05-08T03:03:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.506+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdd34004e50 con 0x7fdd44135060 2024-05-08T03:03:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.506+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd34007250 con 0x7fdd44135060 2024-05-08T03:03:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.506+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd440a03f0 con 0x7fdd44135060 2024-05-08T03:03:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.506+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4409f870 con 0x7fdd44135060 2024-05-08T03:03:04.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.508+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4411fe00 con 0x7fdd44135060 2024-05-08T03:03:04.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.508+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fdd34007400 con 0x7fdd44135060 2024-05-08T03:03:04.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.508+0000 7fdd3b7fe640 1 --2- 172.21.15.46:0/942096325 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdd24038980 0x7fdd2403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:04.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.508+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(698..698 src has 611..698) ==== 3791+0+0 (crc 0 0 0) 0x7fdd34048eb0 con 0x7fdd44135060 2024-05-08T03:03:04.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.508+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7fdd2403eb90 con 0x7fdd44135060 2024-05-08T03:03:04.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.508+0000 7fdd39d9b640 1 --2- 172.21.15.46:0/942096325 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdd24038980 0x7fdd2403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:04.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.509+0000 7fdd39d9b640 1 --2- 172.21.15.46:0/942096325 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdd24038980 0x7fdd2403ae90 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:04.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.518+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fdd340062e0 con 0x7fdd44135060 2024-05-08T03:03:04.731 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:04.727+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "0"} v 0) -- 0x7fdd44069870 con 0x7fdd44135060 2024-05-08T03:03:05.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.312+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 v699) ==== 221+0+0 (crc 0 0 0) 0x7fdd3400ad00 con 0x7fdd44135060 2024-05-08T03:03:05.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.313+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(699..699 src has 611..699) ==== 628+0+0 (crc 0 0 0) 0x7fdd34006dc0 con 0x7fdd44135060 2024-05-08T03:03:05.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.313+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(699..699 src has 611..699) ==== 628+0+0 (crc 0 0 0) 0x7fa0d8037da0 con 0xcd9050 2024-05-08T03:03:05.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.313+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7fdd2403fb80 con 0x7fdd44135060 2024-05-08T03:03:05.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.313+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7fa0d403dd30 con 0xcd9050 2024-05-08T03:03:05.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.313+0000 7fa0e4ff9640 1 -- 172.21.15.46:0/724102918 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:1 200.6 200:6b5d76a5:::two:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e699) -- 0x7fa0d403dfb0 con 0xcd9e20 2024-05-08T03:03:05.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.440+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "0"} v 0) -- 0x7fdd440a5160 con 0x7fdd44135060 2024-05-08T03:03:05.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0ec99c640 1 -- 172.21.15.46:0/724102918 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(1 two [writefull 0~11982] v699'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fa0e000a430 con 0xcd9e20 2024-05-08T03:03:05.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/724102918 >> v2:172.21.15.46:6806/2291706666 conn(0xcd9e20 msgr2=0xd6a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:05.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 --2- 172.21.15.46:0/724102918 >> v2:172.21.15.46:6806/2291706666 conn(0xcd9e20 0xd6a9e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:05.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/724102918 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa0d4037210 msgr2=0x7fa0d4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:05.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 --2- 172.21.15.46:0/724102918 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa0d4037210 0x7fa0d4039720 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:05.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/724102918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 msgr2=0xd57760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:05.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 --2- 172.21.15.46:0/724102918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xd57760 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:05.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/724102918 shutdown_connections 2024-05-08T03:03:05.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 --2- 172.21.15.46:0/724102918 >> v2:172.21.15.46:6806/2291706666 conn(0xcd9e20 0xd6a9e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:05.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 --2- 172.21.15.46:0/724102918 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa0d4037210 0x7fa0d4039720 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:05.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 --2- 172.21.15.46:0/724102918 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xcd9050 0xd57760 unknown :-1 s=CLOSED pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:05.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.544+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/724102918 >> 172.21.15.46:0/724102918 conn(0xbf6960 msgr2=0xdf24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:05.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.545+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/724102918 shutdown_connections 2024-05-08T03:03:05.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:05.545+0000 7fa0f3cfeec0 1 -- 172.21.15.46:0/724102918 wait complete. 2024-05-08T03:03:06.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.380+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 v700) ==== 221+0+0 (crc 0 0 0) 0x7fdd340060b0 con 0x7fdd44135060 2024-05-08T03:03:06.384 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 2024-05-08T03:03:06.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.380+0000 7fdd3b7fe640 1 -- 172.21.15.46:0/942096325 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(700..700 src has 611..700) ==== 628+0+0 (crc 0 0 0) 0x7fdd3400a7f0 con 0x7fdd44135060 2024-05-08T03:03:06.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdd24038980 msgr2=0x7fdd2403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:06.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 --2- 172.21.15.46:0/942096325 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdd24038980 0x7fdd2403ae90 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44135060 msgr2=0x7fdd4411d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:06.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 --2- 172.21.15.46:0/942096325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44135060 0x7fdd4411d1f0 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 shutdown_connections 2024-05-08T03:03:06.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 --2- 172.21.15.46:0/942096325 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fdd24038980 0x7fdd2403ae90 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 --2- 172.21.15.46:0/942096325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd44135060 0x7fdd4411d1f0 unknown :-1 s=CLOSED pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 >> 172.21.15.46:0/942096325 conn(0x7fdd4406d420 msgr2=0x7fdd440a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:06.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 shutdown_connections 2024-05-08T03:03:06.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.383+0000 7fdd48a2d640 1 -- 172.21.15.46:0/942096325 wait complete. 2024-05-08T03:03:06.403 INFO:tasks.workunit.client.0.smithi046.stderr:+ wait 97192 2024-05-08T03:03:06.403 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' 0 -ne 0 ']' 2024-05-08T03:03:06.404 INFO:tasks.workunit.client.0.smithi046.stderr:+ true 2024-05-08T03:03:06.404 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put three /etc/passwd 2024-05-08T03:03:06.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.440+0000 7fb9e8534ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:06.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.447+0000 7fb9e8534ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:06.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.447+0000 7fb9e8534ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:06.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.448+0000 7fb9e8534ec0 1 Processor -- start 2024-05-08T03:03:06.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.448+0000 7fb9e8534ec0 1 -- start start 2024-05-08T03:03:06.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.450+0000 7fb9e8534ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x161b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:06.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.450+0000 7fb9e8534ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1589950 con 0x1624390 2024-05-08T03:03:06.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.450+0000 7fb9e099b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x161b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:06.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.450+0000 7fb9e099b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x161b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52522/0 (socket says 172.21.15.46:52522) 2024-05-08T03:03:06.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.450+0000 7fb9e099b640 1 -- 172.21.15.46:0/1903457448 learned_addr learned my addr 172.21.15.46:0/1903457448 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:06.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.451+0000 7fb9e099b640 1 -- 172.21.15.46:0/1903457448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x15281e0 con 0x1624390 2024-05-08T03:03:06.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.451+0000 7fb9e099b640 1 --2- 172.21.15.46:0/1903457448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x161b120 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5215184c85c1af7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:06.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.451+0000 7fb9da7fc640 1 -- 172.21.15.46:0/1903457448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9cc032040 con 0x1624390 2024-05-08T03:03:06.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.451+0000 7fb9da7fc640 1 -- 172.21.15.46:0/1903457448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb9cc00a040 con 0x1624390 2024-05-08T03:03:06.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.451+0000 7fb9da7fc640 1 -- 172.21.15.46:0/1903457448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9cc00a2e0 con 0x1624390 2024-05-08T03:03:06.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.452+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/1903457448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 msgr2=0x161b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:06.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.452+0000 7fb9e8534ec0 1 --2- 172.21.15.46:0/1903457448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x161b120 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.452+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/1903457448 shutdown_connections 2024-05-08T03:03:06.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.452+0000 7fb9e8534ec0 1 --2- 172.21.15.46:0/1903457448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x161b120 unknown :-1 s=CLOSED pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.452+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/1903457448 >> 172.21.15.46:0/1903457448 conn(0x1540960 msgr2=0x16b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:06.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.452+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/1903457448 shutdown_connections 2024-05-08T03:03:06.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.452+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/1903457448 wait complete. 2024-05-08T03:03:06.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.453+0000 7fb9e8534ec0 1 Processor -- start 2024-05-08T03:03:06.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.453+0000 7fb9e8534ec0 1 -- start start 2024-05-08T03:03:06.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.455+0000 7fb9e8534ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x169fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:06.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.455+0000 7fb9e8534ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x15873d0 con 0x1624390 2024-05-08T03:03:06.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.455+0000 7fb9e099b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x169fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:06.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.455+0000 7fb9e099b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x169fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52524/0 (socket says 172.21.15.46:52524) 2024-05-08T03:03:06.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.455+0000 7fb9e099b640 1 -- 172.21.15.46:0/2128883124 learned_addr learned my addr 172.21.15.46:0/2128883124 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:06.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.456+0000 7fb9e099b640 1 -- 172.21.15.46:0/2128883124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x151ae30 con 0x1624390 2024-05-08T03:03:06.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.456+0000 7fb9e099b640 1 --2- 172.21.15.46:0/2128883124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x169fd70 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:06.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.456+0000 7fb9d97fa640 1 -- 172.21.15.46:0/2128883124 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9cc02d650 con 0x1624390 2024-05-08T03:03:06.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.456+0000 7fb9d97fa640 1 -- 172.21.15.46:0/2128883124 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb9cc02d7b0 con 0x1624390 2024-05-08T03:03:06.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.456+0000 7fb9d97fa640 1 -- 172.21.15.46:0/2128883124 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9cc02da50 con 0x1624390 2024-05-08T03:03:06.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.456+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x151a890 con 0x1624390 2024-05-08T03:03:06.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.456+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x16a3ca0 con 0x1624390 2024-05-08T03:03:06.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.457+0000 7fb9d97fa640 1 -- 172.21.15.46:0/2128883124 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb9cc02dc40 con 0x1624390 2024-05-08T03:03:06.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.458+0000 7fb9d97fa640 1 --2- 172.21.15.46:0/2128883124 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb9c8037210 0x7fb9c8039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:06.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.458+0000 7fb9d97fa640 1 -- 172.21.15.46:0/2128883124 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(700..700 src has 611..700) ==== 3791+0+0 (crc 0 0 0) 0x7fb9cc032040 con 0x1624390 2024-05-08T03:03:06.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.458+0000 7fb9e8534ec0 1 --2- 172.21.15.46:0/2128883124 >> v2:172.21.15.80:6807/3216858417 conn(0x16b7010 0x16a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:06.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.458+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 --> v2:172.21.15.80:6807/3216858417 -- osd_op(unknown.0.0:1 200.3 200:c57798d7:::three:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0x174b5a0 con 0x16b7010 2024-05-08T03:03:06.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.458+0000 7fb9db7fe640 1 --2- 172.21.15.46:0/2128883124 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb9c8037210 0x7fb9c8039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:06.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.459+0000 7fb9db7fe640 1 --2- 172.21.15.46:0/2128883124 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb9c8037210 0x7fb9c8039720 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:06.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.459+0000 7fb9e119c640 1 --2- 172.21.15.46:0/2128883124 >> v2:172.21.15.80:6807/3216858417 conn(0x16b7010 0x16a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:06.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.463+0000 7fb9e119c640 1 --2- 172.21.15.46:0/2128883124 >> v2:172.21.15.80:6807/3216858417 conn(0x16b7010 0x16a07c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:06.937 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e119c640 1 -- 172.21.15.46:0/2128883124 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== osd_op_reply(1 three [writefull 0~11982] v700'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb9d400a430 con 0x16b7010 2024-05-08T03:03:06.937 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 >> v2:172.21.15.80:6807/3216858417 conn(0x16b7010 msgr2=0x16a07c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:06.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 --2- 172.21.15.46:0/2128883124 >> v2:172.21.15.80:6807/3216858417 conn(0x16b7010 0x16a07c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb9c8037210 msgr2=0x7fb9c8039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:06.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 --2- 172.21.15.46:0/2128883124 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb9c8037210 0x7fb9c8039720 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 msgr2=0x169fd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:06.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 --2- 172.21.15.46:0/2128883124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x169fd70 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 shutdown_connections 2024-05-08T03:03:06.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 --2- 172.21.15.46:0/2128883124 >> v2:172.21.15.80:6807/3216858417 conn(0x16b7010 0x16a07c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 --2- 172.21.15.46:0/2128883124 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb9c8037210 0x7fb9c8039720 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 --2- 172.21.15.46:0/2128883124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1624390 0x169fd70 unknown :-1 s=CLOSED pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:06.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 >> 172.21.15.46:0/2128883124 conn(0x1540960 msgr2=0x16b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:06.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 shutdown_connections 2024-05-08T03:03:06.940 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:06.932+0000 7fb9e8534ec0 1 -- 172.21.15.46:0/2128883124 wait complete. 2024-05-08T03:03:06.941 INFO:tasks.workunit.client.0.smithi046.stderr:++ uuidgen 2024-05-08T03:03:06.941 INFO:tasks.workunit.client.0.smithi046.stderr:+ pp=048b0735-bafe-474a-b306-d0d41d70737f 2024-05-08T03:03:06.941 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool create 048b0735-bafe-474a-b306-d0d41d70737f 12 2024-05-08T03:03:07.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.026+0000 7f2cff55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:07.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.034+0000 7f2cff55d640 1 Processor -- start 2024-05-08T03:03:07.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.034+0000 7f2cff55d640 1 -- start start 2024-05-08T03:03:07.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.036+0000 7f2cff55d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2cf809e630 0x7f2cf809f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:07.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.036+0000 7f2cff55d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf80a11d0 con 0x7f2cf80a26b0 2024-05-08T03:03:07.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.036+0000 7f2cff55d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f2cf80a01a0 con 0x7f2cf809e630 2024-05-08T03:03:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.036+0000 7f2cfd2f9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2cf809e630 0x7f2cf809f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.036+0000 7f2cfcaf8640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2cf80a26b0 0x7f2cf80a2ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52240/0 (socket says 172.21.15.46:52240) 2024-05-08T03:03:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.036+0000 7f2cfcaf8640 1 -- 172.21.15.46:0/411511994 learned_addr learned my addr 172.21.15.46:0/411511994 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:03:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.036+0000 7f2cfd2f9640 1 -- 172.21.15.46:0/411511994 >> v1:172.21.15.46:6789/0 conn(0x7f2cf80a26b0 legacy=0x7f2cf80a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.036+0000 7f2cfd2f9640 1 -- 172.21.15.46:0/411511994 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf809f310 con 0x7f2cf809e630 2024-05-08T03:03:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.037+0000 7f2cfd2f9640 1 --2- 172.21.15.46:0/411511994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 0x7f2cf809f770 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356d091abd2e2ce8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.037+0000 7f2cf7fff640 1 -- 172.21.15.46:0/411511994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2ce800e040 con 0x7f2cf809e630 2024-05-08T03:03:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.037+0000 7f2cf7fff640 1 -- 172.21.15.46:0/411511994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2ce8007670 con 0x7f2cf809e630 2024-05-08T03:03:07.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.037+0000 7f2cf7fff640 1 -- 172.21.15.46:0/411511994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2ce8007910 con 0x7f2cf809e630 2024-05-08T03:03:07.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.038+0000 7f2cff55d640 1 -- 172.21.15.46:0/411511994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 msgr2=0x7f2cf809f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:07.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.038+0000 7f2cff55d640 1 --2- 172.21.15.46:0/411511994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 0x7f2cf809f770 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:07.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.038+0000 7f2cff55d640 1 -- 172.21.15.46:0/411511994 shutdown_connections 2024-05-08T03:03:07.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.038+0000 7f2cff55d640 1 --2- 172.21.15.46:0/411511994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 0x7f2cf809f770 unknown :-1 s=CLOSED pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:07.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.038+0000 7f2cff55d640 1 -- 172.21.15.46:0/411511994 >> 172.21.15.46:0/411511994 conn(0x7f2cf806d500 msgr2=0x7f2cf806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:07.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.038+0000 7f2cff55d640 1 -- 172.21.15.46:0/411511994 shutdown_connections 2024-05-08T03:03:07.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.038+0000 7f2cff55d640 1 -- 172.21.15.46:0/411511994 wait complete. 2024-05-08T03:03:07.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.038+0000 7f2cff55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:07.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.040+0000 7f2cff55d640 1 Processor -- start 2024-05-08T03:03:07.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.040+0000 7f2cff55d640 1 -- start start 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.041+0000 7f2cff55d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 0x7f2cf81c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.041+0000 7f2cff55d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf81ab320 con 0x7f2cf809e630 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.041+0000 7f2cfd2f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 0x7f2cf81c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.041+0000 7f2cfd2f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 0x7f2cf81c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52548/0 (socket says 172.21.15.46:52548) 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.041+0000 7f2cfd2f9640 1 -- 172.21.15.46:0/2796624872 learned_addr learned my addr 172.21.15.46:0/2796624872 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.042+0000 7f2cfd2f9640 1 -- 172.21.15.46:0/2796624872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf81ad780 con 0x7f2cf809e630 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.042+0000 7f2cfd2f9640 1 --2- 172.21.15.46:0/2796624872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 0x7f2cf81c6350 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.042+0000 7f2cf5ffb640 1 -- 172.21.15.46:0/2796624872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2ce800e040 con 0x7f2cf809e630 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.042+0000 7f2cf5ffb640 1 -- 172.21.15.46:0/2796624872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2ce8012a80 con 0x7f2cf809e630 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.042+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf81c6040 con 0x7f2cf809e630 2024-05-08T03:03:07.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.042+0000 7f2cf5ffb640 1 -- 172.21.15.46:0/2796624872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2ce8012d20 con 0x7f2cf809e630 2024-05-08T03:03:07.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.042+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf81accf0 con 0x7f2cf809e630 2024-05-08T03:03:07.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.043+0000 7f2cf5ffb640 1 -- 172.21.15.46:0/2796624872 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f2ce80153f0 con 0x7f2cf809e630 2024-05-08T03:03:07.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.043+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf8069870 con 0x7f2cf809e630 2024-05-08T03:03:07.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.043+0000 7f2cf5ffb640 1 --2- 172.21.15.46:0/2796624872 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2ce4038980 0x7f2ce403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:07.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.043+0000 7f2cf5ffb640 1 -- 172.21.15.46:0/2796624872 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(700..700 src has 611..700) ==== 3791+0+0 (crc 0 0 0) 0x7f2ce8049ed0 con 0x7f2cf809e630 2024-05-08T03:03:07.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.044+0000 7f2cfcaf8640 1 --2- 172.21.15.46:0/2796624872 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2ce4038980 0x7f2ce403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:07.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.044+0000 7f2cfcaf8640 1 --2- 172.21.15.46:0/2796624872 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2ce4038980 0x7f2ce403ae90 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:07.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.049+0000 7f2cf5ffb640 1 -- 172.21.15.46:0/2796624872 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f2ce800fc80 con 0x7f2cf809e630 2024-05-08T03:03:07.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.236+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "pg_num": 12} v 0) -- 0x7f2cf8068360 con 0x7f2cf809e630 2024-05-08T03:03:07.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.384+0000 7f2cf5ffb640 1 -- 172.21.15.46:0/2796624872 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "pg_num": 12}]=0 pool '048b0735-bafe-474a-b306-d0d41d70737f' created v701) ==== 176+0+0 (crc 0 0 0) 0x7f2ce8010280 con 0x7f2cf809e630 2024-05-08T03:03:07.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.578+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "pg_num": 12} v 0) -- 0x7f2cf80a31d0 con 0x7f2cf809e630 2024-05-08T03:03:07.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.579+0000 7f2cf5ffb640 1 -- 172.21.15.46:0/2796624872 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "pg_num": 12}]=0 pool '048b0735-bafe-474a-b306-d0d41d70737f' already exists v701) ==== 183+0+0 (crc 0 0 0) 0x7f2ce800faa0 con 0x7f2cf809e630 2024-05-08T03:03:07.582 INFO:tasks.workunit.client.0.smithi046.stderr:pool '048b0735-bafe-474a-b306-d0d41d70737f' already exists 2024-05-08T03:03:07.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2ce4038980 msgr2=0x7f2ce403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:07.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 --2- 172.21.15.46:0/2796624872 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2ce4038980 0x7f2ce403ae90 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:07.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 msgr2=0x7f2cf81c6350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:07.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 --2- 172.21.15.46:0/2796624872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 0x7f2cf81c6350 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:07.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 shutdown_connections 2024-05-08T03:03:07.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 --2- 172.21.15.46:0/2796624872 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2ce4038980 0x7f2ce403ae90 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:07.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 --2- 172.21.15.46:0/2796624872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cf809e630 0x7f2cf81c6350 unknown :-1 s=CLOSED pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:07.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 >> 172.21.15.46:0/2796624872 conn(0x7f2cf806d500 msgr2=0x7f2cf80a4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:07.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 shutdown_connections 2024-05-08T03:03:07.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.582+0000 7f2cff55d640 1 -- 172.21.15.46:0/2796624872 wait complete. 2024-05-08T03:03:07.607 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool application enable 048b0735-bafe-474a-b306-d0d41d70737f rados 2024-05-08T03:03:07.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.733+0000 7f969206d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:07.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.746+0000 7f969206d640 1 Processor -- start 2024-05-08T03:03:07.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.746+0000 7f969206d640 1 -- start start 2024-05-08T03:03:07.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.748+0000 7f969206d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f968c132ea0 0x7f968c1332b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:07.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.748+0000 7f969206d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968c132960 con 0x7f968c12f440 2024-05-08T03:03:07.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.748+0000 7f969206d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f968c0725e0 con 0x7f968c132ea0 2024-05-08T03:03:07.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.748+0000 7f968affd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f968c12f440 0x7f968c12f850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52256/0 (socket says 172.21.15.46:52256) 2024-05-08T03:03:07.752 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.748+0000 7f968affd640 1 -- 172.21.15.46:0/2300080030 learned_addr learned my addr 172.21.15.46:0/2300080030 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:03:07.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.748+0000 7f968b7fe640 1 --2- 172.21.15.46:0/2300080030 >> v2:172.21.15.46:3300/0 conn(0x7f968c132ea0 0x7f968c1332b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:07.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.748+0000 7f968a7fc640 1 -- 172.21.15.46:0/2300080030 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188704909 0 0) 0x7f968c132960 con 0x7f968c12f440 2024-05-08T03:03:07.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.749+0000 7f968b7fe640 1 -- 172.21.15.46:0/2300080030 >> v1:172.21.15.46:6789/0 conn(0x7f968c12f440 legacy=0x7f968c12f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:07.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.749+0000 7f968b7fe640 1 -- 172.21.15.46:0/2300080030 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c132b90 con 0x7f968c132ea0 2024-05-08T03:03:07.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.749+0000 7f968b7fe640 1 --2- 172.21.15.46:0/2300080030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c132ea0 0x7f968c1332b0 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d01842e09257e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:07.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.749+0000 7f968a7fc640 1 -- 172.21.15.46:0/2300080030 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f967c009d90 con 0x7f968c132ea0 2024-05-08T03:03:07.754 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.749+0000 7f968a7fc640 1 -- 172.21.15.46:0/2300080030 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f967c00e230 con 0x7f968c132ea0 2024-05-08T03:03:07.754 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.749+0000 7f968a7fc640 1 -- 172.21.15.46:0/2300080030 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f967c00e4d0 con 0x7f968c132ea0 2024-05-08T03:03:07.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.750+0000 7f969206d640 1 -- 172.21.15.46:0/2300080030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c132ea0 msgr2=0x7f968c1332b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:07.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.750+0000 7f969206d640 1 --2- 172.21.15.46:0/2300080030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c132ea0 0x7f968c1332b0 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:07.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.750+0000 7f969206d640 1 -- 172.21.15.46:0/2300080030 shutdown_connections 2024-05-08T03:03:07.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.750+0000 7f969206d640 1 --2- 172.21.15.46:0/2300080030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c132ea0 0x7f968c1332b0 unknown :-1 s=CLOSED pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:07.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.750+0000 7f969206d640 1 -- 172.21.15.46:0/2300080030 >> 172.21.15.46:0/2300080030 conn(0x7f968c0a2930 msgr2=0x7f968c0a2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:07.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.751+0000 7f969206d640 1 -- 172.21.15.46:0/2300080030 shutdown_connections 2024-05-08T03:03:07.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.751+0000 7f969206d640 1 -- 172.21.15.46:0/2300080030 wait complete. 2024-05-08T03:03:07.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.751+0000 7f969206d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:07.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.753+0000 7f969206d640 1 Processor -- start 2024-05-08T03:03:07.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.754+0000 7f969206d640 1 -- start start 2024-05-08T03:03:07.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.755+0000 7f969206d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c12f440 0x7f968c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:07.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.755+0000 7f969206d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f968c12f0b0 con 0x7f968c12f440 2024-05-08T03:03:07.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.755+0000 7f968b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c12f440 0x7f968c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:07.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.755+0000 7f968b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c12f440 0x7f968c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52570/0 (socket says 172.21.15.46:52570) 2024-05-08T03:03:07.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.756+0000 7f968b7fe640 1 -- 172.21.15.46:0/2405375829 learned_addr learned my addr 172.21.15.46:0/2405375829 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:07.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.756+0000 7f968b7fe640 1 -- 172.21.15.46:0/2405375829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c124030 con 0x7f968c12f440 2024-05-08T03:03:07.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.756+0000 7f968b7fe640 1 --2- 172.21.15.46:0/2405375829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c12f440 0x7f968c06cd20 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:07.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.756+0000 7f9673fff640 1 -- 172.21.15.46:0/2405375829 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f967c013610 con 0x7f968c12f440 2024-05-08T03:03:07.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.756+0000 7f9673fff640 1 -- 172.21.15.46:0/2405375829 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f967c013770 con 0x7f968c12f440 2024-05-08T03:03:07.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.757+0000 7f9673fff640 1 -- 172.21.15.46:0/2405375829 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f967c013a10 con 0x7f968c12f440 2024-05-08T03:03:07.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.757+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c122930 con 0x7f968c12f440 2024-05-08T03:03:07.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.757+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c1234e0 con 0x7f968c12f440 2024-05-08T03:03:07.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.758+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c069870 con 0x7f968c12f440 2024-05-08T03:03:07.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.759+0000 7f9673fff640 1 -- 172.21.15.46:0/2405375829 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f967c013c10 con 0x7f968c12f440 2024-05-08T03:03:07.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.759+0000 7f9673fff640 1 --2- 172.21.15.46:0/2405375829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9678038930 0x7f967803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:07.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.759+0000 7f9673fff640 1 -- 172.21.15.46:0/2405375829 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(701..701 src has 611..701) ==== 4166+0+0 (crc 0 0 0) 0x7f967c018040 con 0x7f968c12f440 2024-05-08T03:03:07.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.760+0000 7f968affd640 1 --2- 172.21.15.46:0/2405375829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9678038930 0x7f967803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:07.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.760+0000 7f968affd640 1 --2- 172.21.15.46:0/2405375829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9678038930 0x7f967803ae40 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:07.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.769+0000 7f9673fff640 1 -- 172.21.15.46:0/2405375829 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f967c018e10 con 0x7f968c12f440 2024-05-08T03:03:07.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:07.963+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "app": "rados"} v 0) -- 0x7f968c068300 con 0x7f968c12f440 2024-05-08T03:03:08.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:08.387+0000 7f9673fff640 1 -- 172.21.15.46:0/2405375829 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "app": "rados"}]=0 enabled application 'rados' on pool '048b0735-bafe-474a-b306-d0d41d70737f' v702) ==== 213+0+0 (crc 0 0 0) 0x7f967c001d40 con 0x7f968c12f440 2024-05-08T03:03:08.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:08.582+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "app": "rados"} v 0) -- 0x7f968c1223d0 con 0x7f968c12f440 2024-05-08T03:03:09.395 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.391+0000 7f9673fff640 1 -- 172.21.15.46:0/2405375829 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "app": "rados"}]=0 enabled application 'rados' on pool '048b0735-bafe-474a-b306-d0d41d70737f' v703) ==== 213+0+0 (crc 0 0 0) 0x7f967c00f2a0 con 0x7f968c12f440 2024-05-08T03:03:09.395 INFO:tasks.workunit.client.0.smithi046.stderr:enabled application 'rados' on pool '048b0735-bafe-474a-b306-d0d41d70737f' 2024-05-08T03:03:09.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.393+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9678038930 msgr2=0x7f967803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:09.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.393+0000 7f969206d640 1 --2- 172.21.15.46:0/2405375829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9678038930 0x7f967803ae40 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:09.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.393+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c12f440 msgr2=0x7f968c06cd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:09.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.393+0000 7f969206d640 1 --2- 172.21.15.46:0/2405375829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c12f440 0x7f968c06cd20 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:09.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.393+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 shutdown_connections 2024-05-08T03:03:09.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.393+0000 7f969206d640 1 --2- 172.21.15.46:0/2405375829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f9678038930 0x7f967803ae40 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:09.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.393+0000 7f969206d640 1 --2- 172.21.15.46:0/2405375829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f968c12f440 0x7f968c06cd20 unknown :-1 s=CLOSED pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:09.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.393+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 >> 172.21.15.46:0/2405375829 conn(0x7f968c0a2930 msgr2=0x7f968c09aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:09.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.394+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 shutdown_connections 2024-05-08T03:03:09.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.394+0000 7f969206d640 1 -- 172.21.15.46:0/2405375829 wait complete. 2024-05-08T03:03:09.408 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota 048b0735-bafe-474a-b306-d0d41d70737f max_objects 10 2024-05-08T03:03:09.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.496+0000 7f316595d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:09.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.506+0000 7f316595d640 1 Processor -- start 2024-05-08T03:03:09.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.506+0000 7f316595d640 1 -- start start 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.507+0000 7f316595d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f316006fed0 0x7f316012e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.507+0000 7f316595d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316012e290 con 0x7f316012ed10 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.507+0000 7f316595d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f316006fc10 con 0x7f316006fed0 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.507+0000 7f315effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f316006fed0 0x7f316012e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.507+0000 7f315e7fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f316012ed10 0x7f3160131790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52264/0 (socket says 172.21.15.46:52264) 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.507+0000 7f315e7fc640 1 -- 172.21.15.46:0/866404059 learned_addr learned my addr 172.21.15.46:0/866404059 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.508+0000 7f315effd640 1 -- 172.21.15.46:0/866404059 >> v1:172.21.15.46:6789/0 conn(0x7f316012ed10 legacy=0x7f3160131790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.508+0000 7f315effd640 1 -- 172.21.15.46:0/866404059 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31600702e0 con 0x7f316006fed0 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.508+0000 7f315effd640 1 --2- 172.21.15.46:0/866404059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 0x7f316012e7d0 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bdaac17537f02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.508+0000 7f315dffb640 1 -- 172.21.15.46:0/866404059 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3150009d90 con 0x7f316006fed0 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.508+0000 7f315dffb640 1 -- 172.21.15.46:0/866404059 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f315000e230 con 0x7f316006fed0 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.508+0000 7f315dffb640 1 -- 172.21.15.46:0/866404059 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f315000e4d0 con 0x7f316006fed0 2024-05-08T03:03:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.509+0000 7f316595d640 1 -- 172.21.15.46:0/866404059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 msgr2=0x7f316012e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:09.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.509+0000 7f316595d640 1 --2- 172.21.15.46:0/866404059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 0x7f316012e7d0 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:09.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.509+0000 7f316595d640 1 -- 172.21.15.46:0/866404059 shutdown_connections 2024-05-08T03:03:09.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.509+0000 7f316595d640 1 --2- 172.21.15.46:0/866404059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 0x7f316012e7d0 unknown :-1 s=CLOSED pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:09.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.509+0000 7f316595d640 1 -- 172.21.15.46:0/866404059 >> 172.21.15.46:0/866404059 conn(0x7f31600a0810 msgr2=0x7f31600a0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:09.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.509+0000 7f316595d640 1 -- 172.21.15.46:0/866404059 shutdown_connections 2024-05-08T03:03:09.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.509+0000 7f316595d640 1 -- 172.21.15.46:0/866404059 wait complete. 2024-05-08T03:03:09.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.509+0000 7f316595d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:09.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.511+0000 7f316595d640 1 Processor -- start 2024-05-08T03:03:09.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.511+0000 7f316595d640 1 -- start start 2024-05-08T03:03:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.512+0000 7f316595d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 0x7f31601349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.512+0000 7f316595d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f316012e0c0 con 0x7f316006fed0 2024-05-08T03:03:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f315effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 0x7f31601349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f315effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 0x7f31601349e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52584/0 (socket says 172.21.15.46:52584) 2024-05-08T03:03:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f315effd640 1 -- 172.21.15.46:0/854308417 learned_addr learned my addr 172.21.15.46:0/854308417 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f315effd640 1 -- 172.21.15.46:0/854308417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316006cc90 con 0x7f316006fed0 2024-05-08T03:03:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f315effd640 1 --2- 172.21.15.46:0/854308417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 0x7f31601349e0 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f3147fff640 1 -- 172.21.15.46:0/854308417 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3150014620 con 0x7f316006fed0 2024-05-08T03:03:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f3147fff640 1 -- 172.21.15.46:0/854308417 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3150014780 con 0x7f316006fed0 2024-05-08T03:03:09.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316012de60 con 0x7f316006fed0 2024-05-08T03:03:09.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f3147fff640 1 -- 172.21.15.46:0/854308417 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3150014a20 con 0x7f316006fed0 2024-05-08T03:03:09.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.513+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3160119330 con 0x7f316006fed0 2024-05-08T03:03:09.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.514+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3160069870 con 0x7f316006fed0 2024-05-08T03:03:09.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.514+0000 7f3147fff640 1 -- 172.21.15.46:0/854308417 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f3150014bd0 con 0x7f316006fed0 2024-05-08T03:03:09.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.514+0000 7f3147fff640 1 --2- 172.21.15.46:0/854308417 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f314c038980 0x7f314c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:09.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.514+0000 7f3147fff640 1 -- 172.21.15.46:0/854308417 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(703..703 src has 611..703) ==== 4179+0+0 (crc 0 0 0) 0x7f3150019040 con 0x7f316006fed0 2024-05-08T03:03:09.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.515+0000 7f315e7fc640 1 --2- 172.21.15.46:0/854308417 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f314c038980 0x7f314c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:09.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.515+0000 7f315e7fc640 1 --2- 172.21.15.46:0/854308417 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f314c038980 0x7f314c03ae90 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:09.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.520+0000 7f3147fff640 1 -- 172.21.15.46:0/854308417 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f3150018190 con 0x7f316006fed0 2024-05-08T03:03:09.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:09.706+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "field": "max_objects", "val": "10"} v 0) -- 0x7f316006cc90 con 0x7f316006fed0 2024-05-08T03:03:10.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:10.314+0000 7f3147fff640 1 -- 172.21.15.46:0/854308417 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 048b0735-bafe-474a-b306-d0d41d70737f v704) ==== 223+0+0 (crc 0 0 0) 0x7f316006cc90 con 0x7f316006fed0 2024-05-08T03:03:10.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:10.425+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "field": "max_objects", "val": "10"} v 0) -- 0x7f316006cc90 con 0x7f316006fed0 2024-05-08T03:03:11.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.396+0000 7f3147fff640 1 -- 172.21.15.46:0/854308417 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 048b0735-bafe-474a-b306-d0d41d70737f v705) ==== 223+0+0 (crc 0 0 0) 0x7f316006cc90 con 0x7f316006fed0 2024-05-08T03:03:11.400 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 10 for pool 048b0735-bafe-474a-b306-d0d41d70737f 2024-05-08T03:03:11.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f314c038980 msgr2=0x7f314c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:11.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 --2- 172.21.15.46:0/854308417 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f314c038980 0x7f314c03ae90 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:11.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 msgr2=0x7f31601349e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:11.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 --2- 172.21.15.46:0/854308417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 0x7f31601349e0 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:11.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 shutdown_connections 2024-05-08T03:03:11.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 --2- 172.21.15.46:0/854308417 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f314c038980 0x7f314c03ae90 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:11.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 --2- 172.21.15.46:0/854308417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f316006fed0 0x7f31601349e0 unknown :-1 s=CLOSED pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:11.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 >> 172.21.15.46:0/854308417 conn(0x7f31600a0810 msgr2=0x7f3160136d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:11.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 shutdown_connections 2024-05-08T03:03:11.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:11.399+0000 7f316595d640 1 -- 172.21.15.46:0/854308417 wait complete. 2024-05-08T03:03:11.415 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-05-08T03:03:41.418 INFO:tasks.workunit.client.0.smithi046.stderr:++ seq 1 10 2024-05-08T03:03:41.418 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:41.418 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj1 /etc/passwd 2024-05-08T03:03:41.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.460+0000 7fa65ea37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.466+0000 7fa65ea37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.467+0000 7fa65ea37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.467+0000 7fa65ea37ec0 1 Processor -- start 2024-05-08T03:03:41.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.468+0000 7fa65ea37ec0 1 -- start start 2024-05-08T03:03:41.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.469+0000 7fa65ea37ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x9631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.469+0000 7fa65ea37ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7b1950 con 0x84abe0 2024-05-08T03:03:41.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.469+0000 7fa656b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x9631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.469+0000 7fa656b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x9631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51468/0 (socket says 172.21.15.46:51468) 2024-05-08T03:03:41.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.469+0000 7fa656b9b640 1 -- 172.21.15.46:0/919076374 learned_addr learned my addr 172.21.15.46:0/919076374 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.469+0000 7fa656b9b640 1 -- 172.21.15.46:0/919076374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7501e0 con 0x84abe0 2024-05-08T03:03:41.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa656b9b640 1 --2- 172.21.15.46:0/919076374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x9631f0 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254ed1391dd94f0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa655398640 1 -- 172.21.15.46:0/919076374 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa64000b500 con 0x84abe0 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa655398640 1 -- 172.21.15.46:0/919076374 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa64000b660 con 0x84abe0 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa655398640 1 -- 172.21.15.46:0/919076374 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa64000b900 con 0x84abe0 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/919076374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 msgr2=0x9631f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa65ea37ec0 1 --2- 172.21.15.46:0/919076374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x9631f0 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/919076374 shutdown_connections 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa65ea37ec0 1 --2- 172.21.15.46:0/919076374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x9631f0 unknown :-1 s=CLOSED pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/919076374 >> 172.21.15.46:0/919076374 conn(0x768960 msgr2=0x966320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/919076374 shutdown_connections 2024-05-08T03:03:41.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.470+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/919076374 wait complete. 2024-05-08T03:03:41.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.471+0000 7fa65ea37ec0 1 Processor -- start 2024-05-08T03:03:41.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.471+0000 7fa65ea37ec0 1 -- start start 2024-05-08T03:03:41.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.473+0000 7fa65ea37ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x950e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.473+0000 7fa65ea37ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7af3d0 con 0x84abe0 2024-05-08T03:03:41.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.473+0000 7fa656b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x950e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.473+0000 7fa656b9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x950e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51476/0 (socket says 172.21.15.46:51476) 2024-05-08T03:03:41.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.473+0000 7fa656b9b640 1 -- 172.21.15.46:0/305070754 learned_addr learned my addr 172.21.15.46:0/305070754 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.473+0000 7fa656b9b640 1 -- 172.21.15.46:0/305070754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x742e30 con 0x84abe0 2024-05-08T03:03:41.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.473+0000 7fa656b9b640 1 --2- 172.21.15.46:0/305070754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x950e30 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.474+0000 7fa64f7fe640 1 -- 172.21.15.46:0/305070754 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa640012b10 con 0x84abe0 2024-05-08T03:03:41.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.474+0000 7fa64f7fe640 1 -- 172.21.15.46:0/305070754 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa640005040 con 0x84abe0 2024-05-08T03:03:41.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.474+0000 7fa64f7fe640 1 -- 172.21.15.46:0/305070754 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa640012da0 con 0x84abe0 2024-05-08T03:03:41.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.474+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x742890 con 0x84abe0 2024-05-08T03:03:41.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.474+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x9523a0 con 0x84abe0 2024-05-08T03:03:41.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.475+0000 7fa64f7fe640 1 -- 172.21.15.46:0/305070754 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa64000d040 con 0x84abe0 2024-05-08T03:03:41.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.475+0000 7fa64f7fe640 1 --2- 172.21.15.46:0/305070754 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa63c037210 0x7fa63c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.475+0000 7fa64f7fe640 1 -- 172.21.15.46:0/305070754 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7fa64000a040 con 0x84abe0 2024-05-08T03:03:41.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.475+0000 7fa65ea37ec0 1 --2- 172.21.15.46:0/305070754 >> v2:172.21.15.80:6807/3216858417 conn(0x84cc50 0x9733d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.475+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 --> v2:172.21.15.80:6807/3216858417 -- osd_op(unknown.0.0:1 201.7 201:ff7b1f36:::obj1:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x954340 con 0x84cc50 2024-05-08T03:03:41.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.475+0000 7fa65639a640 1 --2- 172.21.15.46:0/305070754 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa63c037210 0x7fa63c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.476+0000 7fa65639a640 1 --2- 172.21.15.46:0/305070754 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa63c037210 0x7fa63c039720 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.476+0000 7fa65739c640 1 --2- 172.21.15.46:0/305070754 >> v2:172.21.15.80:6807/3216858417 conn(0x84cc50 0x9733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:41.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.479+0000 7fa65739c640 1 --2- 172.21.15.46:0/305070754 >> v2:172.21.15.80:6807/3216858417 conn(0x84cc50 0x9733d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65739c640 1 -- 172.21.15.46:0/305070754 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== osd_op_reply(1 obj1 [writefull 0~11982] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa64800a430 con 0x84cc50 2024-05-08T03:03:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 >> v2:172.21.15.80:6807/3216858417 conn(0x84cc50 msgr2=0x9733d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 --2- 172.21.15.46:0/305070754 >> v2:172.21.15.80:6807/3216858417 conn(0x84cc50 0x9733d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa63c037210 msgr2=0x7fa63c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 --2- 172.21.15.46:0/305070754 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa63c037210 0x7fa63c039720 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 msgr2=0x950e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 --2- 172.21.15.46:0/305070754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x950e30 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 shutdown_connections 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 --2- 172.21.15.46:0/305070754 >> v2:172.21.15.80:6807/3216858417 conn(0x84cc50 0x9733d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 --2- 172.21.15.46:0/305070754 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fa63c037210 0x7fa63c039720 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 --2- 172.21.15.46:0/305070754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x84abe0 0x950e30 unknown :-1 s=CLOSED pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 >> 172.21.15.46:0/305070754 conn(0x768960 msgr2=0x966260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 shutdown_connections 2024-05-08T03:03:41.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.492+0000 7fa65ea37ec0 1 -- 172.21.15.46:0/305070754 wait complete. 2024-05-08T03:03:41.498 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:41.498 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj2 /etc/passwd 2024-05-08T03:03:41.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.533+0000 7f873742fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.538+0000 7f873742fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.538+0000 7f873742fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.539+0000 7f873742fec0 1 Processor -- start 2024-05-08T03:03:41.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.539+0000 7f873742fec0 1 -- start start 2024-05-08T03:03:41.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.541+0000 7f873742fec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.541+0000 7f873742fec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1611950 con 0x16aabe0 2024-05-08T03:03:41.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.541+0000 7f872f59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.541+0000 7f872f59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51486/0 (socket says 172.21.15.46:51486) 2024-05-08T03:03:41.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.541+0000 7f872f59b640 1 -- 172.21.15.46:0/3632704748 learned_addr learned my addr 172.21.15.46:0/3632704748 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.541+0000 7f872f59b640 1 -- 172.21.15.46:0/3632704748 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x15b01e0 con 0x16aabe0 2024-05-08T03:03:41.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.541+0000 7f872f59b640 1 --2- 172.21.15.46:0/3632704748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17c3420 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7013ece497fd22c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f872dd98640 1 -- 172.21.15.46:0/3632704748 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f871800d500 con 0x16aabe0 2024-05-08T03:03:41.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f872dd98640 1 -- 172.21.15.46:0/3632704748 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f871800d660 con 0x16aabe0 2024-05-08T03:03:41.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f872dd98640 1 -- 172.21.15.46:0/3632704748 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f871800d900 con 0x16aabe0 2024-05-08T03:03:41.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f873742fec0 1 -- 172.21.15.46:0/3632704748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 msgr2=0x17c3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f873742fec0 1 --2- 172.21.15.46:0/3632704748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17c3420 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f873742fec0 1 -- 172.21.15.46:0/3632704748 shutdown_connections 2024-05-08T03:03:41.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f873742fec0 1 --2- 172.21.15.46:0/3632704748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17c3420 unknown :-1 s=CLOSED pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f873742fec0 1 -- 172.21.15.46:0/3632704748 >> 172.21.15.46:0/3632704748 conn(0x15c8960 msgr2=0x16a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f873742fec0 1 -- 172.21.15.46:0/3632704748 shutdown_connections 2024-05-08T03:03:41.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.542+0000 7f873742fec0 1 -- 172.21.15.46:0/3632704748 wait complete. 2024-05-08T03:03:41.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.543+0000 7f873742fec0 1 Processor -- start 2024-05-08T03:03:41.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.543+0000 7f873742fec0 1 -- start start 2024-05-08T03:03:41.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.545+0000 7f873742fec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.545+0000 7f873742fec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x160f3d0 con 0x16aabe0 2024-05-08T03:03:41.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.545+0000 7f872f59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.545+0000 7f872f59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51502/0 (socket says 172.21.15.46:51502) 2024-05-08T03:03:41.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.545+0000 7f872f59b640 1 -- 172.21.15.46:0/467909104 learned_addr learned my addr 172.21.15.46:0/467909104 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.545+0000 7f872f59b640 1 -- 172.21.15.46:0/467909104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x15a2e30 con 0x16aabe0 2024-05-08T03:03:41.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.545+0000 7f872f59b640 1 --2- 172.21.15.46:0/467909104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17b0270 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.545+0000 7f872cd96640 1 -- 172.21.15.46:0/467909104 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f871800fb60 con 0x16aabe0 2024-05-08T03:03:41.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.546+0000 7f872cd96640 1 -- 172.21.15.46:0/467909104 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f871800fcc0 con 0x16aabe0 2024-05-08T03:03:41.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.546+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x15a2890 con 0x16aabe0 2024-05-08T03:03:41.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.546+0000 7f872cd96640 1 -- 172.21.15.46:0/467909104 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f871800c360 con 0x16aabe0 2024-05-08T03:03:41.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.546+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x17b3700 con 0x16aabe0 2024-05-08T03:03:41.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.546+0000 7f872cd96640 1 -- 172.21.15.46:0/467909104 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f871800c510 con 0x16aabe0 2024-05-08T03:03:41.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.547+0000 7f872cd96640 1 --2- 172.21.15.46:0/467909104 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8714037210 0x7f8714039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.547+0000 7f872cd96640 1 -- 172.21.15.46:0/467909104 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7f8718048e60 con 0x16aabe0 2024-05-08T03:03:41.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.547+0000 7f873742fec0 1 --2- 172.21.15.46:0/467909104 >> v2:172.21.15.80:6805/1892248062 conn(0x16acc50 0x17c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.547+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 --> v2:172.21.15.80:6805/1892248062 -- osd_op(unknown.0.0:1 201.8 201:104778fc:::obj2:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x17b3d30 con 0x16acc50 2024-05-08T03:03:41.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.547+0000 7f872ed9a640 1 --2- 172.21.15.46:0/467909104 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8714037210 0x7f8714039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.548+0000 7f872ed9a640 1 --2- 172.21.15.46:0/467909104 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8714037210 0x7f8714039720 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.548+0000 7f872fd9c640 1 --2- 172.21.15.46:0/467909104 >> v2:172.21.15.80:6805/1892248062 conn(0x16acc50 0x17c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:41.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.551+0000 7f872fd9c640 1 --2- 172.21.15.46:0/467909104 >> v2:172.21.15.80:6805/1892248062 conn(0x16acc50 0x17c28c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f872fd9c640 1 -- 172.21.15.46:0/467909104 <== osd.2 v2:172.21.15.80:6805/1892248062 1 ==== osd_op_reply(1 obj2 [writefull 0~11982] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f872000a430 con 0x16acc50 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 >> v2:172.21.15.80:6805/1892248062 conn(0x16acc50 msgr2=0x17c28c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 --2- 172.21.15.46:0/467909104 >> v2:172.21.15.80:6805/1892248062 conn(0x16acc50 0x17c28c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8714037210 msgr2=0x7f8714039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 --2- 172.21.15.46:0/467909104 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8714037210 0x7f8714039720 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 msgr2=0x17b0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 --2- 172.21.15.46:0/467909104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17b0270 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 shutdown_connections 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 --2- 172.21.15.46:0/467909104 >> v2:172.21.15.80:6805/1892248062 conn(0x16acc50 0x17c28c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 --2- 172.21.15.46:0/467909104 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f8714037210 0x7f8714039720 unknown :-1 s=CLOSED pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 --2- 172.21.15.46:0/467909104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x16aabe0 0x17b0270 unknown :-1 s=CLOSED pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 >> 172.21.15.46:0/467909104 conn(0x15c8960 msgr2=0x16a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 shutdown_connections 2024-05-08T03:03:41.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.563+0000 7f873742fec0 1 -- 172.21.15.46:0/467909104 wait complete. 2024-05-08T03:03:41.569 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:41.569 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj3 /etc/passwd 2024-05-08T03:03:41.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.602+0000 7efc64b28ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.607+0000 7efc64b28ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.608+0000 7efc64b28ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.608+0000 7efc64b28ec0 1 Processor -- start 2024-05-08T03:03:41.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.608+0000 7efc64b28ec0 1 -- start start 2024-05-08T03:03:41.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.610+0000 7efc64b28ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x11b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.610+0000 7efc64b28ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1087950 con 0x111ff40 2024-05-08T03:03:41.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.610+0000 7efc5cf9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x11b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.610+0000 7efc5cf9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x11b7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51518/0 (socket says 172.21.15.46:51518) 2024-05-08T03:03:41.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.610+0000 7efc5cf9b640 1 -- 172.21.15.46:0/3993711928 learned_addr learned my addr 172.21.15.46:0/3993711928 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.610+0000 7efc5cf9b640 1 -- 172.21.15.46:0/3993711928 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x10261e0 con 0x111ff40 2024-05-08T03:03:41.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.610+0000 7efc5cf9b640 1 --2- 172.21.15.46:0/3993711928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x11b7b00 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed179ee19f2abb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.610+0000 7efc567fc640 1 -- 172.21.15.46:0/3993711928 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc4800b500 con 0x111ff40 2024-05-08T03:03:41.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.611+0000 7efc567fc640 1 -- 172.21.15.46:0/3993711928 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efc4800b660 con 0x111ff40 2024-05-08T03:03:41.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.611+0000 7efc567fc640 1 -- 172.21.15.46:0/3993711928 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc4800b900 con 0x111ff40 2024-05-08T03:03:41.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.611+0000 7efc64b28ec0 1 -- 172.21.15.46:0/3993711928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 msgr2=0x11b7b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.611+0000 7efc64b28ec0 1 --2- 172.21.15.46:0/3993711928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x11b7b00 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.611+0000 7efc64b28ec0 1 -- 172.21.15.46:0/3993711928 shutdown_connections 2024-05-08T03:03:41.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.611+0000 7efc64b28ec0 1 --2- 172.21.15.46:0/3993711928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x11b7b00 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.611+0000 7efc64b28ec0 1 -- 172.21.15.46:0/3993711928 >> 172.21.15.46:0/3993711928 conn(0x103e960 msgr2=0x11259e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.611+0000 7efc64b28ec0 1 -- 172.21.15.46:0/3993711928 shutdown_connections 2024-05-08T03:03:41.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.611+0000 7efc64b28ec0 1 -- 172.21.15.46:0/3993711928 wait complete. 2024-05-08T03:03:41.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.612+0000 7efc64b28ec0 1 Processor -- start 2024-05-08T03:03:41.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.612+0000 7efc64b28ec0 1 -- start start 2024-05-08T03:03:41.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc64b28ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x119f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc64b28ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x10853d0 con 0x111ff40 2024-05-08T03:03:41.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc5cf9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x119f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc5cf9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x119f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51532/0 (socket says 172.21.15.46:51532) 2024-05-08T03:03:41.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc5cf9b640 1 -- 172.21.15.46:0/1763835882 learned_addr learned my addr 172.21.15.46:0/1763835882 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc5cf9b640 1 -- 172.21.15.46:0/1763835882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1018e30 con 0x111ff40 2024-05-08T03:03:41.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc5cf9b640 1 --2- 172.21.15.46:0/1763835882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x119f430 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc557fa640 1 -- 172.21.15.46:0/1763835882 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc480111e0 con 0x111ff40 2024-05-08T03:03:41.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc557fa640 1 -- 172.21.15.46:0/1763835882 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efc48011980 con 0x111ff40 2024-05-08T03:03:41.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc557fa640 1 -- 172.21.15.46:0/1763835882 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc48011af0 con 0x111ff40 2024-05-08T03:03:41.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.614+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1018890 con 0x111ff40 2024-05-08T03:03:41.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.615+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x11a28d0 con 0x111ff40 2024-05-08T03:03:41.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.615+0000 7efc557fa640 1 -- 172.21.15.46:0/1763835882 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7efc48011ce0 con 0x111ff40 2024-05-08T03:03:41.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.616+0000 7efc557fa640 1 --2- 172.21.15.46:0/1763835882 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7efc44037210 0x7efc44039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.616+0000 7efc557fa640 1 -- 172.21.15.46:0/1763835882 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7efc48048d90 con 0x111ff40 2024-05-08T03:03:41.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.616+0000 7efc64b28ec0 1 --2- 172.21.15.46:0/1763835882 >> v2:172.21.15.46:6806/2291706666 conn(0x1121050 0x11b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.616+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:1 201.1 201:8dd16f86:::obj3:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x11a2fe0 con 0x1121050 2024-05-08T03:03:41.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.616+0000 7efc577fe640 1 --2- 172.21.15.46:0/1763835882 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7efc44037210 0x7efc44039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.617+0000 7efc577fe640 1 --2- 172.21.15.46:0/1763835882 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7efc44037210 0x7efc44039720 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.617+0000 7efc5d79c640 1 --2- 172.21.15.46:0/1763835882 >> v2:172.21.15.46:6806/2291706666 conn(0x1121050 0x11b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:41.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.620+0000 7efc5d79c640 1 --2- 172.21.15.46:0/1763835882 >> v2:172.21.15.46:6806/2291706666 conn(0x1121050 0x11b28c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc5d79c640 1 -- 172.21.15.46:0/1763835882 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(1 obj3 [writefull 0~11982] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7efc5000a430 con 0x1121050 2024-05-08T03:03:41.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 >> v2:172.21.15.46:6806/2291706666 conn(0x1121050 msgr2=0x11b28c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 --2- 172.21.15.46:0/1763835882 >> v2:172.21.15.46:6806/2291706666 conn(0x1121050 0x11b28c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7efc44037210 msgr2=0x7efc44039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 --2- 172.21.15.46:0/1763835882 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7efc44037210 0x7efc44039720 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 msgr2=0x119f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 --2- 172.21.15.46:0/1763835882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x119f430 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 shutdown_connections 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 --2- 172.21.15.46:0/1763835882 >> v2:172.21.15.46:6806/2291706666 conn(0x1121050 0x11b28c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 --2- 172.21.15.46:0/1763835882 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7efc44037210 0x7efc44039720 unknown :-1 s=CLOSED pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 --2- 172.21.15.46:0/1763835882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x111ff40 0x119f430 unknown :-1 s=CLOSED pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.631+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 >> 172.21.15.46:0/1763835882 conn(0x103e960 msgr2=0x11259e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.632+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 shutdown_connections 2024-05-08T03:03:41.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.632+0000 7efc64b28ec0 1 -- 172.21.15.46:0/1763835882 wait complete. 2024-05-08T03:03:41.637 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:41.637 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj4 /etc/passwd 2024-05-08T03:03:41.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.672+0000 7f331d254ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.678+0000 7f331d254ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.678+0000 7f331d254ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.679+0000 7f331d254ec0 1 Processor -- start 2024-05-08T03:03:41.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.679+0000 7f331d254ec0 1 -- start start 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.680+0000 7f331d254ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x1065970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.680+0000 7f331d254ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xf36950 con 0x1063ab0 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.681+0000 7f331539b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x1065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.681+0000 7f331539b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x1065970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51548/0 (socket says 172.21.15.46:51548) 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.681+0000 7f331539b640 1 -- 172.21.15.46:0/1281039221 learned_addr learned my addr 172.21.15.46:0/1281039221 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.681+0000 7f331539b640 1 -- 172.21.15.46:0/1281039221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xed51e0 con 0x1063ab0 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.681+0000 7f331539b640 1 --2- 172.21.15.46:0/1281039221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x1065970 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd352bf466dfa172 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.681+0000 7f330effd640 1 -- 172.21.15.46:0/1281039221 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f330800c490 con 0x1063ab0 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.681+0000 7f330effd640 1 -- 172.21.15.46:0/1281039221 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f330800c5f0 con 0x1063ab0 2024-05-08T03:03:41.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.681+0000 7f330effd640 1 -- 172.21.15.46:0/1281039221 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f330800c890 con 0x1063ab0 2024-05-08T03:03:41.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.682+0000 7f331d254ec0 1 -- 172.21.15.46:0/1281039221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 msgr2=0x1065970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.682+0000 7f331d254ec0 1 --2- 172.21.15.46:0/1281039221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x1065970 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.682+0000 7f331d254ec0 1 -- 172.21.15.46:0/1281039221 shutdown_connections 2024-05-08T03:03:41.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.682+0000 7f331d254ec0 1 --2- 172.21.15.46:0/1281039221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x1065970 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.682+0000 7f331d254ec0 1 -- 172.21.15.46:0/1281039221 >> 172.21.15.46:0/1281039221 conn(0xeed960 msgr2=0x10614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.682+0000 7f331d254ec0 1 -- 172.21.15.46:0/1281039221 shutdown_connections 2024-05-08T03:03:41.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.682+0000 7f331d254ec0 1 -- 172.21.15.46:0/1281039221 wait complete. 2024-05-08T03:03:41.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.683+0000 7f331d254ec0 1 Processor -- start 2024-05-08T03:03:41.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.683+0000 7f331d254ec0 1 -- start start 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.684+0000 7f331d254ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x104e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.684+0000 7f331d254ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xf343d0 con 0x1063ab0 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f331539b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x104e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f331539b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x104e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51558/0 (socket says 172.21.15.46:51558) 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f331539b640 1 -- 172.21.15.46:0/35478224 learned_addr learned my addr 172.21.15.46:0/35478224 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f331539b640 1 -- 172.21.15.46:0/35478224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xec7e30 con 0x1063ab0 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f331539b640 1 --2- 172.21.15.46:0/35478224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x104e270 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f330dffb640 1 -- 172.21.15.46:0/35478224 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3308016040 con 0x1063ab0 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f330dffb640 1 -- 172.21.15.46:0/35478224 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f33080119d0 con 0x1063ab0 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xec7890 con 0x1063ab0 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f330dffb640 1 -- 172.21.15.46:0/35478224 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3308011c70 con 0x1063ab0 2024-05-08T03:03:41.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.685+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1051670 con 0x1063ab0 2024-05-08T03:03:41.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.686+0000 7f330dffb640 1 -- 172.21.15.46:0/35478224 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f330800e440 con 0x1063ab0 2024-05-08T03:03:41.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.686+0000 7f330dffb640 1 --2- 172.21.15.46:0/35478224 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f32f0037260 0x7f32f0039770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.686+0000 7f330dffb640 1 -- 172.21.15.46:0/35478224 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7f33080491a0 con 0x1063ab0 2024-05-08T03:03:41.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.687+0000 7f331d254ec0 1 --2- 172.21.15.46:0/35478224 >> v2:172.21.15.80:6807/3216858417 conn(0x10668f0 0x104ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.687+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 --> v2:172.21.15.80:6807/3216858417 -- osd_op(unknown.0.0:1 201.0 201:0ee9ae15:::obj4:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x10f8ae0 con 0x10668f0 2024-05-08T03:03:41.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.687+0000 7f3314b9a640 1 --2- 172.21.15.46:0/35478224 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f32f0037260 0x7f32f0039770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.687+0000 7f3314b9a640 1 --2- 172.21.15.46:0/35478224 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f32f0037260 0x7f32f0039770 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.688+0000 7f3315b9c640 1 --2- 172.21.15.46:0/35478224 >> v2:172.21.15.80:6807/3216858417 conn(0x10668f0 0x104ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:41.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.692+0000 7f3315b9c640 1 --2- 172.21.15.46:0/35478224 >> v2:172.21.15.80:6807/3216858417 conn(0x10668f0 0x104ecc0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f3315b9c640 1 -- 172.21.15.46:0/35478224 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== osd_op_reply(1 obj4 [writefull 0~11982] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f330000a430 con 0x10668f0 2024-05-08T03:03:41.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 >> v2:172.21.15.80:6807/3216858417 conn(0x10668f0 msgr2=0x104ecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 --2- 172.21.15.46:0/35478224 >> v2:172.21.15.80:6807/3216858417 conn(0x10668f0 0x104ecc0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f32f0037260 msgr2=0x7f32f0039770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 --2- 172.21.15.46:0/35478224 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f32f0037260 0x7f32f0039770 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 msgr2=0x104e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 --2- 172.21.15.46:0/35478224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x104e270 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 shutdown_connections 2024-05-08T03:03:41.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 --2- 172.21.15.46:0/35478224 >> v2:172.21.15.80:6807/3216858417 conn(0x10668f0 0x104ecc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 --2- 172.21.15.46:0/35478224 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f32f0037260 0x7f32f0039770 unknown :-1 s=CLOSED pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 --2- 172.21.15.46:0/35478224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1063ab0 0x104e270 unknown :-1 s=CLOSED pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 >> 172.21.15.46:0/35478224 conn(0xeed960 msgr2=0x10614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 shutdown_connections 2024-05-08T03:03:41.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.704+0000 7f331d254ec0 1 -- 172.21.15.46:0/35478224 wait complete. 2024-05-08T03:03:41.710 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:41.710 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj5 /etc/passwd 2024-05-08T03:03:41.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.743+0000 7fb06a8d6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.749+0000 7fb06a8d6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.749+0000 7fb06a8d6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.750+0000 7fb06a8d6ec0 1 Processor -- start 2024-05-08T03:03:41.754 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.750+0000 7fb06a8d6ec0 1 -- start start 2024-05-08T03:03:41.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb06a8d6ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x14a5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb06a8d6ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1376950 con 0x14a3ab0 2024-05-08T03:03:41.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb062d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x14a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb062d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x14a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51572/0 (socket says 172.21.15.46:51572) 2024-05-08T03:03:41.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb062d9b640 1 -- 172.21.15.46:0/4173188793 learned_addr learned my addr 172.21.15.46:0/4173188793 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb062d9b640 1 -- 172.21.15.46:0/4173188793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13151e0 con 0x14a3ab0 2024-05-08T03:03:41.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb062d9b640 1 --2- 172.21.15.46:0/4173188793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x14a5970 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f837a56a39ca699 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb061598640 1 -- 172.21.15.46:0/4173188793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb04c00c490 con 0x14a3ab0 2024-05-08T03:03:41.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb061598640 1 -- 172.21.15.46:0/4173188793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb04c00c5f0 con 0x14a3ab0 2024-05-08T03:03:41.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.752+0000 7fb061598640 1 -- 172.21.15.46:0/4173188793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb04c00c890 con 0x14a3ab0 2024-05-08T03:03:41.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.753+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/4173188793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 msgr2=0x14a5970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.753+0000 7fb06a8d6ec0 1 --2- 172.21.15.46:0/4173188793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x14a5970 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.753+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/4173188793 shutdown_connections 2024-05-08T03:03:41.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.753+0000 7fb06a8d6ec0 1 --2- 172.21.15.46:0/4173188793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x14a5970 unknown :-1 s=CLOSED pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.753+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/4173188793 >> 172.21.15.46:0/4173188793 conn(0x132d960 msgr2=0x14a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.753+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/4173188793 shutdown_connections 2024-05-08T03:03:41.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.753+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/4173188793 wait complete. 2024-05-08T03:03:41.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.754+0000 7fb06a8d6ec0 1 Processor -- start 2024-05-08T03:03:41.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.754+0000 7fb06a8d6ec0 1 -- start start 2024-05-08T03:03:41.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb06a8d6ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x148e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb06a8d6ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x13743d0 con 0x14a3ab0 2024-05-08T03:03:41.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb062d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x148e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb062d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x148e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51580/0 (socket says 172.21.15.46:51580) 2024-05-08T03:03:41.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb062d9b640 1 -- 172.21.15.46:0/1058807230 learned_addr learned my addr 172.21.15.46:0/1058807230 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb062d9b640 1 -- 172.21.15.46:0/1058807230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1307e30 con 0x14a3ab0 2024-05-08T03:03:41.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb062d9b640 1 --2- 172.21.15.46:0/1058807230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x148e270 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb05b7fe640 1 -- 172.21.15.46:0/1058807230 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb04c016040 con 0x14a3ab0 2024-05-08T03:03:41.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1307890 con 0x14a3ab0 2024-05-08T03:03:41.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb05b7fe640 1 -- 172.21.15.46:0/1058807230 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb04c0118d0 con 0x14a3ab0 2024-05-08T03:03:41.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb05b7fe640 1 -- 172.21.15.46:0/1058807230 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb04c011b70 con 0x14a3ab0 2024-05-08T03:03:41.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.756+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1491670 con 0x14a3ab0 2024-05-08T03:03:41.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.757+0000 7fb05b7fe640 1 -- 172.21.15.46:0/1058807230 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb04c00e440 con 0x14a3ab0 2024-05-08T03:03:41.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.758+0000 7fb05b7fe640 1 --2- 172.21.15.46:0/1058807230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0480371c0 0x7fb0480396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.758+0000 7fb05b7fe640 1 -- 172.21.15.46:0/1058807230 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7fb04c049110 con 0x14a3ab0 2024-05-08T03:03:41.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.758+0000 7fb06a8d6ec0 1 --2- 172.21.15.46:0/1058807230 >> v2:172.21.15.46:6801/3562168766 conn(0x14a68f0 0x148ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.758+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 --> v2:172.21.15.46:6801/3562168766 -- osd_op(unknown.0.0:1 201.3 201:c52c9666:::obj5:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x1538ae0 con 0x14a68f0 2024-05-08T03:03:41.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.758+0000 7fb06259a640 1 --2- 172.21.15.46:0/1058807230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0480371c0 0x7fb0480396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.758+0000 7fb06259a640 1 --2- 172.21.15.46:0/1058807230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0480371c0 0x7fb0480396d0 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.758+0000 7fb06359c640 1 --2- 172.21.15.46:0/1058807230 >> v2:172.21.15.46:6801/3562168766 conn(0x14a68f0 0x148ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:41.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.761+0000 7fb06359c640 1 --2- 172.21.15.46:0/1058807230 >> v2:172.21.15.46:6801/3562168766 conn(0x14a68f0 0x148ecc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06359c640 1 -- 172.21.15.46:0/1058807230 <== osd.0 v2:172.21.15.46:6801/3562168766 1 ==== osd_op_reply(1 obj5 [writefull 0~11982] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb05400a430 con 0x14a68f0 2024-05-08T03:03:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 >> v2:172.21.15.46:6801/3562168766 conn(0x14a68f0 msgr2=0x148ecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 --2- 172.21.15.46:0/1058807230 >> v2:172.21.15.46:6801/3562168766 conn(0x14a68f0 0x148ecc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0480371c0 msgr2=0x7fb0480396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 --2- 172.21.15.46:0/1058807230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0480371c0 0x7fb0480396d0 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 msgr2=0x148e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 --2- 172.21.15.46:0/1058807230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x148e270 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 shutdown_connections 2024-05-08T03:03:41.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 --2- 172.21.15.46:0/1058807230 >> v2:172.21.15.46:6801/3562168766 conn(0x14a68f0 0x148ecc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 --2- 172.21.15.46:0/1058807230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0480371c0 0x7fb0480396d0 unknown :-1 s=CLOSED pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 --2- 172.21.15.46:0/1058807230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x14a3ab0 0x148e270 unknown :-1 s=CLOSED pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 >> 172.21.15.46:0/1058807230 conn(0x132d960 msgr2=0x14a14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 shutdown_connections 2024-05-08T03:03:41.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.774+0000 7fb06a8d6ec0 1 -- 172.21.15.46:0/1058807230 wait complete. 2024-05-08T03:03:41.780 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:41.780 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj6 /etc/passwd 2024-05-08T03:03:41.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.820+0000 7f26e2e80ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.826+0000 7f26e2e80ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.826+0000 7f26e2e80ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.827+0000 7f26e2e80ec0 1 Processor -- start 2024-05-08T03:03:41.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.827+0000 7f26e2e80ec0 1 -- start start 2024-05-08T03:03:41.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.828+0000 7f26e2e80ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x22d40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.828+0000 7f26e2e80ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x2254950 con 0x22edbe0 2024-05-08T03:03:41.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.828+0000 7f26daf9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x22d40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.829+0000 7f26daf9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x22d40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51590/0 (socket says 172.21.15.46:51590) 2024-05-08T03:03:41.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.829+0000 7f26daf9b640 1 -- 172.21.15.46:0/3208464150 learned_addr learned my addr 172.21.15.46:0/3208464150 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.829+0000 7f26daf9b640 1 -- 172.21.15.46:0/3208464150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x21f31e0 con 0x22edbe0 2024-05-08T03:03:41.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.829+0000 7f26daf9b640 1 --2- 172.21.15.46:0/3208464150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x22d40c0 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d648d0f8b3ff3f45 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.829+0000 7f26d9798640 1 -- 172.21.15.46:0/3208464150 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f26c402c990 con 0x22edbe0 2024-05-08T03:03:41.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.829+0000 7f26d9798640 1 -- 172.21.15.46:0/3208464150 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f26c400a040 con 0x22edbe0 2024-05-08T03:03:41.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.829+0000 7f26d9798640 1 -- 172.21.15.46:0/3208464150 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f26c400a2e0 con 0x22edbe0 2024-05-08T03:03:41.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.830+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3208464150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 msgr2=0x22d40c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.830+0000 7f26e2e80ec0 1 --2- 172.21.15.46:0/3208464150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x22d40c0 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.830+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3208464150 shutdown_connections 2024-05-08T03:03:41.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.830+0000 7f26e2e80ec0 1 --2- 172.21.15.46:0/3208464150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x22d40c0 unknown :-1 s=CLOSED pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.830+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3208464150 >> 172.21.15.46:0/3208464150 conn(0x220b960 msgr2=0x22e6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.830+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3208464150 shutdown_connections 2024-05-08T03:03:41.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.830+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3208464150 wait complete. 2024-05-08T03:03:41.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.831+0000 7f26e2e80ec0 1 Processor -- start 2024-05-08T03:03:41.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.831+0000 7f26e2e80ec0 1 -- start start 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.832+0000 7f26e2e80ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x2418be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.832+0000 7f26e2e80ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x22523d0 con 0x22edbe0 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.832+0000 7f26daf9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x2418be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.832+0000 7f26daf9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x2418be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51602/0 (socket says 172.21.15.46:51602) 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.832+0000 7f26daf9b640 1 -- 172.21.15.46:0/3221880191 learned_addr learned my addr 172.21.15.46:0/3221880191 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.833+0000 7f26daf9b640 1 -- 172.21.15.46:0/3221880191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x21e5e30 con 0x22edbe0 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.833+0000 7f26daf9b640 1 --2- 172.21.15.46:0/3221880191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x2418be0 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.833+0000 7f26d37fe640 1 -- 172.21.15.46:0/3221880191 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f26c402d570 con 0x22edbe0 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.833+0000 7f26d37fe640 1 -- 172.21.15.46:0/3221880191 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f26c402d6d0 con 0x22edbe0 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.833+0000 7f26d37fe640 1 -- 172.21.15.46:0/3221880191 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f26c402d970 con 0x22edbe0 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.833+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x21e5890 con 0x22edbe0 2024-05-08T03:03:41.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.833+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x24066b0 con 0x22edbe0 2024-05-08T03:03:41.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.834+0000 7f26d37fe640 1 -- 172.21.15.46:0/3221880191 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f26c4035040 con 0x22edbe0 2024-05-08T03:03:41.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.834+0000 7f26d37fe640 1 --2- 172.21.15.46:0/3221880191 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f26c0037210 0x7f26c0039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.834+0000 7f26d37fe640 1 -- 172.21.15.46:0/3221880191 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7f26c4032040 con 0x22edbe0 2024-05-08T03:03:41.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.834+0000 7f26e2e80ec0 1 --2- 172.21.15.46:0/3221880191 >> v2:172.21.15.46:6806/2291706666 conn(0x22efa80 0x23f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.834+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:1 201.4 201:233a42c1:::obj6:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x23f88e0 con 0x22efa80 2024-05-08T03:03:41.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.834+0000 7f26da79a640 1 --2- 172.21.15.46:0/3221880191 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f26c0037210 0x7f26c0039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.835+0000 7f26da79a640 1 --2- 172.21.15.46:0/3221880191 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f26c0037210 0x7f26c0039720 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.835+0000 7f26db79c640 1 --2- 172.21.15.46:0/3221880191 >> v2:172.21.15.46:6806/2291706666 conn(0x22efa80 0x23f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:41.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.839+0000 7f26db79c640 1 --2- 172.21.15.46:0/3221880191 >> v2:172.21.15.46:6806/2291706666 conn(0x22efa80 0x23f59c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26db79c640 1 -- 172.21.15.46:0/3221880191 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(1 obj6 [writefull 0~11982] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f26cc00a430 con 0x22efa80 2024-05-08T03:03:41.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 >> v2:172.21.15.46:6806/2291706666 conn(0x22efa80 msgr2=0x23f59c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 --2- 172.21.15.46:0/3221880191 >> v2:172.21.15.46:6806/2291706666 conn(0x22efa80 0x23f59c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f26c0037210 msgr2=0x7f26c0039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 --2- 172.21.15.46:0/3221880191 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f26c0037210 0x7f26c0039720 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 msgr2=0x2418be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 --2- 172.21.15.46:0/3221880191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x2418be0 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 shutdown_connections 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 --2- 172.21.15.46:0/3221880191 >> v2:172.21.15.46:6806/2291706666 conn(0x22efa80 0x23f59c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 --2- 172.21.15.46:0/3221880191 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f26c0037210 0x7f26c0039720 unknown :-1 s=CLOSED pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 --2- 172.21.15.46:0/3221880191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x22edbe0 0x2418be0 unknown :-1 s=CLOSED pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.850+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 >> 172.21.15.46:0/3221880191 conn(0x220b960 msgr2=0x22e6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.851+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 shutdown_connections 2024-05-08T03:03:41.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.851+0000 7f26e2e80ec0 1 -- 172.21.15.46:0/3221880191 wait complete. 2024-05-08T03:03:41.856 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:41.857 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj7 /etc/passwd 2024-05-08T03:03:41.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.891+0000 7f3e90e3cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.897+0000 7f3e90e3cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.897+0000 7f3e90e3cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.898+0000 7f3e90e3cec0 1 Processor -- start 2024-05-08T03:03:41.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.898+0000 7f3e90e3cec0 1 -- start start 2024-05-08T03:03:41.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.899+0000 7f3e90e3cec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x26751f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.899+0000 7f3e90e3cec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x24c3950 con 0x255cbe0 2024-05-08T03:03:41.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.899+0000 7f3e88f9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x26751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.899+0000 7f3e88f9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x26751f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51628/0 (socket says 172.21.15.46:51628) 2024-05-08T03:03:41.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.899+0000 7f3e88f9b640 1 -- 172.21.15.46:0/770447828 learned_addr learned my addr 172.21.15.46:0/770447828 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.899+0000 7f3e88f9b640 1 -- 172.21.15.46:0/770447828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24621e0 con 0x255cbe0 2024-05-08T03:03:41.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e88f9b640 1 --2- 172.21.15.46:0/770447828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x26751f0 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ff71cfc914ad51 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e827fc640 1 -- 172.21.15.46:0/770447828 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e7402fb90 con 0x255cbe0 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e827fc640 1 -- 172.21.15.46:0/770447828 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3e7402fcf0 con 0x255cbe0 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e827fc640 1 -- 172.21.15.46:0/770447828 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e74034410 con 0x255cbe0 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/770447828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 msgr2=0x26751f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e90e3cec0 1 --2- 172.21.15.46:0/770447828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x26751f0 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/770447828 shutdown_connections 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e90e3cec0 1 --2- 172.21.15.46:0/770447828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x26751f0 unknown :-1 s=CLOSED pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/770447828 >> 172.21.15.46:0/770447828 conn(0x247a960 msgr2=0x2555350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/770447828 shutdown_connections 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.900+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/770447828 wait complete. 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.901+0000 7f3e90e3cec0 1 Processor -- start 2024-05-08T03:03:41.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.901+0000 7f3e90e3cec0 1 -- start start 2024-05-08T03:03:41.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.903+0000 7f3e90e3cec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x2662270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.903+0000 7f3e90e3cec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x24c13d0 con 0x255cbe0 2024-05-08T03:03:41.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.903+0000 7f3e88f9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x2662270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.903+0000 7f3e88f9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x2662270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51640/0 (socket says 172.21.15.46:51640) 2024-05-08T03:03:41.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.903+0000 7f3e88f9b640 1 -- 172.21.15.46:0/3081692282 learned_addr learned my addr 172.21.15.46:0/3081692282 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.903+0000 7f3e88f9b640 1 -- 172.21.15.46:0/3081692282 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2454e30 con 0x255cbe0 2024-05-08T03:03:41.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.903+0000 7f3e88f9b640 1 --2- 172.21.15.46:0/3081692282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x2662270 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.904+0000 7f3e817fa640 1 -- 172.21.15.46:0/3081692282 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e7402fe60 con 0x255cbe0 2024-05-08T03:03:41.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.904+0000 7f3e817fa640 1 -- 172.21.15.46:0/3081692282 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3e74034e10 con 0x255cbe0 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.904+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2454890 con 0x255cbe0 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.904+0000 7f3e817fa640 1 -- 172.21.15.46:0/3081692282 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e74033530 con 0x255cbe0 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.904+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x26645d0 con 0x255cbe0 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.905+0000 7f3e817fa640 1 -- 172.21.15.46:0/3081692282 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f3e7403c040 con 0x255cbe0 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.905+0000 7f3e817fa640 1 --2- 172.21.15.46:0/3081692282 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3e70037210 0x7f3e70039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.905+0000 7f3e817fa640 1 -- 172.21.15.46:0/3081692282 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7f3e74039040 con 0x255cbe0 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.905+0000 7f3e90e3cec0 1 --2- 172.21.15.46:0/3081692282 >> v2:172.21.15.46:6806/2291706666 conn(0x255ea80 0x2685850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.905+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:1 201.9 201:9a09113a:::obj7:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x2665be0 con 0x255ea80 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.905+0000 7f3e837fe640 1 --2- 172.21.15.46:0/3081692282 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3e70037210 0x7f3e70039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.906+0000 7f3e837fe640 1 --2- 172.21.15.46:0/3081692282 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3e70037210 0x7f3e70039720 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.906+0000 7f3e8979c640 1 --2- 172.21.15.46:0/3081692282 >> v2:172.21.15.46:6806/2291706666 conn(0x255ea80 0x2685850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:41.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.908+0000 7f3e8979c640 1 --2- 172.21.15.46:0/3081692282 >> v2:172.21.15.46:6806/2291706666 conn(0x255ea80 0x2685850 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.919+0000 7f3e8979c640 1 -- 172.21.15.46:0/3081692282 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(1 obj7 [writefull 0~11982] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3e7c00c430 con 0x255ea80 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.919+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 >> v2:172.21.15.46:6806/2291706666 conn(0x255ea80 msgr2=0x2685850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.919+0000 7f3e90e3cec0 1 --2- 172.21.15.46:0/3081692282 >> v2:172.21.15.46:6806/2291706666 conn(0x255ea80 0x2685850 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3e70037210 msgr2=0x7f3e70039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 --2- 172.21.15.46:0/3081692282 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3e70037210 0x7f3e70039720 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 msgr2=0x2662270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 --2- 172.21.15.46:0/3081692282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x2662270 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 shutdown_connections 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 --2- 172.21.15.46:0/3081692282 >> v2:172.21.15.46:6806/2291706666 conn(0x255ea80 0x2685850 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 --2- 172.21.15.46:0/3081692282 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3e70037210 0x7f3e70039720 unknown :-1 s=CLOSED pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 --2- 172.21.15.46:0/3081692282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x255cbe0 0x2662270 unknown :-1 s=CLOSED pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 >> 172.21.15.46:0/3081692282 conn(0x247a960 msgr2=0x25586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 shutdown_connections 2024-05-08T03:03:41.925 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.920+0000 7f3e90e3cec0 1 -- 172.21.15.46:0/3081692282 wait complete. 2024-05-08T03:03:41.926 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:41.926 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj8 /etc/passwd 2024-05-08T03:03:41.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.961+0000 7f90d842dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.969+0000 7f90d842dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.969+0000 7f90d842dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:41.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.970+0000 7f90d842dec0 1 Processor -- start 2024-05-08T03:03:41.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.970+0000 7f90d842dec0 1 -- start start 2024-05-08T03:03:41.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.972+0000 7f90d842dec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1d0cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.972+0000 7f90d842dec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1bdf950 con 0x1c5f840 2024-05-08T03:03:41.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.972+0000 7f90cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1d0cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.972+0000 7f90cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1d0cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51656/0 (socket says 172.21.15.46:51656) 2024-05-08T03:03:41.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.972+0000 7f90cb7fe640 1 -- 172.21.15.46:0/3844744971 learned_addr learned my addr 172.21.15.46:0/3844744971 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.972+0000 7f90cb7fe640 1 -- 172.21.15.46:0/3844744971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b7e1e0 con 0x1c5f840 2024-05-08T03:03:41.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.972+0000 7f90cb7fe640 1 --2- 172.21.15.46:0/3844744971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1d0cfd0 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7180d738bd621e26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.973+0000 7f90c9ffb640 1 -- 172.21.15.46:0/3844744971 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90bc00b500 con 0x1c5f840 2024-05-08T03:03:41.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.973+0000 7f90c9ffb640 1 -- 172.21.15.46:0/3844744971 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f90bc00b660 con 0x1c5f840 2024-05-08T03:03:41.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.973+0000 7f90c9ffb640 1 -- 172.21.15.46:0/3844744971 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90bc00b900 con 0x1c5f840 2024-05-08T03:03:41.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.973+0000 7f90d842dec0 1 -- 172.21.15.46:0/3844744971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 msgr2=0x1d0cfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.974+0000 7f90d842dec0 1 --2- 172.21.15.46:0/3844744971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1d0cfd0 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.974+0000 7f90d842dec0 1 -- 172.21.15.46:0/3844744971 shutdown_connections 2024-05-08T03:03:41.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.974+0000 7f90d842dec0 1 --2- 172.21.15.46:0/3844744971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1d0cfd0 unknown :-1 s=CLOSED pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.974+0000 7f90d842dec0 1 -- 172.21.15.46:0/3844744971 >> 172.21.15.46:0/3844744971 conn(0x1b96960 msgr2=0x1d100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.974+0000 7f90d842dec0 1 -- 172.21.15.46:0/3844744971 shutdown_connections 2024-05-08T03:03:41.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.974+0000 7f90d842dec0 1 -- 172.21.15.46:0/3844744971 wait complete. 2024-05-08T03:03:41.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.975+0000 7f90d842dec0 1 Processor -- start 2024-05-08T03:03:41.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.975+0000 7f90d842dec0 1 -- start start 2024-05-08T03:03:41.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.976+0000 7f90d842dec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1cf8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.976+0000 7f90d842dec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1bdd3d0 con 0x1c5f840 2024-05-08T03:03:41.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.977+0000 7f90cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1cf8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.977+0000 7f90cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1cf8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51672/0 (socket says 172.21.15.46:51672) 2024-05-08T03:03:41.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.977+0000 7f90cb7fe640 1 -- 172.21.15.46:0/555189255 learned_addr learned my addr 172.21.15.46:0/555189255 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:41.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.977+0000 7f90cb7fe640 1 -- 172.21.15.46:0/555189255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b70e30 con 0x1c5f840 2024-05-08T03:03:41.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.977+0000 7f90cb7fe640 1 --2- 172.21.15.46:0/555189255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1cf8510 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.977+0000 7f90c8ff9640 1 -- 172.21.15.46:0/555189255 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90bc0110b0 con 0x1c5f840 2024-05-08T03:03:41.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.977+0000 7f90c8ff9640 1 -- 172.21.15.46:0/555189255 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f90bc011210 con 0x1c5f840 2024-05-08T03:03:41.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.977+0000 7f90c8ff9640 1 -- 172.21.15.46:0/555189255 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f90bc011ab0 con 0x1c5f840 2024-05-08T03:03:41.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.977+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1b70890 con 0x1c5f840 2024-05-08T03:03:41.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.978+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1cfa9c0 con 0x1c5f840 2024-05-08T03:03:41.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.979+0000 7f90c8ff9640 1 -- 172.21.15.46:0/555189255 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f90bc011c60 con 0x1c5f840 2024-05-08T03:03:41.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.979+0000 7f90c8ff9640 1 --2- 172.21.15.46:0/555189255 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f90b8037210 0x7f90b8039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.979+0000 7f90c8ff9640 1 -- 172.21.15.46:0/555189255 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7f90bc048d70 con 0x1c5f840 2024-05-08T03:03:41.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.979+0000 7f90d842dec0 1 --2- 172.21.15.46:0/555189255 >> v2:172.21.15.46:6806/2291706666 conn(0x1c78fa0 0x1cf8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:41.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.979+0000 7f90caffd640 1 --2- 172.21.15.46:0/555189255 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f90b8037210 0x7f90b8039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:41.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.979+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:1 201.5 201:a557efb1:::obj8:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x21a89e0 con 0x1c78fa0 2024-05-08T03:03:41.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.980+0000 7f90caffd640 1 --2- 172.21.15.46:0/555189255 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f90b8037210 0x7f90b8039720 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.980+0000 7f90cbfff640 1 --2- 172.21.15.46:0/555189255 >> v2:172.21.15.46:6806/2291706666 conn(0x1c78fa0 0x1cf8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:41.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.984+0000 7f90cbfff640 1 --2- 172.21.15.46:0/555189255 >> v2:172.21.15.46:6806/2291706666 conn(0x1c78fa0 0x1cf8f60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:41.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90cbfff640 1 -- 172.21.15.46:0/555189255 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(1 obj8 [writefull 0~11982] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f90c400a430 con 0x1c78fa0 2024-05-08T03:03:41.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 >> v2:172.21.15.46:6806/2291706666 conn(0x1c78fa0 msgr2=0x1cf8f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 --2- 172.21.15.46:0/555189255 >> v2:172.21.15.46:6806/2291706666 conn(0x1c78fa0 0x1cf8f60 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f90b8037210 msgr2=0x7f90b8039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 --2- 172.21.15.46:0/555189255 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f90b8037210 0x7f90b8039720 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 msgr2=0x1cf8510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 --2- 172.21.15.46:0/555189255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1cf8510 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 shutdown_connections 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 --2- 172.21.15.46:0/555189255 >> v2:172.21.15.46:6806/2291706666 conn(0x1c78fa0 0x1cf8f60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 --2- 172.21.15.46:0/555189255 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f90b8037210 0x7f90b8039720 unknown :-1 s=CLOSED pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 --2- 172.21.15.46:0/555189255 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x1c5f840 0x1cf8510 unknown :-1 s=CLOSED pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 >> 172.21.15.46:0/555189255 conn(0x1b96960 msgr2=0x1d100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 shutdown_connections 2024-05-08T03:03:41.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:41.994+0000 7f90d842dec0 1 -- 172.21.15.46:0/555189255 wait complete. 2024-05-08T03:03:42.001 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:42.001 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj9 /etc/passwd 2024-05-08T03:03:42.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.034+0000 7fb10082eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:42.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.039+0000 7fb10082eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:42.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.040+0000 7fb10082eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:42.044 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.040+0000 7fb10082eec0 1 Processor -- start 2024-05-08T03:03:42.044 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.040+0000 7fb10082eec0 1 -- start start 2024-05-08T03:03:42.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.042+0000 7fb10082eec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xbb21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:42.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.042+0000 7fb10082eec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0xa00950 con 0xa99be0 2024-05-08T03:03:42.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.042+0000 7fb0f899b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xbb21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:42.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.042+0000 7fb0f899b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xbb21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51690/0 (socket says 172.21.15.46:51690) 2024-05-08T03:03:42.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.042+0000 7fb0f899b640 1 -- 172.21.15.46:0/172985162 learned_addr learned my addr 172.21.15.46:0/172985162 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:42.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.042+0000 7fb0f899b640 1 -- 172.21.15.46:0/172985162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x99f1e0 con 0xa99be0 2024-05-08T03:03:42.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.042+0000 7fb0f899b640 1 --2- 172.21.15.46:0/172985162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xbb21f0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ce4168211c2a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:42.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb0f2ffd640 1 -- 172.21.15.46:0/172985162 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb0e400b500 con 0xa99be0 2024-05-08T03:03:42.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb0f2ffd640 1 -- 172.21.15.46:0/172985162 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb0e400b660 con 0xa99be0 2024-05-08T03:03:42.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb0f2ffd640 1 -- 172.21.15.46:0/172985162 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb0e400b900 con 0xa99be0 2024-05-08T03:03:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb10082eec0 1 -- 172.21.15.46:0/172985162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 msgr2=0xbb21f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb10082eec0 1 --2- 172.21.15.46:0/172985162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xbb21f0 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb10082eec0 1 -- 172.21.15.46:0/172985162 shutdown_connections 2024-05-08T03:03:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb10082eec0 1 --2- 172.21.15.46:0/172985162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xbb21f0 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb10082eec0 1 -- 172.21.15.46:0/172985162 >> 172.21.15.46:0/172985162 conn(0x9b7960 msgr2=0xbb5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb10082eec0 1 -- 172.21.15.46:0/172985162 shutdown_connections 2024-05-08T03:03:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.043+0000 7fb10082eec0 1 -- 172.21.15.46:0/172985162 wait complete. 2024-05-08T03:03:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.044+0000 7fb10082eec0 1 Processor -- start 2024-05-08T03:03:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.044+0000 7fb10082eec0 1 -- start start 2024-05-08T03:03:42.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb10082eec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xb9fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:42.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb10082eec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x9fe3d0 con 0xa99be0 2024-05-08T03:03:42.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb0f899b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xb9fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:42.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb0f899b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xb9fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51702/0 (socket says 172.21.15.46:51702) 2024-05-08T03:03:42.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb0f899b640 1 -- 172.21.15.46:0/574499389 learned_addr learned my addr 172.21.15.46:0/574499389 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:42.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb0f899b640 1 -- 172.21.15.46:0/574499389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x991e30 con 0xa99be0 2024-05-08T03:03:42.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb0f899b640 1 --2- 172.21.15.46:0/574499389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xb9fe30 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:42.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb0f1ffb640 1 -- 172.21.15.46:0/574499389 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb0e4012b10 con 0xa99be0 2024-05-08T03:03:42.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb0f1ffb640 1 -- 172.21.15.46:0/574499389 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb0e4005040 con 0xa99be0 2024-05-08T03:03:42.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x991890 con 0xa99be0 2024-05-08T03:03:42.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb0f1ffb640 1 -- 172.21.15.46:0/574499389 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb0e4012da0 con 0xa99be0 2024-05-08T03:03:42.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.046+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0xba13a0 con 0xa99be0 2024-05-08T03:03:42.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.047+0000 7fb0f1ffb640 1 -- 172.21.15.46:0/574499389 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb0e400d040 con 0xa99be0 2024-05-08T03:03:42.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.048+0000 7fb0f1ffb640 1 --2- 172.21.15.46:0/574499389 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0d4037210 0x7fb0d4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:42.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.048+0000 7fb0f1ffb640 1 -- 172.21.15.46:0/574499389 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7fb0e400a040 con 0xa99be0 2024-05-08T03:03:42.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.048+0000 7fb10082eec0 1 --2- 172.21.15.46:0/574499389 >> v2:172.21.15.80:6807/3216858417 conn(0xa9bc50 0xbc23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:42.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.048+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 --> v2:172.21.15.80:6807/3216858417 -- osd_op(unknown.0.0:1 201.7 201:fe351e27:::obj9:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0xba3340 con 0xa9bc50 2024-05-08T03:03:42.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.048+0000 7fb0ebfff640 1 --2- 172.21.15.46:0/574499389 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0d4037210 0x7fb0d4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:42.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.049+0000 7fb0ebfff640 1 --2- 172.21.15.46:0/574499389 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0d4037210 0x7fb0d4039720 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:42.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.049+0000 7fb0f919c640 1 --2- 172.21.15.46:0/574499389 >> v2:172.21.15.80:6807/3216858417 conn(0xa9bc50 0xbc23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:42.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.053+0000 7fb0f919c640 1 --2- 172.21.15.46:0/574499389 >> v2:172.21.15.80:6807/3216858417 conn(0xa9bc50 0xbc23d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.063+0000 7fb0f919c640 1 -- 172.21.15.46:0/574499389 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== osd_op_reply(1 obj9 [writefull 0~11982] v706'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb0ec00a430 con 0xa9bc50 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 >> v2:172.21.15.80:6807/3216858417 conn(0xa9bc50 msgr2=0xbc23d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 --2- 172.21.15.46:0/574499389 >> v2:172.21.15.80:6807/3216858417 conn(0xa9bc50 0xbc23d0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0d4037210 msgr2=0x7fb0d4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 --2- 172.21.15.46:0/574499389 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0d4037210 0x7fb0d4039720 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 msgr2=0xb9fe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 --2- 172.21.15.46:0/574499389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xb9fe30 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 shutdown_connections 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 --2- 172.21.15.46:0/574499389 >> v2:172.21.15.80:6807/3216858417 conn(0xa9bc50 0xbc23d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 --2- 172.21.15.46:0/574499389 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb0d4037210 0x7fb0d4039720 unknown :-1 s=CLOSED pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 --2- 172.21.15.46:0/574499389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0xa99be0 0xb9fe30 unknown :-1 s=CLOSED pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 >> 172.21.15.46:0/574499389 conn(0x9b7960 msgr2=0xbb5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:42.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 shutdown_connections 2024-05-08T03:03:42.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.064+0000 7fb10082eec0 1 -- 172.21.15.46:0/574499389 wait complete. 2024-05-08T03:03:42.069 INFO:tasks.workunit.client.0.smithi046.stderr:+ for f in `seq 1 10` 2024-05-08T03:03:42.070 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 048b0735-bafe-474a-b306-d0d41d70737f put obj10 /etc/passwd 2024-05-08T03:03:42.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.119+0000 7f640e42fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:42.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.127+0000 7f640e42fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:42.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.128+0000 7f640e42fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:03:42.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.129+0000 7f640e42fec0 1 Processor -- start 2024-05-08T03:03:42.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.129+0000 7f640e42fec0 1 -- start start 2024-05-08T03:03:42.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.130+0000 7f640e42fec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x1925c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:42.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.130+0000 7f640e42fec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x1771950 con 0x180a0d0 2024-05-08T03:03:42.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.130+0000 7f6405d9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x1925c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:42.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.130+0000 7f6405d9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x1925c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51730/0 (socket says 172.21.15.46:51730) 2024-05-08T03:03:42.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.130+0000 7f6405d9a640 1 -- 172.21.15.46:0/3803719165 learned_addr learned my addr 172.21.15.46:0/3803719165 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:42.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.131+0000 7f6405d9a640 1 -- 172.21.15.46:0/3803719165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17101e0 con 0x180a0d0 2024-05-08T03:03:42.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.131+0000 7f6405d9a640 1 --2- 172.21.15.46:0/3803719165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x1925c20 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5011a8bc32cf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:42.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.131+0000 7f63f7fff640 1 -- 172.21.15.46:0/3803719165 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f63fc0077c0 con 0x180a0d0 2024-05-08T03:03:42.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.131+0000 7f63f7fff640 1 -- 172.21.15.46:0/3803719165 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f63fc007920 con 0x180a0d0 2024-05-08T03:03:42.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.131+0000 7f63f7fff640 1 -- 172.21.15.46:0/3803719165 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f63fc007bc0 con 0x180a0d0 2024-05-08T03:03:42.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.132+0000 7f640e42fec0 1 -- 172.21.15.46:0/3803719165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 msgr2=0x1925c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:42.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.132+0000 7f640e42fec0 1 --2- 172.21.15.46:0/3803719165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x1925c20 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.132+0000 7f640e42fec0 1 -- 172.21.15.46:0/3803719165 shutdown_connections 2024-05-08T03:03:42.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.132+0000 7f640e42fec0 1 --2- 172.21.15.46:0/3803719165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x1925c20 unknown :-1 s=CLOSED pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.132+0000 7f640e42fec0 1 -- 172.21.15.46:0/3803719165 >> 172.21.15.46:0/3803719165 conn(0x1728960 msgr2=0x180eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:42.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.132+0000 7f640e42fec0 1 -- 172.21.15.46:0/3803719165 shutdown_connections 2024-05-08T03:03:42.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.132+0000 7f640e42fec0 1 -- 172.21.15.46:0/3803719165 wait complete. 2024-05-08T03:03:42.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.133+0000 7f640e42fec0 1 Processor -- start 2024-05-08T03:03:42.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.133+0000 7f640e42fec0 1 -- start start 2024-05-08T03:03:42.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.134+0000 7f640e42fec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x190ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:42.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.134+0000 7f640e42fec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x176f3d0 con 0x180a0d0 2024-05-08T03:03:42.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f6405d9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x190ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:42.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f6405d9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x190ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51744/0 (socket says 172.21.15.46:51744) 2024-05-08T03:03:42.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f6405d9a640 1 -- 172.21.15.46:0/4171340515 learned_addr learned my addr 172.21.15.46:0/4171340515 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:03:42.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f6405d9a640 1 -- 172.21.15.46:0/4171340515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1702e30 con 0x180a0d0 2024-05-08T03:03:42.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f6405d9a640 1 --2- 172.21.15.46:0/4171340515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x190ceb0 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:42.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f63f6ffd640 1 -- 172.21.15.46:0/4171340515 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f63fc039040 con 0x180a0d0 2024-05-08T03:03:42.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f63f6ffd640 1 -- 172.21.15.46:0/4171340515 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f63fc034740 con 0x180a0d0 2024-05-08T03:03:42.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1702890 con 0x180a0d0 2024-05-08T03:03:42.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f63f6ffd640 1 -- 172.21.15.46:0/4171340515 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f63fc0349e0 con 0x180a0d0 2024-05-08T03:03:42.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.135+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1926050 con 0x180a0d0 2024-05-08T03:03:42.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.136+0000 7f63f6ffd640 1 -- 172.21.15.46:0/4171340515 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f63fc034b90 con 0x180a0d0 2024-05-08T03:03:42.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.136+0000 7f63f6ffd640 1 --2- 172.21.15.46:0/4171340515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f63e4037210 0x7f63e4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:42.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.137+0000 7f63f6ffd640 1 -- 172.21.15.46:0/4171340515 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(706..706 src has 611..706) ==== 4179+0+0 (crc 0 0 0) 0x7f63fc06d310 con 0x180a0d0 2024-05-08T03:03:42.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.137+0000 7f640e42fec0 1 --2- 172.21.15.46:0/4171340515 >> v2:172.21.15.46:6806/2291706666 conn(0x180a4e0 0x1931370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:03:42.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.137+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 --> v2:172.21.15.46:6806/2291706666 -- osd_op(unknown.0.0:1 201.b 201:d1337354:::obj10:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x19318b0 con 0x180a4e0 2024-05-08T03:03:42.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.137+0000 7f6405599640 1 --2- 172.21.15.46:0/4171340515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f63e4037210 0x7f63e4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:03:42.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.137+0000 7f6405599640 1 --2- 172.21.15.46:0/4171340515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f63e4037210 0x7f63e4039720 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:42.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.138+0000 7f640659b640 1 --2- 172.21.15.46:0/4171340515 >> v2:172.21.15.46:6806/2291706666 conn(0x180a4e0 0x1931370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:03:42.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.141+0000 7f640659b640 1 --2- 172.21.15.46:0/4171340515 >> v2:172.21.15.46:6806/2291706666 conn(0x180a4e0 0x1931370 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:03:42.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640659b640 1 -- 172.21.15.46:0/4171340515 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== osd_op_reply(1 obj10 [writefull 0~11982] v706'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f63f800a430 con 0x180a4e0 2024-05-08T03:03:42.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 >> v2:172.21.15.46:6806/2291706666 conn(0x180a4e0 msgr2=0x1931370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:42.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 --2- 172.21.15.46:0/4171340515 >> v2:172.21.15.46:6806/2291706666 conn(0x180a4e0 0x1931370 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f63e4037210 msgr2=0x7f63e4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:42.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 --2- 172.21.15.46:0/4171340515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f63e4037210 0x7f63e4039720 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 msgr2=0x190ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:03:42.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 --2- 172.21.15.46:0/4171340515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x190ceb0 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 shutdown_connections 2024-05-08T03:03:42.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 --2- 172.21.15.46:0/4171340515 >> v2:172.21.15.46:6806/2291706666 conn(0x180a4e0 0x1931370 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 --2- 172.21.15.46:0/4171340515 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f63e4037210 0x7f63e4039720 unknown :-1 s=CLOSED pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 --2- 172.21.15.46:0/4171340515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x180a0d0 0x190ceb0 unknown :-1 s=CLOSED pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:03:42.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 >> 172.21.15.46:0/4171340515 conn(0x1728960 msgr2=0x180eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:03:42.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 shutdown_connections 2024-05-08T03:03:42.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:03:42.152+0000 7f640e42fec0 1 -- 172.21.15.46:0/4171340515 wait complete. 2024-05-08T03:03:42.160 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-05-08T03:04:12.160 INFO:tasks.workunit.client.0.smithi046.stderr:+ rados -p 008ce654-4211-4a2d-8916-631643828e06 put threemore /etc/passwd 2024-05-08T03:04:12.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.202+0000 7f8300630ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:12.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.208+0000 7f8300630ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:12.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.209+0000 7f8300630ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:12.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.210+0000 7f8300630ec0 1 Processor -- start 2024-05-08T03:04:12.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.210+0000 7f8300630ec0 1 -- start start 2024-05-08T03:04:12.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.211+0000 7f8300630ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:12.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.211+0000 7f8300630ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x240c950 con 0x248c840 2024-05-08T03:04:12.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.211+0000 7f82f37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:12.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.211+0000 7f82f37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52002/0 (socket says 172.21.15.46:52002) 2024-05-08T03:04:12.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.211+0000 7f82f37fe640 1 -- 172.21.15.46:0/647121839 learned_addr learned my addr 172.21.15.46:0/647121839 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:12.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.212+0000 7f82f37fe640 1 -- 172.21.15.46:0/647121839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x23ab1e0 con 0x248c840 2024-05-08T03:04:12.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.212+0000 7f82f37fe640 1 --2- 172.21.15.46:0/647121839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25c4ab0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d2b0d89567a828 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:12.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.212+0000 7f82f1ffb640 1 -- 172.21.15.46:0/647121839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82e40334a0 con 0x248c840 2024-05-08T03:04:12.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.212+0000 7f82f1ffb640 1 -- 172.21.15.46:0/647121839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f82e4033600 con 0x248c840 2024-05-08T03:04:12.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.212+0000 7f82f1ffb640 1 -- 172.21.15.46:0/647121839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82e40338a0 con 0x248c840 2024-05-08T03:04:12.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.213+0000 7f8300630ec0 1 -- 172.21.15.46:0/647121839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 msgr2=0x25c4ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:12.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.213+0000 7f8300630ec0 1 --2- 172.21.15.46:0/647121839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25c4ab0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.213+0000 7f8300630ec0 1 -- 172.21.15.46:0/647121839 shutdown_connections 2024-05-08T03:04:12.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.213+0000 7f8300630ec0 1 --2- 172.21.15.46:0/647121839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25c4ab0 unknown :-1 s=CLOSED pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.213+0000 7f8300630ec0 1 -- 172.21.15.46:0/647121839 >> 172.21.15.46:0/647121839 conn(0x23c3960 msgr2=0x249d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:12.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.213+0000 7f8300630ec0 1 -- 172.21.15.46:0/647121839 shutdown_connections 2024-05-08T03:04:12.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.213+0000 7f8300630ec0 1 -- 172.21.15.46:0/647121839 wait complete. 2024-05-08T03:04:12.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.214+0000 7f8300630ec0 1 Processor -- start 2024-05-08T03:04:12.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.214+0000 7f8300630ec0 1 -- start start 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.215+0000 7f8300630ec0 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25234b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.215+0000 7f8300630ec0 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x240a3d0 con 0x248c840 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f82f37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f82f37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25234b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52008/0 (socket says 172.21.15.46:52008) 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f82f37fe640 1 -- 172.21.15.46:0/1791362636 learned_addr learned my addr 172.21.15.46:0/1791362636 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f82f37fe640 1 -- 172.21.15.46:0/1791362636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x239de30 con 0x248c840 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f82f37fe640 1 --2- 172.21.15.46:0/1791362636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25234b0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f82f0ff9640 1 -- 172.21.15.46:0/1791362636 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82e403b040 con 0x248c840 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f82f0ff9640 1 -- 172.21.15.46:0/1791362636 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f82e4035450 con 0x248c840 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x239d890 con 0x248c840 2024-05-08T03:04:12.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f82f0ff9640 1 -- 172.21.15.46:0/1791362636 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f82e40356f0 con 0x248c840 2024-05-08T03:04:12.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.216+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x253d160 con 0x248c840 2024-05-08T03:04:12.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.217+0000 7f82f0ff9640 1 -- 172.21.15.46:0/1791362636 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f82e4003040 con 0x248c840 2024-05-08T03:04:12.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.218+0000 7f82f0ff9640 1 --2- 172.21.15.46:0/1791362636 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f82e0037210 0x7f82e0039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:12.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.218+0000 7f82f0ff9640 1 -- 172.21.15.46:0/1791362636 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(708..708 src has 611..708) ==== 4179+0+0 (crc 0 0 0) 0x7f82e403a040 con 0x248c840 2024-05-08T03:04:12.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.218+0000 7f82f0ff9640 1 -- 172.21.15.46:0/1791362636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f82e003dc20 con 0x248c840 2024-05-08T03:04:12.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.218+0000 7f8300630ec0 1 --2- 172.21.15.46:0/1791362636 >> v2:172.21.15.80:6805/1892248062 conn(0x24a5dd0 0x253be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:12.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.218+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 --> v2:172.21.15.80:6805/1892248062 -- osd_op(unknown.0.0:1 200.2 200:47cad802:::threemore:head [writefull 0~11982 in=11982b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e708) -- 0x252b400 con 0x24a5dd0 2024-05-08T03:04:12.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.218+0000 7f82f2ffd640 1 --2- 172.21.15.46:0/1791362636 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f82e0037210 0x7f82e0039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:12.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.219+0000 7f82f2ffd640 1 --2- 172.21.15.46:0/1791362636 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f82e0037210 0x7f82e0039720 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:12.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.219+0000 7f82f8f9c640 1 --2- 172.21.15.46:0/1791362636 >> v2:172.21.15.80:6805/1892248062 conn(0x24a5dd0 0x253be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:04:12.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.222+0000 7f82f8f9c640 1 --2- 172.21.15.46:0/1791362636 >> v2:172.21.15.80:6805/1892248062 conn(0x24a5dd0 0x253be10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:12.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f82f8f9c640 1 -- 172.21.15.46:0/1791362636 <== osd.2 v2:172.21.15.80:6805/1892248062 1 ==== osd_op_reply(1 threemore [writefull 0~11982] v708'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f82ec00c430 con 0x24a5dd0 2024-05-08T03:04:12.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 >> v2:172.21.15.80:6805/1892248062 conn(0x24a5dd0 msgr2=0x253be10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 --2- 172.21.15.46:0/1791362636 >> v2:172.21.15.80:6805/1892248062 conn(0x24a5dd0 0x253be10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f82e0037210 msgr2=0x7f82e0039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 --2- 172.21.15.46:0/1791362636 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f82e0037210 0x7f82e0039720 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 msgr2=0x25234b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 --2- 172.21.15.46:0/1791362636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25234b0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 shutdown_connections 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 --2- 172.21.15.46:0/1791362636 >> v2:172.21.15.80:6805/1892248062 conn(0x24a5dd0 0x253be10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 --2- 172.21.15.46:0/1791362636 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f82e0037210 0x7f82e0039720 unknown :-1 s=CLOSED pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 --2- 172.21.15.46:0/1791362636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x248c840 0x25234b0 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 >> 172.21.15.46:0/1791362636 conn(0x23c3960 msgr2=0x249d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 shutdown_connections 2024-05-08T03:04:12.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.234+0000 7f8300630ec0 1 -- 172.21.15.46:0/1791362636 wait complete. 2024-05-08T03:04:12.240 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota 008ce654-4211-4a2d-8916-631643828e06 max_bytes 0 2024-05-08T03:04:12.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.329+0000 7f4ab479d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:12.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.339+0000 7f4ab479d640 1 Processor -- start 2024-05-08T03:04:12.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.339+0000 7f4ab479d640 1 -- start start 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab479d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4aac135060 0x7f4aac135470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab479d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aac1359b0 con 0x7f4aac0a25b0 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab479d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f4aac09be70 con 0x7f4aac135060 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab2539640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4aac135060 0x7f4aac135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab1d38640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4aac0a25b0 0x7f4aac0a29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39664/0 (socket says 172.21.15.46:39664) 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab1d38640 1 -- 172.21.15.46:0/387713552 learned_addr learned my addr 172.21.15.46:0/387713552 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab2539640 1 -- 172.21.15.46:0/387713552 >> v1:172.21.15.46:6789/0 conn(0x7f4aac0a25b0 legacy=0x7f4aac0a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab2539640 1 -- 172.21.15.46:0/387713552 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac134c30 con 0x7f4aac135060 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab2539640 1 --2- 172.21.15.46:0/387713552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac135060 0x7f4aac135470 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba07221f6c9b800 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:12.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab1537640 1 -- 172.21.15.46:0/387713552 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a9c009d90 con 0x7f4aac135060 2024-05-08T03:04:12.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab1537640 1 -- 172.21.15.46:0/387713552 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4a9c00e230 con 0x7f4aac135060 2024-05-08T03:04:12.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.341+0000 7f4ab1537640 1 -- 172.21.15.46:0/387713552 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a9c00e4d0 con 0x7f4aac135060 2024-05-08T03:04:12.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.342+0000 7f4ab479d640 1 -- 172.21.15.46:0/387713552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac135060 msgr2=0x7f4aac135470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:12.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.342+0000 7f4ab479d640 1 --2- 172.21.15.46:0/387713552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac135060 0x7f4aac135470 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.342+0000 7f4ab479d640 1 -- 172.21.15.46:0/387713552 shutdown_connections 2024-05-08T03:04:12.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.342+0000 7f4ab479d640 1 --2- 172.21.15.46:0/387713552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac135060 0x7f4aac135470 unknown :-1 s=CLOSED pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:12.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.342+0000 7f4ab479d640 1 -- 172.21.15.46:0/387713552 >> 172.21.15.46:0/387713552 conn(0x7f4aac06d420 msgr2=0x7f4aac06d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:12.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.342+0000 7f4ab479d640 1 -- 172.21.15.46:0/387713552 shutdown_connections 2024-05-08T03:04:12.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.342+0000 7f4ab479d640 1 -- 172.21.15.46:0/387713552 wait complete. 2024-05-08T03:04:12.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.343+0000 7f4ab479d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:12.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.344+0000 7f4ab479d640 1 Processor -- start 2024-05-08T03:04:12.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.344+0000 7f4ab479d640 1 -- start start 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.346+0000 7f4ab479d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac0a25b0 0x7f4aac09e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.346+0000 7f4ab479d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac11d3f0 con 0x7f4aac0a25b0 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.346+0000 7f4ab2539640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac0a25b0 0x7f4aac09e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.346+0000 7f4ab2539640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac0a25b0 0x7f4aac09e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52026/0 (socket says 172.21.15.46:52026) 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.346+0000 7f4ab2539640 1 -- 172.21.15.46:0/3865183367 learned_addr learned my addr 172.21.15.46:0/3865183367 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.346+0000 7f4ab2539640 1 -- 172.21.15.46:0/3865183367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac0a0350 con 0x7f4aac0a25b0 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.346+0000 7f4ab2539640 1 --2- 172.21.15.46:0/3865183367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac0a25b0 0x7f4aac09e6f0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.347+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a9c014540 con 0x7f4aac0a25b0 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.347+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4a9c0146a0 con 0x7f4aac0a25b0 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.347+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac12ee40 con 0x7f4aac0a25b0 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.347+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a9c014940 con 0x7f4aac0a25b0 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.347+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac11dab0 con 0x7f4aac0a25b0 2024-05-08T03:04:12.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.348+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4a9c014b40 con 0x7f4aac0a25b0 2024-05-08T03:04:12.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.348+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac09fc20 con 0x7f4aac0a25b0 2024-05-08T03:04:12.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.348+0000 7f4aa2ffd640 1 --2- 172.21.15.46:0/3865183367 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4a90038930 0x7f4a9003ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:12.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.348+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(708..708 src has 611..708) ==== 4179+0+0 (crc 0 0 0) 0x7f4a9c019040 con 0x7f4aac0a25b0 2024-05-08T03:04:12.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.348+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f4a9003f2e0 con 0x7f4aac0a25b0 2024-05-08T03:04:12.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.348+0000 7f4ab1d38640 1 --2- 172.21.15.46:0/3865183367 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4a90038930 0x7f4a9003ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:12.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.349+0000 7f4ab1d38640 1 --2- 172.21.15.46:0/3865183367 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4a90038930 0x7f4a9003ae40 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:12.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.353+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f4a9c018190 con 0x7f4aac0a25b0 2024-05-08T03:04:12.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:12.538+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "0"} v 0) -- 0x7f4aac11ef80 con 0x7f4aac0a25b0 2024-05-08T03:04:13.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:13.339+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 v709) ==== 217+0+0 (crc 0 0 0) 0x7f4a9c001d40 con 0x7f4aac0a25b0 2024-05-08T03:04:13.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:13.343+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(709..709 src has 611..709) ==== 628+0+0 (crc 0 0 0) 0x7f4a9c00be60 con 0x7f4aac0a25b0 2024-05-08T03:04:13.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:13.343+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7f4a90040060 con 0x7f4aac0a25b0 2024-05-08T03:04:13.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:13.552+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "0"} v 0) -- 0x7f4aac11d1f0 con 0x7f4aac0a25b0 2024-05-08T03:04:14.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.342+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 v710) ==== 217+0+0 (crc 0 0 0) 0x7f4a9c00fb30 con 0x7f4aac0a25b0 2024-05-08T03:04:14.346 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_bytes = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 2024-05-08T03:04:14.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.342+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(710..710 src has 611..710) ==== 628+0+0 (crc 0 0 0) 0x7f4a9c010310 con 0x7f4aac0a25b0 2024-05-08T03:04:14.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.342+0000 7f4aa2ffd640 1 -- 172.21.15.46:0/3865183367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=711}) -- 0x7f4a90040340 con 0x7f4aac0a25b0 2024-05-08T03:04:14.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4a90038930 msgr2=0x7f4a9003ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:14.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 --2- 172.21.15.46:0/3865183367 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4a90038930 0x7f4a9003ae40 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:14.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac0a25b0 msgr2=0x7f4aac09e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:14.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 --2- 172.21.15.46:0/3865183367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac0a25b0 0x7f4aac09e6f0 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:14.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 shutdown_connections 2024-05-08T03:04:14.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 --2- 172.21.15.46:0/3865183367 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4a90038930 0x7f4a9003ae40 unknown :-1 s=CLOSED pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:14.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 --2- 172.21.15.46:0/3865183367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4aac0a25b0 0x7f4aac09e6f0 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:14.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 >> 172.21.15.46:0/3865183367 conn(0x7f4aac06d420 msgr2=0x7f4aac1328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:14.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 shutdown_connections 2024-05-08T03:04:14.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.345+0000 7f4ab479d640 1 -- 172.21.15.46:0/3865183367 wait complete. 2024-05-08T03:04:14.360 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool set-quota 008ce654-4211-4a2d-8916-631643828e06 max_objects 0 2024-05-08T03:04:14.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.444+0000 7fcda24ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:14.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.454+0000 7fcda24ad640 1 Processor -- start 2024-05-08T03:04:14.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.454+0000 7fcda24ad640 1 -- start start 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcda24ad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcd9c06dff0 0x7fcd9c0a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcda24ad640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9c09f110 con 0x7fcd9c0a2bf0 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcda24ad640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fcd9c09dfd0 con 0x7fcd9c06dff0 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcd9bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcd9c06dff0 0x7fcd9c0a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcd9b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcd9c0a2bf0 0x7fcd9c139490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:32780/0 (socket says 172.21.15.46:32780) 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcd9b7fe640 1 -- 172.21.15.46:0/3913964179 learned_addr learned my addr 172.21.15.46:0/3913964179 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcd9bfff640 1 -- 172.21.15.46:0/3913964179 >> v1:172.21.15.46:6789/0 conn(0x7fcd9c0a2bf0 legacy=0x7fcd9c139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcd9bfff640 1 -- 172.21.15.46:0/3913964179 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9c0a0280 con 0x7fcd9c06dff0 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcd9bfff640 1 --2- 172.21.15.46:0/3913964179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 0x7fcd9c0a26b0 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e5d4930e397657 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcd9affd640 1 -- 172.21.15.46:0/3913964179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd8c009d90 con 0x7fcd9c06dff0 2024-05-08T03:04:14.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcd9affd640 1 -- 172.21.15.46:0/3913964179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcd8c00e230 con 0x7fcd9c06dff0 2024-05-08T03:04:14.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.456+0000 7fcd9affd640 1 -- 172.21.15.46:0/3913964179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd8c00e4d0 con 0x7fcd9c06dff0 2024-05-08T03:04:14.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.457+0000 7fcda24ad640 1 -- 172.21.15.46:0/3913964179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 msgr2=0x7fcd9c0a26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:14.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.457+0000 7fcda24ad640 1 --2- 172.21.15.46:0/3913964179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 0x7fcd9c0a26b0 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:14.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.457+0000 7fcda24ad640 1 -- 172.21.15.46:0/3913964179 shutdown_connections 2024-05-08T03:04:14.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.457+0000 7fcda24ad640 1 --2- 172.21.15.46:0/3913964179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 0x7fcd9c0a26b0 unknown :-1 s=CLOSED pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:14.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.457+0000 7fcda24ad640 1 -- 172.21.15.46:0/3913964179 >> 172.21.15.46:0/3913964179 conn(0x7fcd9c06d4d0 msgr2=0x7fcd9c06d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:14.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.457+0000 7fcda24ad640 1 -- 172.21.15.46:0/3913964179 shutdown_connections 2024-05-08T03:04:14.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.457+0000 7fcda24ad640 1 -- 172.21.15.46:0/3913964179 wait complete. 2024-05-08T03:04:14.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.457+0000 7fcda24ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:14.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.459+0000 7fcda24ad640 1 Processor -- start 2024-05-08T03:04:14.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.459+0000 7fcda24ad640 1 -- start start 2024-05-08T03:04:14.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.461+0000 7fcda24ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 0x7fcd9c1ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:14.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.461+0000 7fcda24ad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c1acd80 con 0x7fcd9c06dff0 2024-05-08T03:04:14.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.461+0000 7fcd9bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 0x7fcd9c1ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:14.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.461+0000 7fcd9bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 0x7fcd9c1ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47680/0 (socket says 172.21.15.46:47680) 2024-05-08T03:04:14.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.461+0000 7fcd9bfff640 1 -- 172.21.15.46:0/3244187258 learned_addr learned my addr 172.21.15.46:0/3244187258 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:14.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.461+0000 7fcd9bfff640 1 -- 172.21.15.46:0/3244187258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9c1abfe0 con 0x7fcd9c06dff0 2024-05-08T03:04:14.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.462+0000 7fcd9bfff640 1 --2- 172.21.15.46:0/3244187258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 0x7fcd9c1ad080 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:14.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.462+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd8c014620 con 0x7fcd9c06dff0 2024-05-08T03:04:14.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.462+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcd8c014780 con 0x7fcd9c06dff0 2024-05-08T03:04:14.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.462+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9c1ad7a0 con 0x7fcd9c06dff0 2024-05-08T03:04:14.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.462+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcd8c014a20 con 0x7fcd9c06dff0 2024-05-08T03:04:14.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.462+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9c1aca70 con 0x7fcd9c06dff0 2024-05-08T03:04:14.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.463+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fcd8c014bd0 con 0x7fcd9c06dff0 2024-05-08T03:04:14.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.463+0000 7fcd98ff9640 1 --2- 172.21.15.46:0/3244187258 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fcd88038980 0x7fcd8803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:14.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.463+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd9c09fed0 con 0x7fcd9c06dff0 2024-05-08T03:04:14.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.463+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(710..710 src has 611..710) ==== 4179+0+0 (crc 0 0 0) 0x7fcd8c019040 con 0x7fcd9c06dff0 2024-05-08T03:04:14.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.463+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=711}) -- 0x7fcd8803f330 con 0x7fcd9c06dff0 2024-05-08T03:04:14.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.463+0000 7fcd9b7fe640 1 --2- 172.21.15.46:0/3244187258 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fcd88038980 0x7fcd8803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:14.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.464+0000 7fcd9b7fe640 1 --2- 172.21.15.46:0/3244187258 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fcd88038980 0x7fcd8803ae90 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:14.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.468+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fcd8c012390 con 0x7fcd9c06dff0 2024-05-08T03:04:14.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:14.659+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "0"} v 0) -- 0x7fcd9c069870 con 0x7fcd9c06dff0 2024-05-08T03:04:15.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:15.346+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 v711) ==== 221+0+0 (crc 0 0 0) 0x7fcd8c010310 con 0x7fcd9c06dff0 2024-05-08T03:04:15.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:15.346+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(711..711 src has 611..711) ==== 628+0+0 (crc 0 0 0) 0x7fcd8c013e40 con 0x7fcd9c06dff0 2024-05-08T03:04:15.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:15.346+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=712}) -- 0x7fcd88040360 con 0x7fcd9c06dff0 2024-05-08T03:04:15.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:15.461+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "0"} v 0) -- 0x7fcd9c0008d0 con 0x7fcd9c06dff0 2024-05-08T03:04:16.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.347+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "008ce654-4211-4a2d-8916-631643828e06", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 v712) ==== 221+0+0 (crc 0 0 0) 0x7fcd8c00f2a0 con 0x7fcd9c06dff0 2024-05-08T03:04:16.351 INFO:tasks.workunit.client.0.smithi046.stderr:set-quota max_objects = 0 for pool 008ce654-4211-4a2d-8916-631643828e06 2024-05-08T03:04:16.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.347+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 <== mon.0 v2:172.21.15.46:3300/0 10 ==== osd_map(712..712 src has 611..712) ==== 628+0+0 (crc 0 0 0) 0x7fcd8c0104d0 con 0x7fcd9c06dff0 2024-05-08T03:04:16.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.347+0000 7fcd98ff9640 1 -- 172.21.15.46:0/3244187258 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7fcd88040410 con 0x7fcd9c06dff0 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fcd88038980 msgr2=0x7fcd8803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 --2- 172.21.15.46:0/3244187258 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fcd88038980 0x7fcd8803ae90 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 msgr2=0x7fcd9c1ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 --2- 172.21.15.46:0/3244187258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 0x7fcd9c1ad080 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 shutdown_connections 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 --2- 172.21.15.46:0/3244187258 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fcd88038980 0x7fcd8803ae90 unknown :-1 s=CLOSED pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 --2- 172.21.15.46:0/3244187258 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9c06dff0 0x7fcd9c1ad080 unknown :-1 s=CLOSED pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 >> 172.21.15.46:0/3244187258 conn(0x7fcd9c06d4d0 msgr2=0x7fcd9c09bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 shutdown_connections 2024-05-08T03:04:16.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:16.350+0000 7fcda24ad640 1 -- 172.21.15.46:0/3244187258 wait complete. 2024-05-08T03:04:16.367 INFO:tasks.workunit.client.0.smithi046.stderr:+ sleep 30 2024-05-08T03:04:46.369 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool delete 008ce654-4211-4a2d-8916-631643828e06 008ce654-4211-4a2d-8916-631643828e06 --yes-i-really-really-mean-it 2024-05-08T03:04:46.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.468+0000 7fec5255d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:46.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.478+0000 7fec5255d640 1 Processor -- start 2024-05-08T03:04:46.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.479+0000 7fec5255d640 1 -- start start 2024-05-08T03:04:46.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.480+0000 7fec5255d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fec4c09c340 0x7fec4c12e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:46.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.480+0000 7fec5255d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec4c09fab0 con 0x7fec4c12eb40 2024-05-08T03:04:46.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.480+0000 7fec5255d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fec4c09f7a0 con 0x7fec4c09c340 2024-05-08T03:04:46.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.480+0000 7fec4bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fec4c09c340 0x7fec4c12e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.480+0000 7fec43fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fec4c12eb40 0x7fec4c1316b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52934/0 (socket says 172.21.15.46:52934) 2024-05-08T03:04:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.480+0000 7fec4bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fec4c09c340 0x7fec4c12e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58624/0 (socket says 172.21.15.46:58624) 2024-05-08T03:04:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.480+0000 7fec43fff640 1 -- 172.21.15.46:0/3197984981 learned_addr learned my addr 172.21.15.46:0/3197984981 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.481+0000 7fec4bfff640 1 -- 172.21.15.46:0/3197984981 >> v1:172.21.15.46:6789/0 conn(0x7fec4c12eb40 legacy=0x7fec4c1316b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.481+0000 7fec4bfff640 1 -- 172.21.15.46:0/3197984981 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c09da10 con 0x7fec4c09c340 2024-05-08T03:04:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.481+0000 7fec4bfff640 1 --2- 172.21.15.46:0/3197984981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 0x7fec4c12e600 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddf4253817dacc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.481+0000 7fec4b7fe640 1 -- 172.21.15.46:0/3197984981 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec3c009d90 con 0x7fec4c09c340 2024-05-08T03:04:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.481+0000 7fec4b7fe640 1 -- 172.21.15.46:0/3197984981 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec3c00e230 con 0x7fec4c09c340 2024-05-08T03:04:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.481+0000 7fec4b7fe640 1 -- 172.21.15.46:0/3197984981 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec3c00e4d0 con 0x7fec4c09c340 2024-05-08T03:04:46.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.482+0000 7fec5255d640 1 -- 172.21.15.46:0/3197984981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 msgr2=0x7fec4c12e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:46.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.482+0000 7fec5255d640 1 --2- 172.21.15.46:0/3197984981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 0x7fec4c12e600 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:46.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.482+0000 7fec5255d640 1 -- 172.21.15.46:0/3197984981 shutdown_connections 2024-05-08T03:04:46.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.482+0000 7fec5255d640 1 --2- 172.21.15.46:0/3197984981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 0x7fec4c12e600 unknown :-1 s=CLOSED pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:46.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.482+0000 7fec5255d640 1 -- 172.21.15.46:0/3197984981 >> 172.21.15.46:0/3197984981 conn(0x7fec4c0a08c0 msgr2=0x7fec4c0a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:46.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.482+0000 7fec5255d640 1 -- 172.21.15.46:0/3197984981 shutdown_connections 2024-05-08T03:04:46.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.482+0000 7fec5255d640 1 -- 172.21.15.46:0/3197984981 wait complete. 2024-05-08T03:04:46.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.482+0000 7fec5255d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:46.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.484+0000 7fec5255d640 1 Processor -- start 2024-05-08T03:04:46.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.484+0000 7fec5255d640 1 -- start start 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.485+0000 7fec5255d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 0x7fec4c11a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec5255d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c1211f0 con 0x7fec4c09c340 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec4bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 0x7fec4c11a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec4bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 0x7fec4c11a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58632/0 (socket says 172.21.15.46:58632) 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec4bfff640 1 -- 172.21.15.46:0/1034892829 learned_addr learned my addr 172.21.15.46:0/1034892829 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec4bfff640 1 -- 172.21.15.46:0/1034892829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c120770 con 0x7fec4c09c340 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec4bfff640 1 --2- 172.21.15.46:0/1034892829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 0x7fec4c11a070 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec3c014620 con 0x7fec4c09c340 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec3c014780 con 0x7fec4c09c340 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4c12dc30 con 0x7fec4c09c340 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec3c014a20 con 0x7fec4c09c340 2024-05-08T03:04:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.486+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4c11b1a0 con 0x7fec4c09c340 2024-05-08T03:04:46.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.487+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fec3c014bd0 con 0x7fec4c09c340 2024-05-08T03:04:46.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.487+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec4c0a3850 con 0x7fec4c09c340 2024-05-08T03:04:46.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.488+0000 7fec497fa640 1 --2- 172.21.15.46:0/1034892829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fec2c038980 0x7fec2c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:46.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.488+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(712..712 src has 611..712) ==== 4179+0+0 (crc 0 0 0) 0x7fec3c019040 con 0x7fec4c09c340 2024-05-08T03:04:46.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.488+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7fec2c03f330 con 0x7fec4c09c340 2024-05-08T03:04:46.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.488+0000 7fec43fff640 1 --2- 172.21.15.46:0/1034892829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fec2c038980 0x7fec2c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:46.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.489+0000 7fec43fff640 1 --2- 172.21.15.46:0/1034892829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fec2c038980 0x7fec2c03ae90 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:46.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.493+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fec3c012390 con 0x7fec4c09c340 2024-05-08T03:04:46.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:46.680+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "008ce654-4211-4a2d-8916-631643828e06", "pool2": "008ce654-4211-4a2d-8916-631643828e06", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec4c121330 con 0x7fec4c09c340 2024-05-08T03:04:47.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.382+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "008ce654-4211-4a2d-8916-631643828e06", "pool2": "008ce654-4211-4a2d-8916-631643828e06", "yes_i_really_really_mean_it": true}]=0 pool '008ce654-4211-4a2d-8916-631643828e06' removed v713) ==== 248+0+0 (crc 0 0 0) 0x7fec3c00fb30 con 0x7fec4c09c340 2024-05-08T03:04:47.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.382+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(713..713 src has 611..713) ==== 296+0+0 (crc 0 0 0) 0x7fec3c013e40 con 0x7fec4c09c340 2024-05-08T03:04:47.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.383+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7fec2c040010 con 0x7fec4c09c340 2024-05-08T03:04:47.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.496+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "008ce654-4211-4a2d-8916-631643828e06", "pool2": "008ce654-4211-4a2d-8916-631643828e06", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec4c069870 con 0x7fec4c09c340 2024-05-08T03:04:47.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.497+0000 7fec497fa640 1 -- 172.21.15.46:0/1034892829 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "008ce654-4211-4a2d-8916-631643828e06", "pool2": "008ce654-4211-4a2d-8916-631643828e06", "yes_i_really_really_mean_it": true}]=0 pool '008ce654-4211-4a2d-8916-631643828e06' does not exist v713) ==== 255+0+0 (crc 0 0 0) 0x7fec3c00fd10 con 0x7fec4c09c340 2024-05-08T03:04:47.500 INFO:tasks.workunit.client.0.smithi046.stderr:pool '008ce654-4211-4a2d-8916-631643828e06' does not exist 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fec2c038980 msgr2=0x7fec2c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 --2- 172.21.15.46:0/1034892829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fec2c038980 0x7fec2c03ae90 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 msgr2=0x7fec4c11a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 --2- 172.21.15.46:0/1034892829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 0x7fec4c11a070 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 shutdown_connections 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 --2- 172.21.15.46:0/1034892829 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fec2c038980 0x7fec2c03ae90 unknown :-1 s=CLOSED pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 --2- 172.21.15.46:0/1034892829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec4c09c340 0x7fec4c11a070 unknown :-1 s=CLOSED pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 >> 172.21.15.46:0/1034892829 conn(0x7fec4c0a08c0 msgr2=0x7fec4c1b76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 shutdown_connections 2024-05-08T03:04:47.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.499+0000 7fec5255d640 1 -- 172.21.15.46:0/1034892829 wait complete. 2024-05-08T03:04:47.513 INFO:tasks.workunit.client.0.smithi046.stderr:+ ceph osd pool delete 048b0735-bafe-474a-b306-d0d41d70737f 048b0735-bafe-474a-b306-d0d41d70737f --yes-i-really-really-mean-it 2024-05-08T03:04:47.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.598+0000 7f4e8942d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:47.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.608+0000 7f4e8942d640 1 Processor -- start 2024-05-08T03:04:47.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.608+0000 7f4e8942d640 1 -- start start 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.609+0000 7f4e8942d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4e84137de0 0x7f4e8413a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.609+0000 7f4e8942d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e84134c30 con 0x7f4e84135060 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.609+0000 7f4e8942d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8409be70 con 0x7f4e84137de0 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e7a7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4e84137de0 0x7f4e8413a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e82ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4e84135060 0x7f4e84135470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52950/0 (socket says 172.21.15.46:52950) 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e82ffd640 1 -- 172.21.15.46:0/2455815252 learned_addr learned my addr 172.21.15.46:0/2455815252 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e7a7fc640 1 -- 172.21.15.46:0/2455815252 >> v1:172.21.15.46:6789/0 conn(0x7f4e84135060 legacy=0x7f4e84135470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e7a7fc640 1 -- 172.21.15.46:0/2455815252 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8409c840 con 0x7f4e84137de0 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e827fc640 1 -- 172.21.15.46:0/2455815252 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034530528 0 0) 0x7f4e84134c30 con 0x7f4e84135060 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e7a7fc640 1 --2- 172.21.15.46:0/2455815252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84137de0 0x7f4e8413a200 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8c5b553352aa58 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e827fc640 1 -- 172.21.15.46:0/2455815252 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4e6c009d90 con 0x7f4e84137de0 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e827fc640 1 -- 172.21.15.46:0/2455815252 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4e6c00e230 con 0x7f4e84137de0 2024-05-08T03:04:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.610+0000 7f4e827fc640 1 -- 172.21.15.46:0/2455815252 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4e6c00e4d0 con 0x7f4e84137de0 2024-05-08T03:04:47.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.611+0000 7f4e8942d640 1 -- 172.21.15.46:0/2455815252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84137de0 msgr2=0x7f4e8413a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:47.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.611+0000 7f4e8942d640 1 --2- 172.21.15.46:0/2455815252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84137de0 0x7f4e8413a200 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.611+0000 7f4e8942d640 1 -- 172.21.15.46:0/2455815252 shutdown_connections 2024-05-08T03:04:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.611+0000 7f4e8942d640 1 --2- 172.21.15.46:0/2455815252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84137de0 0x7f4e8413a200 unknown :-1 s=CLOSED pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.611+0000 7f4e8942d640 1 -- 172.21.15.46:0/2455815252 >> 172.21.15.46:0/2455815252 conn(0x7f4e8406d420 msgr2=0x7f4e8406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.611+0000 7f4e8942d640 1 -- 172.21.15.46:0/2455815252 shutdown_connections 2024-05-08T03:04:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.611+0000 7f4e8942d640 1 -- 172.21.15.46:0/2455815252 wait complete. 2024-05-08T03:04:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.611+0000 7f4e8942d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.613+0000 7f4e8942d640 1 Processor -- start 2024-05-08T03:04:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.614+0000 7f4e8942d640 1 -- start start 2024-05-08T03:04:47.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.615+0000 7f4e8942d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84135060 0x7f4e8411d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:47.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.615+0000 7f4e8942d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8411e340 con 0x7f4e84135060 2024-05-08T03:04:47.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.615+0000 7f4e82ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84135060 0x7f4e8411d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:47.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.615+0000 7f4e82ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84135060 0x7f4e8411d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58644/0 (socket says 172.21.15.46:58644) 2024-05-08T03:04:47.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.615+0000 7f4e82ffd640 1 -- 172.21.15.46:0/344589971 learned_addr learned my addr 172.21.15.46:0/344589971 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:47.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.615+0000 7f4e82ffd640 1 -- 172.21.15.46:0/344589971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8411e620 con 0x7f4e84135060 2024-05-08T03:04:47.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.616+0000 7f4e82ffd640 1 --2- 172.21.15.46:0/344589971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84135060 0x7f4e8411d1f0 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:47.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.616+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4e74004b80 con 0x7f4e84135060 2024-05-08T03:04:47.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.616+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4e74004ce0 con 0x7f4e84135060 2024-05-08T03:04:47.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.616+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e840a03f0 con 0x7f4e84135060 2024-05-08T03:04:47.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.616+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4e74007120 con 0x7f4e84135060 2024-05-08T03:04:47.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.616+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e8409f870 con 0x7f4e84135060 2024-05-08T03:04:47.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.617+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e8411fe00 con 0x7f4e84135060 2024-05-08T03:04:47.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.617+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4e740072d0 con 0x7f4e84135060 2024-05-08T03:04:47.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.617+0000 7f4e7bfff640 1 --2- 172.21.15.46:0/344589971 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4e64038980 0x7f4e6403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:47.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.617+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(713..713 src has 611..713) ==== 3791+0+0 (crc 0 0 0) 0x7f4e74048750 con 0x7f4e84135060 2024-05-08T03:04:47.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.617+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7f4e6403eb90 con 0x7f4e84135060 2024-05-08T03:04:47.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.618+0000 7f4e7a7fc640 1 --2- 172.21.15.46:0/344589971 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4e64038980 0x7f4e6403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:47.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.618+0000 7f4e7a7fc640 1 --2- 172.21.15.46:0/344589971 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4e64038980 0x7f4e6403ae90 crc :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:47.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.622+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f4e7400f230 con 0x7f4e84135060 2024-05-08T03:04:47.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:47.814+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "pool2": "048b0735-bafe-474a-b306-d0d41d70737f", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4e84069870 con 0x7f4e84135060 2024-05-08T03:04:48.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.383+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "pool2": "048b0735-bafe-474a-b306-d0d41d70737f", "yes_i_really_really_mean_it": true}]=0 pool '048b0735-bafe-474a-b306-d0d41d70737f' removed v714) ==== 248+0+0 (crc 0 0 0) 0x7f4e7400a5d0 con 0x7f4e84135060 2024-05-08T03:04:48.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.384+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 <== mon.0 v2:172.21.15.46:3300/0 8 ==== osd_map(714..714 src has 611..714) ==== 296+0+0 (crc 0 0 0) 0x7f4e7400ce10 con 0x7f4e84135060 2024-05-08T03:04:48.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.384+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f4e6403f8e0 con 0x7f4e84135060 2024-05-08T03:04:48.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.588+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "pool2": "048b0735-bafe-474a-b306-d0d41d70737f", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4e840a5160 con 0x7f4e84135060 2024-05-08T03:04:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.589+0000 7f4e7bfff640 1 -- 172.21.15.46:0/344589971 <== mon.0 v2:172.21.15.46:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "048b0735-bafe-474a-b306-d0d41d70737f", "pool2": "048b0735-bafe-474a-b306-d0d41d70737f", "yes_i_really_really_mean_it": true}]=0 pool '048b0735-bafe-474a-b306-d0d41d70737f' does not exist v714) ==== 255+0+0 (crc 0 0 0) 0x7f4e7400a7b0 con 0x7f4e84135060 2024-05-08T03:04:48.592 INFO:tasks.workunit.client.0.smithi046.stderr:pool '048b0735-bafe-474a-b306-d0d41d70737f' does not exist 2024-05-08T03:04:48.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4e64038980 msgr2=0x7f4e6403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:48.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 --2- 172.21.15.46:0/344589971 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4e64038980 0x7f4e6403ae90 crc :-1 s=READY pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:48.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84135060 msgr2=0x7f4e8411d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:48.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 --2- 172.21.15.46:0/344589971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84135060 0x7f4e8411d1f0 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:48.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 shutdown_connections 2024-05-08T03:04:48.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 --2- 172.21.15.46:0/344589971 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f4e64038980 0x7f4e6403ae90 unknown :-1 s=CLOSED pgs=3873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:48.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 --2- 172.21.15.46:0/344589971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e84135060 0x7f4e8411d1f0 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:48.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 >> 172.21.15.46:0/344589971 conn(0x7f4e8406d420 msgr2=0x7f4e840a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:48.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 shutdown_connections 2024-05-08T03:04:48.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-05-08T03:04:48.592+0000 7f4e8942d640 1 -- 172.21.15.46:0/344589971 wait complete. 2024-05-08T03:04:48.614 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo OK 2024-05-08T03:04:48.615 INFO:tasks.workunit.client.0.smithi046.stdout:OK 2024-05-08T03:04:48.615 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T03:04:48.616 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T03:04:48.685 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-05-08T03:04:48.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T03:04:49.012 DEBUG:teuthology.parallel:result is None 2024-05-08T03:04:49.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T03:04:49.039 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T03:04:49.039 DEBUG:teuthology.orchestra.run.smithi046:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-05-08T03:04:49.117 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T03:04:49.118 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T03:04:49.140 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T03:04:49.140 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T03:04:49.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.266+0000 7f0b7c86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:49.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.271+0000 7f0b7c86d640 1 Processor -- start 2024-05-08T03:04:49.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.271+0000 7f0b7c86d640 1 -- start start 2024-05-08T03:04:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.273+0000 7f0b7c86d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b78134cc0 0x7f0b781370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.273+0000 7f0b7c86d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b78131a50 con 0x7f0b78131ed0 2024-05-08T03:04:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.273+0000 7f0b7c86d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f0b78070100 con 0x7f0b78134cc0 2024-05-08T03:04:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.273+0000 7f0b7659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0b78131ed0 0x7f0b781322e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52954/0 (socket says 172.21.15.46:52954) 2024-05-08T03:04:49.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.273+0000 7f0b7659c640 1 -- 172.21.15.46:0/830450440 learned_addr learned my addr 172.21.15.46:0/830450440 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.273+0000 7f0b75d9b640 1 --2- 172.21.15.46:0/830450440 >> v2:172.21.15.46:3300/0 conn(0x7f0b78134cc0 0x7f0b781370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.273+0000 7f0b7559a640 1 -- 172.21.15.46:0/830450440 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297277191 0 0) 0x7f0b78131a50 con 0x7f0b78131ed0 2024-05-08T03:04:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.273+0000 7f0b7559a640 1 -- 172.21.15.46:0/830450440 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b60003580 con 0x7f0b78131ed0 2024-05-08T03:04:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.274+0000 7f0b75d9b640 1 -- 172.21.15.46:0/830450440 >> v1:172.21.15.46:6789/0 conn(0x7f0b78131ed0 legacy=0x7f0b781322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.274+0000 7f0b75d9b640 1 -- 172.21.15.46:0/830450440 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7806efd0 con 0x7f0b78134cc0 2024-05-08T03:04:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.274+0000 7f0b75d9b640 1 --2- 172.21.15.46:0/830450440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78134cc0 0x7f0b781370e0 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82ecefd317657e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.274+0000 7f0b7559a640 1 -- 172.21.15.46:0/830450440 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b6c009d90 con 0x7f0b78134cc0 2024-05-08T03:04:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.274+0000 7f0b7559a640 1 -- 172.21.15.46:0/830450440 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b6c00e230 con 0x7f0b78134cc0 2024-05-08T03:04:49.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.274+0000 7f0b7559a640 1 -- 172.21.15.46:0/830450440 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b6c00e4d0 con 0x7f0b78134cc0 2024-05-08T03:04:49.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.275+0000 7f0b7c86d640 1 -- 172.21.15.46:0/830450440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78134cc0 msgr2=0x7f0b781370e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.275+0000 7f0b7c86d640 1 --2- 172.21.15.46:0/830450440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78134cc0 0x7f0b781370e0 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.275+0000 7f0b7c86d640 1 -- 172.21.15.46:0/830450440 shutdown_connections 2024-05-08T03:04:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.275+0000 7f0b7c86d640 1 --2- 172.21.15.46:0/830450440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78134cc0 0x7f0b781370e0 unknown :-1 s=CLOSED pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.275+0000 7f0b7c86d640 1 -- 172.21.15.46:0/830450440 >> 172.21.15.46:0/830450440 conn(0x7f0b780a2df0 msgr2=0x7f0b780a3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.275+0000 7f0b7c86d640 1 -- 172.21.15.46:0/830450440 shutdown_connections 2024-05-08T03:04:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.275+0000 7f0b7c86d640 1 -- 172.21.15.46:0/830450440 wait complete. 2024-05-08T03:04:49.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.275+0000 7f0b7c86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:49.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.277+0000 7f0b7c86d640 1 Processor -- start 2024-05-08T03:04:49.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.277+0000 7f0b7c86d640 1 -- start start 2024-05-08T03:04:49.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b7c86d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78131ed0 0x7f0b781c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:49.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b7c86d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7812efb0 con 0x7f0b78131ed0 2024-05-08T03:04:49.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b7659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78131ed0 0x7f0b781c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:49.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b7659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78131ed0 0x7f0b781c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58668/0 (socket says 172.21.15.46:58668) 2024-05-08T03:04:49.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b7659c640 1 -- 172.21.15.46:0/1133016221 learned_addr learned my addr 172.21.15.46:0/1133016221 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:49.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b7659c640 1 -- 172.21.15.46:0/1133016221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b781c7640 con 0x7f0b78131ed0 2024-05-08T03:04:49.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b7659c640 1 --2- 172.21.15.46:0/1133016221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78131ed0 0x7f0b781c7c00 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:49.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b66ffd640 1 -- 172.21.15.46:0/1133016221 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b68005a60 con 0x7f0b78131ed0 2024-05-08T03:04:49.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b66ffd640 1 -- 172.21.15.46:0/1133016221 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b68005bc0 con 0x7f0b78131ed0 2024-05-08T03:04:49.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7811ad90 con 0x7f0b78131ed0 2024-05-08T03:04:49.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b66ffd640 1 -- 172.21.15.46:0/1133016221 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b68005e60 con 0x7f0b78131ed0 2024-05-08T03:04:49.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.279+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b78072a50 con 0x7f0b78131ed0 2024-05-08T03:04:49.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.280+0000 7f0b66ffd640 1 -- 172.21.15.46:0/1133016221 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0b6800c7a0 con 0x7f0b78131ed0 2024-05-08T03:04:49.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.280+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b78063900 con 0x7f0b78131ed0 2024-05-08T03:04:49.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.281+0000 7f0b66ffd640 1 --2- 172.21.15.46:0/1133016221 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0b58038980 0x7f0b5803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:49.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.281+0000 7f0b66ffd640 1 -- 172.21.15.46:0/1133016221 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7f0b68048480 con 0x7f0b78131ed0 2024-05-08T03:04:49.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.281+0000 7f0b75d9b640 1 --2- 172.21.15.46:0/1133016221 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0b58038980 0x7f0b5803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:49.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.282+0000 7f0b75d9b640 1 --2- 172.21.15.46:0/1133016221 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0b58038980 0x7f0b5803ae90 crc :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:49.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.286+0000 7f0b66ffd640 1 -- 172.21.15.46:0/1133016221 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f0b6800d4d0 con 0x7f0b78131ed0 2024-05-08T03:04:49.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.468+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b7806fd20 con 0x7f0b58038980 2024-05-08T03:04:49.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.472+0000 7f0b66ffd640 1 -- 172.21.15.46:0/1133016221 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109144 (crc 0 0 0) 0x7f0b6c009ce0 con 0x7f0b58038980 2024-05-08T03:04:49.476 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T03:04:49.487 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-08T03:04:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0b58038980 msgr2=0x7f0b5803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 --2- 172.21.15.46:0/1133016221 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0b58038980 0x7f0b5803ae90 crc :-1 s=READY pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78131ed0 msgr2=0x7f0b781c7c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 --2- 172.21.15.46:0/1133016221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78131ed0 0x7f0b781c7c00 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 shutdown_connections 2024-05-08T03:04:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 --2- 172.21.15.46:0/1133016221 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0b58038980 0x7f0b5803ae90 unknown :-1 s=CLOSED pgs=3874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 --2- 172.21.15.46:0/1133016221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b78131ed0 0x7f0b781c7c00 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 >> 172.21.15.46:0/1133016221 conn(0x7f0b780a2df0 msgr2=0x7f0b78133b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 shutdown_connections 2024-05-08T03:04:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.475+0000 7f0b7c86d640 1 -- 172.21.15.46:0/1133016221 wait complete. 2024-05-08T03:04:49.490 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1288,"stamp":"2024-05-08T03:04:48.802023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":273196,"kb_used_data":8524,"kb_used_omap":0,"kb_used_meta":264640,"kb_avail":419157204,"statfs":{"total":429496729600,"available":429216976896,"internally_reserved":0,"allocated":8728576,"data_stored":3775169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":270991360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-299550,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002571"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.746337+0000","last_change":"2024-05-08T02:51:09.430157+0000","last_active":"2024-05-08T03:04:19.746337+0000","last_peered":"2024-05-08T03:04:19.746337+0000","last_clean":"2024-05-08T03:04:19.746337+0000","last_became_active":"2024-05-08T02:51:09.414974+0000","last_became_peered":"2024-05-08T02:51:09.414974+0000","last_unstale":"2024-05-08T03:04:19.746337+0000","last_undegraded":"2024-05-08T03:04:19.746337+0000","last_fullsized":"2024-05-08T03:04:19.746337+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.472460+0000","last_change":"2024-05-08T02:51:09.437442+0000","last_active":"2024-05-08T03:04:16.472460+0000","last_peered":"2024-05-08T03:04:16.472460+0000","last_clean":"2024-05-08T03:04:16.472460+0000","last_became_active":"2024-05-08T02:51:09.429857+0000","last_became_peered":"2024-05-08T02:51:09.429857+0000","last_unstale":"2024-05-08T03:04:16.472460+0000","last_undegraded":"2024-05-08T03:04:16.472460+0000","last_fullsized":"2024-05-08T03:04:16.472460+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.640820+0000","last_change":"2024-05-08T02:51:09.428422+0000","last_active":"2024-05-08T03:04:19.640820+0000","last_peered":"2024-05-08T03:04:19.640820+0000","last_clean":"2024-05-08T03:04:19.640820+0000","last_became_active":"2024-05-08T02:51:09.422128+0000","last_became_peered":"2024-05-08T02:51:09.422128+0000","last_unstale":"2024-05-08T03:04:19.640820+0000","last_undegraded":"2024-05-08T03:04:19.640820+0000","last_fullsized":"2024-05-08T03:04:19.640820+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.909774+0000","last_change":"2024-05-08T02:51:09.514243+0000","last_active":"2024-05-08T03:04:17.909774+0000","last_peered":"2024-05-08T03:04:17.909774+0000","last_clean":"2024-05-08T03:04:17.909774+0000","last_became_active":"2024-05-08T02:51:09.509773+0000","last_became_peered":"2024-05-08T02:51:09.509773+0000","last_unstale":"2024-05-08T03:04:17.909774+0000","last_undegraded":"2024-05-08T03:04:17.909774+0000","last_fullsized":"2024-05-08T03:04:17.909774+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.706769+0000","last_change":"2024-05-08T02:51:09.525448+0000","last_active":"2024-05-08T03:04:19.706769+0000","last_peered":"2024-05-08T03:04:19.706769+0000","last_clean":"2024-05-08T03:04:19.706769+0000","last_became_active":"2024-05-08T02:51:09.520146+0000","last_became_peered":"2024-05-08T02:51:09.520146+0000","last_unstale":"2024-05-08T03:04:19.706769+0000","last_undegraded":"2024-05-08T03:04:19.706769+0000","last_fullsized":"2024-05-08T03:04:19.706769+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.529961+0000","last_change":"2024-05-08T02:51:09.479496+0000","last_active":"2024-05-08T03:04:16.529961+0000","last_peered":"2024-05-08T03:04:16.529961+0000","last_clean":"2024-05-08T03:04:16.529961+0000","last_became_active":"2024-05-08T02:51:09.464789+0000","last_became_peered":"2024-05-08T02:51:09.464789+0000","last_unstale":"2024-05-08T03:04:16.529961+0000","last_undegraded":"2024-05-08T03:04:16.529961+0000","last_fullsized":"2024-05-08T03:04:16.529961+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.515528+0000","last_change":"2024-05-08T02:51:09.495786+0000","last_active":"2024-05-08T03:04:16.515528+0000","last_peered":"2024-05-08T03:04:16.515528+0000","last_clean":"2024-05-08T03:04:16.515528+0000","last_became_active":"2024-05-08T02:51:09.490174+0000","last_became_peered":"2024-05-08T02:51:09.490174+0000","last_unstale":"2024-05-08T03:04:16.515528+0000","last_undegraded":"2024-05-08T03:04:16.515528+0000","last_fullsized":"2024-05-08T03:04:16.515528+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.489022+0000","last_change":"2024-05-08T02:51:09.483583+0000","last_active":"2024-05-08T03:04:16.489022+0000","last_peered":"2024-05-08T03:04:16.489022+0000","last_clean":"2024-05-08T03:04:16.489022+0000","last_became_active":"2024-05-08T02:51:09.473858+0000","last_became_peered":"2024-05-08T02:51:09.473858+0000","last_unstale":"2024-05-08T03:04:16.489022+0000","last_undegraded":"2024-05-08T03:04:16.489022+0000","last_fullsized":"2024-05-08T03:04:16.489022+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.841052+0000","last_change":"2024-05-08T02:51:09.428825+0000","last_active":"2024-05-08T03:04:17.841052+0000","last_peered":"2024-05-08T03:04:17.841052+0000","last_clean":"2024-05-08T03:04:17.841052+0000","last_became_active":"2024-05-08T02:51:09.419746+0000","last_became_peered":"2024-05-08T02:51:09.419746+0000","last_unstale":"2024-05-08T03:04:17.841052+0000","last_undegraded":"2024-05-08T03:04:17.841052+0000","last_fullsized":"2024-05-08T03:04:17.841052+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.657736+0000","last_change":"2024-05-08T02:51:09.425411+0000","last_active":"2024-05-08T03:04:19.657736+0000","last_peered":"2024-05-08T03:04:19.657736+0000","last_clean":"2024-05-08T03:04:19.657736+0000","last_became_active":"2024-05-08T02:51:09.412840+0000","last_became_peered":"2024-05-08T02:51:09.412840+0000","last_unstale":"2024-05-08T03:04:19.657736+0000","last_undegraded":"2024-05-08T03:04:19.657736+0000","last_fullsized":"2024-05-08T03:04:19.657736+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.881641+0000","last_change":"2024-05-08T02:51:09.535779+0000","last_active":"2024-05-08T03:04:17.881641+0000","last_peered":"2024-05-08T03:04:17.881641+0000","last_clean":"2024-05-08T03:04:17.881641+0000","last_became_active":"2024-05-08T02:51:09.531607+0000","last_became_peered":"2024-05-08T02:51:09.531607+0000","last_unstale":"2024-05-08T03:04:17.881641+0000","last_undegraded":"2024-05-08T03:04:17.881641+0000","last_fullsized":"2024-05-08T03:04:17.881641+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.480717+0000","last_change":"2024-05-08T02:51:09.485826+0000","last_active":"2024-05-08T03:04:16.480717+0000","last_peered":"2024-05-08T03:04:16.480717+0000","last_clean":"2024-05-08T03:04:16.480717+0000","last_became_active":"2024-05-08T02:51:09.469507+0000","last_became_peered":"2024-05-08T02:51:09.469507+0000","last_unstale":"2024-05-08T03:04:16.480717+0000","last_undegraded":"2024-05-08T03:04:16.480717+0000","last_fullsized":"2024-05-08T03:04:16.480717+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.873475+0000","last_change":"2024-05-08T02:51:09.469162+0000","last_active":"2024-05-08T03:04:17.873475+0000","last_peered":"2024-05-08T03:04:17.873475+0000","last_clean":"2024-05-08T03:04:17.873475+0000","last_became_active":"2024-05-08T02:51:09.455287+0000","last_became_peered":"2024-05-08T02:51:09.455287+0000","last_unstale":"2024-05-08T03:04:17.873475+0000","last_undegraded":"2024-05-08T03:04:17.873475+0000","last_fullsized":"2024-05-08T03:04:17.873475+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.898314+0000","last_change":"2024-05-08T02:51:09.498571+0000","last_active":"2024-05-08T03:04:17.898314+0000","last_peered":"2024-05-08T03:04:17.898314+0000","last_clean":"2024-05-08T03:04:17.898314+0000","last_became_active":"2024-05-08T02:51:09.492168+0000","last_became_peered":"2024-05-08T02:51:09.492168+0000","last_unstale":"2024-05-08T03:04:17.898314+0000","last_undegraded":"2024-05-08T03:04:17.898314+0000","last_fullsized":"2024-05-08T03:04:17.898314+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.439741+0000","last_change":"2024-05-08T02:51:09.552657+0000","last_active":"2024-05-08T03:04:16.439741+0000","last_peered":"2024-05-08T03:04:16.439741+0000","last_clean":"2024-05-08T03:04:16.439741+0000","last_became_active":"2024-05-08T02:51:09.545524+0000","last_became_peered":"2024-05-08T02:51:09.545524+0000","last_unstale":"2024-05-08T03:04:16.439741+0000","last_undegraded":"2024-05-08T03:04:16.439741+0000","last_fullsized":"2024-05-08T03:04:16.439741+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.510341+0000","last_change":"2024-05-08T02:51:09.505576+0000","last_active":"2024-05-08T03:04:16.510341+0000","last_peered":"2024-05-08T03:04:16.510341+0000","last_clean":"2024-05-08T03:04:16.510341+0000","last_became_active":"2024-05-08T02:51:09.498798+0000","last_became_peered":"2024-05-08T02:51:09.498798+0000","last_unstale":"2024-05-08T03:04:16.510341+0000","last_undegraded":"2024-05-08T03:04:16.510341+0000","last_fullsized":"2024-05-08T03:04:16.510341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.506929+0000","last_change":"2024-05-08T02:51:09.449392+0000","last_active":"2024-05-08T03:04:16.506929+0000","last_peered":"2024-05-08T03:04:16.506929+0000","last_clean":"2024-05-08T03:04:16.506929+0000","last_became_active":"2024-05-08T02:51:09.440822+0000","last_became_peered":"2024-05-08T02:51:09.440822+0000","last_unstale":"2024-05-08T03:04:16.506929+0000","last_undegraded":"2024-05-08T03:04:16.506929+0000","last_fullsized":"2024-05-08T03:04:16.506929+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.893036+0000","last_change":"2024-05-08T02:51:09.462545+0000","last_active":"2024-05-08T03:04:17.893036+0000","last_peered":"2024-05-08T03:04:17.893036+0000","last_clean":"2024-05-08T03:04:17.893036+0000","last_became_active":"2024-05-08T02:51:09.449604+0000","last_became_peered":"2024-05-08T02:51:09.449604+0000","last_unstale":"2024-05-08T03:04:17.893036+0000","last_undegraded":"2024-05-08T03:04:17.893036+0000","last_fullsized":"2024-05-08T03:04:17.893036+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.645218+0000","last_change":"2024-05-08T02:51:09.416372+0000","last_active":"2024-05-08T03:04:19.645218+0000","last_peered":"2024-05-08T03:04:19.645218+0000","last_clean":"2024-05-08T03:04:19.645218+0000","last_became_active":"2024-05-08T02:51:09.408878+0000","last_became_peered":"2024-05-08T02:51:09.408878+0000","last_unstale":"2024-05-08T03:04:19.645218+0000","last_undegraded":"2024-05-08T03:04:19.645218+0000","last_fullsized":"2024-05-08T03:04:19.645218+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.704810+0000","last_change":"2024-05-08T02:51:09.499815+0000","last_active":"2024-05-08T03:04:19.704810+0000","last_peered":"2024-05-08T03:04:19.704810+0000","last_clean":"2024-05-08T03:04:19.704810+0000","last_became_active":"2024-05-08T02:51:09.493372+0000","last_became_peered":"2024-05-08T02:51:09.493372+0000","last_unstale":"2024-05-08T03:04:19.704810+0000","last_undegraded":"2024-05-08T03:04:19.704810+0000","last_fullsized":"2024-05-08T03:04:19.704810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.743603+0000","last_change":"2024-05-08T02:51:09.478707+0000","last_active":"2024-05-08T03:04:19.743603+0000","last_peered":"2024-05-08T03:04:19.743603+0000","last_clean":"2024-05-08T03:04:19.743603+0000","last_became_active":"2024-05-08T02:51:09.466931+0000","last_became_peered":"2024-05-08T02:51:09.466931+0000","last_unstale":"2024-05-08T03:04:19.743603+0000","last_undegraded":"2024-05-08T03:04:19.743603+0000","last_fullsized":"2024-05-08T03:04:19.743603+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.727210+0000","last_change":"2024-05-08T02:51:09.485829+0000","last_active":"2024-05-08T03:04:19.727210+0000","last_peered":"2024-05-08T03:04:19.727210+0000","last_clean":"2024-05-08T03:04:19.727210+0000","last_became_active":"2024-05-08T02:51:09.475586+0000","last_became_peered":"2024-05-08T02:51:09.475586+0000","last_unstale":"2024-05-08T03:04:19.727210+0000","last_undegraded":"2024-05-08T03:04:19.727210+0000","last_fullsized":"2024-05-08T03:04:19.727210+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.620157+0000","last_change":"2024-05-08T02:51:09.459058+0000","last_active":"2024-05-08T03:04:19.620157+0000","last_peered":"2024-05-08T03:04:19.620157+0000","last_clean":"2024-05-08T03:04:19.620157+0000","last_became_active":"2024-05-08T02:51:09.448780+0000","last_became_peered":"2024-05-08T02:51:09.448780+0000","last_unstale":"2024-05-08T03:04:19.620157+0000","last_undegraded":"2024-05-08T03:04:19.620157+0000","last_fullsized":"2024-05-08T03:04:19.620157+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.899212+0000","last_change":"2024-05-08T02:51:09.452398+0000","last_active":"2024-05-08T03:04:17.899212+0000","last_peered":"2024-05-08T03:04:17.899212+0000","last_clean":"2024-05-08T03:04:17.899212+0000","last_became_active":"2024-05-08T02:51:09.440069+0000","last_became_peered":"2024-05-08T02:51:09.440069+0000","last_unstale":"2024-05-08T03:04:17.899212+0000","last_undegraded":"2024-05-08T03:04:17.899212+0000","last_fullsized":"2024-05-08T03:04:17.899212+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.872326+0000","last_change":"2024-05-08T02:51:09.479443+0000","last_active":"2024-05-08T03:04:17.872326+0000","last_peered":"2024-05-08T03:04:17.872326+0000","last_clean":"2024-05-08T03:04:17.872326+0000","last_became_active":"2024-05-08T02:51:09.472343+0000","last_became_peered":"2024-05-08T02:51:09.472343+0000","last_unstale":"2024-05-08T03:04:17.872326+0000","last_undegraded":"2024-05-08T03:04:17.872326+0000","last_fullsized":"2024-05-08T03:04:17.872326+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.465288+0000","last_change":"2024-05-08T02:51:09.539867+0000","last_active":"2024-05-08T03:04:16.465288+0000","last_peered":"2024-05-08T03:04:16.465288+0000","last_clean":"2024-05-08T03:04:16.465288+0000","last_became_active":"2024-05-08T02:51:09.532094+0000","last_became_peered":"2024-05-08T02:51:09.532094+0000","last_unstale":"2024-05-08T03:04:16.465288+0000","last_undegraded":"2024-05-08T03:04:16.465288+0000","last_fullsized":"2024-05-08T03:04:16.465288+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.857431+0000","last_change":"2024-05-08T02:51:09.459701+0000","last_active":"2024-05-08T03:04:17.857431+0000","last_peered":"2024-05-08T03:04:17.857431+0000","last_clean":"2024-05-08T03:04:17.857431+0000","last_became_active":"2024-05-08T02:51:09.443431+0000","last_became_peered":"2024-05-08T02:51:09.443431+0000","last_unstale":"2024-05-08T03:04:17.857431+0000","last_undegraded":"2024-05-08T03:04:17.857431+0000","last_fullsized":"2024-05-08T03:04:17.857431+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.536157+0000","last_change":"2024-05-08T02:51:09.523580+0000","last_active":"2024-05-08T03:04:16.536157+0000","last_peered":"2024-05-08T03:04:16.536157+0000","last_clean":"2024-05-08T03:04:16.536157+0000","last_became_active":"2024-05-08T02:51:09.515226+0000","last_became_peered":"2024-05-08T02:51:09.515226+0000","last_unstale":"2024-05-08T03:04:16.536157+0000","last_undegraded":"2024-05-08T03:04:16.536157+0000","last_fullsized":"2024-05-08T03:04:16.536157+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.521789+0000","last_change":"2024-05-08T02:51:09.446239+0000","last_active":"2024-05-08T03:04:16.521789+0000","last_peered":"2024-05-08T03:04:16.521789+0000","last_clean":"2024-05-08T03:04:16.521789+0000","last_became_active":"2024-05-08T02:51:09.433946+0000","last_became_peered":"2024-05-08T02:51:09.433946+0000","last_unstale":"2024-05-08T03:04:16.521789+0000","last_undegraded":"2024-05-08T03:04:16.521789+0000","last_fullsized":"2024-05-08T03:04:16.521789+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.509222+0000","last_change":"2024-05-08T02:51:09.577416+0000","last_active":"2024-05-08T03:04:16.509222+0000","last_peered":"2024-05-08T03:04:16.509222+0000","last_clean":"2024-05-08T03:04:16.509222+0000","last_became_active":"2024-05-08T02:51:09.570979+0000","last_became_peered":"2024-05-08T02:51:09.570979+0000","last_unstale":"2024-05-08T03:04:16.509222+0000","last_undegraded":"2024-05-08T03:04:16.509222+0000","last_fullsized":"2024-05-08T03:04:16.509222+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1302,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.737519+0000","last_change":"2024-05-08T02:51:09.425933+0000","last_active":"2024-05-08T03:04:19.737519+0000","last_peered":"2024-05-08T03:04:19.737519+0000","last_clean":"2024-05-08T03:04:19.737519+0000","last_became_active":"2024-05-08T02:51:09.419747+0000","last_became_peered":"2024-05-08T02:51:09.419747+0000","last_unstale":"2024-05-08T03:04:19.737519+0000","last_undegraded":"2024-05-08T03:04:19.737519+0000","last_fullsized":"2024-05-08T03:04:19.737519+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.636523+0000","last_change":"2024-05-08T02:51:09.462720+0000","last_active":"2024-05-08T03:04:19.636523+0000","last_peered":"2024-05-08T03:04:19.636523+0000","last_clean":"2024-05-08T03:04:19.636523+0000","last_became_active":"2024-05-08T02:51:09.454882+0000","last_became_peered":"2024-05-08T02:51:09.454882+0000","last_unstale":"2024-05-08T03:04:19.636523+0000","last_undegraded":"2024-05-08T03:04:19.636523+0000","last_fullsized":"2024-05-08T03:04:19.636523+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1887,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.858939+0000","last_change":"2024-05-08T02:45:31.653041+0000","last_active":"2024-05-08T03:04:19.858939+0000","last_peered":"2024-05-08T03:04:19.858939+0000","last_clean":"2024-05-08T03:04:19.858939+0000","last_became_active":"2024-05-08T02:45:31.647316+0000","last_became_peered":"2024-05-08T02:45:31.647316+0000","last_unstale":"2024-05-08T03:04:19.858939+0000","last_undegraded":"2024-05-08T03:04:19.858939+0000","last_fullsized":"2024-05-08T03:04:19.858939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1891,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.757287+0000","last_change":"2024-05-08T02:45:31.640980+0000","last_active":"2024-05-08T03:04:19.757287+0000","last_peered":"2024-05-08T03:04:19.757287+0000","last_clean":"2024-05-08T03:04:19.757287+0000","last_became_active":"2024-05-08T02:45:31.636059+0000","last_became_peered":"2024-05-08T02:45:31.636059+0000","last_unstale":"2024-05-08T03:04:19.757287+0000","last_undegraded":"2024-05-08T03:04:19.757287+0000","last_fullsized":"2024-05-08T03:04:19.757287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1869,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:18.049760+0000","last_change":"2024-05-08T02:45:31.616723+0000","last_active":"2024-05-08T03:04:18.049760+0000","last_peered":"2024-05-08T03:04:18.049760+0000","last_clean":"2024-05-08T03:04:18.049760+0000","last_became_active":"2024-05-08T02:45:31.611005+0000","last_became_peered":"2024-05-08T02:45:31.611005+0000","last_unstale":"2024-05-08T03:04:18.049760+0000","last_undegraded":"2024-05-08T03:04:18.049760+0000","last_fullsized":"2024-05-08T03:04:18.049760+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1891,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.606003+0000","last_change":"2024-05-08T02:45:31.623778+0000","last_active":"2024-05-08T03:04:19.606003+0000","last_peered":"2024-05-08T03:04:19.606003+0000","last_clean":"2024-05-08T03:04:19.606003+0000","last_became_active":"2024-05-08T02:45:31.617883+0000","last_became_peered":"2024-05-08T02:45:31.617883+0000","last_unstale":"2024-05-08T03:04:19.606003+0000","last_undegraded":"2024-05-08T03:04:19.606003+0000","last_fullsized":"2024-05-08T03:04:19.606003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1881,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.769811+0000","last_change":"2024-05-08T02:45:31.634126+0000","last_active":"2024-05-08T03:04:16.769811+0000","last_peered":"2024-05-08T03:04:16.769811+0000","last_clean":"2024-05-08T03:04:16.769811+0000","last_became_active":"2024-05-08T02:45:31.628702+0000","last_became_peered":"2024-05-08T02:45:31.628702+0000","last_unstale":"2024-05-08T03:04:16.769811+0000","last_undegraded":"2024-05-08T03:04:16.769811+0000","last_fullsized":"2024-05-08T03:04:16.769811+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1887,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.728207+0000","last_change":"2024-05-08T02:45:31.621292+0000","last_active":"2024-05-08T03:04:19.728207+0000","last_peered":"2024-05-08T03:04:19.728207+0000","last_clean":"2024-05-08T03:04:19.728207+0000","last_became_active":"2024-05-08T02:45:31.615285+0000","last_became_peered":"2024-05-08T02:45:31.615285+0000","last_unstale":"2024-05-08T03:04:19.728207+0000","last_undegraded":"2024-05-08T03:04:19.728207+0000","last_fullsized":"2024-05-08T03:04:19.728207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1881,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.643267+0000","last_change":"2024-05-08T02:45:31.635093+0000","last_active":"2024-05-08T03:04:16.643267+0000","last_peered":"2024-05-08T03:04:16.643267+0000","last_clean":"2024-05-08T03:04:16.643267+0000","last_became_active":"2024-05-08T02:45:31.629721+0000","last_became_peered":"2024-05-08T02:45:31.629721+0000","last_unstale":"2024-05-08T03:04:16.643267+0000","last_undegraded":"2024-05-08T03:04:16.643267+0000","last_fullsized":"2024-05-08T03:04:16.643267+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1887,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.926275+0000","last_change":"2024-05-08T02:45:31.648464+0000","last_active":"2024-05-08T03:04:19.926275+0000","last_peered":"2024-05-08T03:04:19.926275+0000","last_clean":"2024-05-08T03:04:19.926275+0000","last_became_active":"2024-05-08T02:45:31.642977+0000","last_became_peered":"2024-05-08T02:45:31.642977+0000","last_unstale":"2024-05-08T03:04:19.926275+0000","last_undegraded":"2024-05-08T03:04:19.926275+0000","last_fullsized":"2024-05-08T03:04:19.926275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2002,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.907539+0000","last_change":"2024-05-08T02:45:29.600723+0000","last_active":"2024-05-08T03:04:17.907539+0000","last_peered":"2024-05-08T03:04:17.907539+0000","last_clean":"2024-05-08T03:04:17.907539+0000","last_became_active":"2024-05-08T02:45:29.595527+0000","last_became_peered":"2024-05-08T02:45:29.595527+0000","last_unstale":"2024-05-08T03:04:17.907539+0000","last_undegraded":"2024-05-08T03:04:17.907539+0000","last_fullsized":"2024-05-08T03:04:17.907539+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_clean_scrub_stamp":"2024-05-08T02:45:28.553006+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77892,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779708,"statfs":{"total":107374182400,"available":107294420992,"internally_reserved":0,"allocated":2420736,"data_stored":1207077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64948,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792652,"statfs":{"total":107374182400,"available":107307675648,"internally_reserved":0,"allocated":1945600,"data_stored":655816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64876,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792724,"statfs":{"total":107374182400,"available":107307749376,"internally_reserved":0,"allocated":1871872,"data_stored":652657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":65480,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792120,"statfs":{"total":107374182400,"available":107307130880,"internally_reserved":0,"allocated":2490368,"data_stored":1259619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T03:04:49.492 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T03:04:49.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.598+0000 7fc7d319d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:49.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.603+0000 7fc7d319d640 1 Processor -- start 2024-05-08T03:04:49.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.603+0000 7fc7d319d640 1 -- start start 2024-05-08T03:04:49.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.605+0000 7fc7d319d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7cc132250 0x7fc7cc136c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:49.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.605+0000 7fc7d319d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7cc09cb70 con 0x7fc7cc131730 2024-05-08T03:04:49.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.605+0000 7fc7d319d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc7cc09dcc0 con 0x7fc7cc132250 2024-05-08T03:04:49.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.605+0000 7fc7cbfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc7cc132250 0x7fc7cc136c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:49.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.605+0000 7fc7d0f39640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc7cc131730 0x7fc7cc131b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52964/0 (socket says 172.21.15.46:52964) 2024-05-08T03:04:49.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.605+0000 7fc7d0f39640 1 -- 172.21.15.46:0/817208957 learned_addr learned my addr 172.21.15.46:0/817208957 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:49.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.606+0000 7fc7cbfff640 1 -- 172.21.15.46:0/817208957 >> v1:172.21.15.46:6789/0 conn(0x7fc7cc131730 legacy=0x7fc7cc131b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.606+0000 7fc7cbfff640 1 -- 172.21.15.46:0/817208957 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc09d9b0 con 0x7fc7cc132250 2024-05-08T03:04:49.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.606+0000 7fc7cbfff640 1 --2- 172.21.15.46:0/817208957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc132250 0x7fc7cc136c60 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d68c64c1dc3de07 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:49.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.606+0000 7fc7cb7fe640 1 -- 172.21.15.46:0/817208957 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc7c0009d90 con 0x7fc7cc132250 2024-05-08T03:04:49.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.606+0000 7fc7cb7fe640 1 -- 172.21.15.46:0/817208957 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc7c000e230 con 0x7fc7cc132250 2024-05-08T03:04:49.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.606+0000 7fc7cb7fe640 1 -- 172.21.15.46:0/817208957 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc7c000e4d0 con 0x7fc7cc132250 2024-05-08T03:04:49.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.607+0000 7fc7d319d640 1 -- 172.21.15.46:0/817208957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc132250 msgr2=0x7fc7cc136c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.607+0000 7fc7d319d640 1 --2- 172.21.15.46:0/817208957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc132250 0x7fc7cc136c60 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.607+0000 7fc7d319d640 1 -- 172.21.15.46:0/817208957 shutdown_connections 2024-05-08T03:04:49.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.607+0000 7fc7d319d640 1 --2- 172.21.15.46:0/817208957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc132250 0x7fc7cc136c60 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.607+0000 7fc7d319d640 1 -- 172.21.15.46:0/817208957 >> 172.21.15.46:0/817208957 conn(0x7fc7cc0a1a80 msgr2=0x7fc7cc0a1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:49.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.607+0000 7fc7d319d640 1 -- 172.21.15.46:0/817208957 shutdown_connections 2024-05-08T03:04:49.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.607+0000 7fc7d319d640 1 -- 172.21.15.46:0/817208957 wait complete. 2024-05-08T03:04:49.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.607+0000 7fc7d319d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:49.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.609+0000 7fc7d319d640 1 Processor -- start 2024-05-08T03:04:49.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.609+0000 7fc7d319d640 1 -- start start 2024-05-08T03:04:49.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.610+0000 7fc7d319d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc131730 0x7fc7cc11adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:49.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.610+0000 7fc7d319d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1222a0 con 0x7fc7cc131730 2024-05-08T03:04:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.610+0000 7fc7d0f39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc131730 0x7fc7cc11adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.610+0000 7fc7d0f39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc131730 0x7fc7cc11adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58680/0 (socket says 172.21.15.46:58680) 2024-05-08T03:04:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.610+0000 7fc7d0f39640 1 -- 172.21.15.46:0/3647713230 learned_addr learned my addr 172.21.15.46:0/3647713230 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.611+0000 7fc7d0f39640 1 -- 172.21.15.46:0/3647713230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc06b480 con 0x7fc7cc131730 2024-05-08T03:04:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.611+0000 7fc7d0f39640 1 --2- 172.21.15.46:0/3647713230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc131730 0x7fc7cc11adf0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:49.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.611+0000 7fc7c97fa640 1 -- 172.21.15.46:0/3647713230 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc7bc005a60 con 0x7fc7cc131730 2024-05-08T03:04:49.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.611+0000 7fc7c97fa640 1 -- 172.21.15.46:0/3647713230 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc7bc005bc0 con 0x7fc7cc131730 2024-05-08T03:04:49.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.611+0000 7fc7c97fa640 1 -- 172.21.15.46:0/3647713230 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc7bc005e60 con 0x7fc7cc131730 2024-05-08T03:04:49.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.611+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7cc06c090 con 0x7fc7cc131730 2024-05-08T03:04:49.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.611+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7cc06c8a0 con 0x7fc7cc131730 2024-05-08T03:04:49.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.612+0000 7fc7c97fa640 1 -- 172.21.15.46:0/3647713230 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc7bc00c780 con 0x7fc7cc131730 2024-05-08T03:04:49.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.612+0000 7fc7c97fa640 1 --2- 172.21.15.46:0/3647713230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc7b8038980 0x7fc7b803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:49.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.612+0000 7fc7c97fa640 1 -- 172.21.15.46:0/3647713230 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7fc7bc048290 con 0x7fc7cc131730 2024-05-08T03:04:49.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.612+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7cc0739c0 con 0x7fc7cc131730 2024-05-08T03:04:49.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.613+0000 7fc7cbfff640 1 --2- 172.21.15.46:0/3647713230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc7b8038980 0x7fc7b803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:49.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.613+0000 7fc7cbfff640 1 --2- 172.21.15.46:0/3647713230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc7b8038980 0x7fc7b803ae90 crc :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:49.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.618+0000 7fc7c97fa640 1 -- 172.21.15.46:0/3647713230 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fc7bc0070b0 con 0x7fc7cc131730 2024-05-08T03:04:49.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.807+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7cc06b480 con 0x7fc7b8038980 2024-05-08T03:04:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.812+0000 7fc7c97fa640 1 -- 172.21.15.46:0/3647713230 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109144 (crc 0 0 0) 0x7fc7cc06b480 con 0x7fc7b8038980 2024-05-08T03:04:49.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T03:04:49.817 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-08T03:04:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc7b8038980 msgr2=0x7fc7b803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 --2- 172.21.15.46:0/3647713230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc7b8038980 0x7fc7b803ae90 crc :-1 s=READY pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc131730 msgr2=0x7fc7cc11adf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 --2- 172.21.15.46:0/3647713230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc131730 0x7fc7cc11adf0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 shutdown_connections 2024-05-08T03:04:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 --2- 172.21.15.46:0/3647713230 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc7b8038980 0x7fc7b803ae90 unknown :-1 s=CLOSED pgs=3875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 --2- 172.21.15.46:0/3647713230 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7cc131730 0x7fc7cc11adf0 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 >> 172.21.15.46:0/3647713230 conn(0x7fc7cc0a1a80 msgr2=0x7fc7cc09efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 shutdown_connections 2024-05-08T03:04:49.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.815+0000 7fc7d319d640 1 -- 172.21.15.46:0/3647713230 wait complete. 2024-05-08T03:04:49.834 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1288,"stamp":"2024-05-08T03:04:48.802023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":273196,"kb_used_data":8524,"kb_used_omap":0,"kb_used_meta":264640,"kb_avail":419157204,"statfs":{"total":429496729600,"available":429216976896,"internally_reserved":0,"allocated":8728576,"data_stored":3775169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":270991360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-299550,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002571"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.746337+0000","last_change":"2024-05-08T02:51:09.430157+0000","last_active":"2024-05-08T03:04:19.746337+0000","last_peered":"2024-05-08T03:04:19.746337+0000","last_clean":"2024-05-08T03:04:19.746337+0000","last_became_active":"2024-05-08T02:51:09.414974+0000","last_became_peered":"2024-05-08T02:51:09.414974+0000","last_unstale":"2024-05-08T03:04:19.746337+0000","last_undegraded":"2024-05-08T03:04:19.746337+0000","last_fullsized":"2024-05-08T03:04:19.746337+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.472460+0000","last_change":"2024-05-08T02:51:09.437442+0000","last_active":"2024-05-08T03:04:16.472460+0000","last_peered":"2024-05-08T03:04:16.472460+0000","last_clean":"2024-05-08T03:04:16.472460+0000","last_became_active":"2024-05-08T02:51:09.429857+0000","last_became_peered":"2024-05-08T02:51:09.429857+0000","last_unstale":"2024-05-08T03:04:16.472460+0000","last_undegraded":"2024-05-08T03:04:16.472460+0000","last_fullsized":"2024-05-08T03:04:16.472460+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.640820+0000","last_change":"2024-05-08T02:51:09.428422+0000","last_active":"2024-05-08T03:04:19.640820+0000","last_peered":"2024-05-08T03:04:19.640820+0000","last_clean":"2024-05-08T03:04:19.640820+0000","last_became_active":"2024-05-08T02:51:09.422128+0000","last_became_peered":"2024-05-08T02:51:09.422128+0000","last_unstale":"2024-05-08T03:04:19.640820+0000","last_undegraded":"2024-05-08T03:04:19.640820+0000","last_fullsized":"2024-05-08T03:04:19.640820+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.909774+0000","last_change":"2024-05-08T02:51:09.514243+0000","last_active":"2024-05-08T03:04:17.909774+0000","last_peered":"2024-05-08T03:04:17.909774+0000","last_clean":"2024-05-08T03:04:17.909774+0000","last_became_active":"2024-05-08T02:51:09.509773+0000","last_became_peered":"2024-05-08T02:51:09.509773+0000","last_unstale":"2024-05-08T03:04:17.909774+0000","last_undegraded":"2024-05-08T03:04:17.909774+0000","last_fullsized":"2024-05-08T03:04:17.909774+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.706769+0000","last_change":"2024-05-08T02:51:09.525448+0000","last_active":"2024-05-08T03:04:19.706769+0000","last_peered":"2024-05-08T03:04:19.706769+0000","last_clean":"2024-05-08T03:04:19.706769+0000","last_became_active":"2024-05-08T02:51:09.520146+0000","last_became_peered":"2024-05-08T02:51:09.520146+0000","last_unstale":"2024-05-08T03:04:19.706769+0000","last_undegraded":"2024-05-08T03:04:19.706769+0000","last_fullsized":"2024-05-08T03:04:19.706769+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.529961+0000","last_change":"2024-05-08T02:51:09.479496+0000","last_active":"2024-05-08T03:04:16.529961+0000","last_peered":"2024-05-08T03:04:16.529961+0000","last_clean":"2024-05-08T03:04:16.529961+0000","last_became_active":"2024-05-08T02:51:09.464789+0000","last_became_peered":"2024-05-08T02:51:09.464789+0000","last_unstale":"2024-05-08T03:04:16.529961+0000","last_undegraded":"2024-05-08T03:04:16.529961+0000","last_fullsized":"2024-05-08T03:04:16.529961+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.515528+0000","last_change":"2024-05-08T02:51:09.495786+0000","last_active":"2024-05-08T03:04:16.515528+0000","last_peered":"2024-05-08T03:04:16.515528+0000","last_clean":"2024-05-08T03:04:16.515528+0000","last_became_active":"2024-05-08T02:51:09.490174+0000","last_became_peered":"2024-05-08T02:51:09.490174+0000","last_unstale":"2024-05-08T03:04:16.515528+0000","last_undegraded":"2024-05-08T03:04:16.515528+0000","last_fullsized":"2024-05-08T03:04:16.515528+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.489022+0000","last_change":"2024-05-08T02:51:09.483583+0000","last_active":"2024-05-08T03:04:16.489022+0000","last_peered":"2024-05-08T03:04:16.489022+0000","last_clean":"2024-05-08T03:04:16.489022+0000","last_became_active":"2024-05-08T02:51:09.473858+0000","last_became_peered":"2024-05-08T02:51:09.473858+0000","last_unstale":"2024-05-08T03:04:16.489022+0000","last_undegraded":"2024-05-08T03:04:16.489022+0000","last_fullsized":"2024-05-08T03:04:16.489022+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.841052+0000","last_change":"2024-05-08T02:51:09.428825+0000","last_active":"2024-05-08T03:04:17.841052+0000","last_peered":"2024-05-08T03:04:17.841052+0000","last_clean":"2024-05-08T03:04:17.841052+0000","last_became_active":"2024-05-08T02:51:09.419746+0000","last_became_peered":"2024-05-08T02:51:09.419746+0000","last_unstale":"2024-05-08T03:04:17.841052+0000","last_undegraded":"2024-05-08T03:04:17.841052+0000","last_fullsized":"2024-05-08T03:04:17.841052+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.657736+0000","last_change":"2024-05-08T02:51:09.425411+0000","last_active":"2024-05-08T03:04:19.657736+0000","last_peered":"2024-05-08T03:04:19.657736+0000","last_clean":"2024-05-08T03:04:19.657736+0000","last_became_active":"2024-05-08T02:51:09.412840+0000","last_became_peered":"2024-05-08T02:51:09.412840+0000","last_unstale":"2024-05-08T03:04:19.657736+0000","last_undegraded":"2024-05-08T03:04:19.657736+0000","last_fullsized":"2024-05-08T03:04:19.657736+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.881641+0000","last_change":"2024-05-08T02:51:09.535779+0000","last_active":"2024-05-08T03:04:17.881641+0000","last_peered":"2024-05-08T03:04:17.881641+0000","last_clean":"2024-05-08T03:04:17.881641+0000","last_became_active":"2024-05-08T02:51:09.531607+0000","last_became_peered":"2024-05-08T02:51:09.531607+0000","last_unstale":"2024-05-08T03:04:17.881641+0000","last_undegraded":"2024-05-08T03:04:17.881641+0000","last_fullsized":"2024-05-08T03:04:17.881641+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.480717+0000","last_change":"2024-05-08T02:51:09.485826+0000","last_active":"2024-05-08T03:04:16.480717+0000","last_peered":"2024-05-08T03:04:16.480717+0000","last_clean":"2024-05-08T03:04:16.480717+0000","last_became_active":"2024-05-08T02:51:09.469507+0000","last_became_peered":"2024-05-08T02:51:09.469507+0000","last_unstale":"2024-05-08T03:04:16.480717+0000","last_undegraded":"2024-05-08T03:04:16.480717+0000","last_fullsized":"2024-05-08T03:04:16.480717+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.873475+0000","last_change":"2024-05-08T02:51:09.469162+0000","last_active":"2024-05-08T03:04:17.873475+0000","last_peered":"2024-05-08T03:04:17.873475+0000","last_clean":"2024-05-08T03:04:17.873475+0000","last_became_active":"2024-05-08T02:51:09.455287+0000","last_became_peered":"2024-05-08T02:51:09.455287+0000","last_unstale":"2024-05-08T03:04:17.873475+0000","last_undegraded":"2024-05-08T03:04:17.873475+0000","last_fullsized":"2024-05-08T03:04:17.873475+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.898314+0000","last_change":"2024-05-08T02:51:09.498571+0000","last_active":"2024-05-08T03:04:17.898314+0000","last_peered":"2024-05-08T03:04:17.898314+0000","last_clean":"2024-05-08T03:04:17.898314+0000","last_became_active":"2024-05-08T02:51:09.492168+0000","last_became_peered":"2024-05-08T02:51:09.492168+0000","last_unstale":"2024-05-08T03:04:17.898314+0000","last_undegraded":"2024-05-08T03:04:17.898314+0000","last_fullsized":"2024-05-08T03:04:17.898314+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.439741+0000","last_change":"2024-05-08T02:51:09.552657+0000","last_active":"2024-05-08T03:04:16.439741+0000","last_peered":"2024-05-08T03:04:16.439741+0000","last_clean":"2024-05-08T03:04:16.439741+0000","last_became_active":"2024-05-08T02:51:09.545524+0000","last_became_peered":"2024-05-08T02:51:09.545524+0000","last_unstale":"2024-05-08T03:04:16.439741+0000","last_undegraded":"2024-05-08T03:04:16.439741+0000","last_fullsized":"2024-05-08T03:04:16.439741+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.510341+0000","last_change":"2024-05-08T02:51:09.505576+0000","last_active":"2024-05-08T03:04:16.510341+0000","last_peered":"2024-05-08T03:04:16.510341+0000","last_clean":"2024-05-08T03:04:16.510341+0000","last_became_active":"2024-05-08T02:51:09.498798+0000","last_became_peered":"2024-05-08T02:51:09.498798+0000","last_unstale":"2024-05-08T03:04:16.510341+0000","last_undegraded":"2024-05-08T03:04:16.510341+0000","last_fullsized":"2024-05-08T03:04:16.510341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.506929+0000","last_change":"2024-05-08T02:51:09.449392+0000","last_active":"2024-05-08T03:04:16.506929+0000","last_peered":"2024-05-08T03:04:16.506929+0000","last_clean":"2024-05-08T03:04:16.506929+0000","last_became_active":"2024-05-08T02:51:09.440822+0000","last_became_peered":"2024-05-08T02:51:09.440822+0000","last_unstale":"2024-05-08T03:04:16.506929+0000","last_undegraded":"2024-05-08T03:04:16.506929+0000","last_fullsized":"2024-05-08T03:04:16.506929+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.893036+0000","last_change":"2024-05-08T02:51:09.462545+0000","last_active":"2024-05-08T03:04:17.893036+0000","last_peered":"2024-05-08T03:04:17.893036+0000","last_clean":"2024-05-08T03:04:17.893036+0000","last_became_active":"2024-05-08T02:51:09.449604+0000","last_became_peered":"2024-05-08T02:51:09.449604+0000","last_unstale":"2024-05-08T03:04:17.893036+0000","last_undegraded":"2024-05-08T03:04:17.893036+0000","last_fullsized":"2024-05-08T03:04:17.893036+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.645218+0000","last_change":"2024-05-08T02:51:09.416372+0000","last_active":"2024-05-08T03:04:19.645218+0000","last_peered":"2024-05-08T03:04:19.645218+0000","last_clean":"2024-05-08T03:04:19.645218+0000","last_became_active":"2024-05-08T02:51:09.408878+0000","last_became_peered":"2024-05-08T02:51:09.408878+0000","last_unstale":"2024-05-08T03:04:19.645218+0000","last_undegraded":"2024-05-08T03:04:19.645218+0000","last_fullsized":"2024-05-08T03:04:19.645218+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.704810+0000","last_change":"2024-05-08T02:51:09.499815+0000","last_active":"2024-05-08T03:04:19.704810+0000","last_peered":"2024-05-08T03:04:19.704810+0000","last_clean":"2024-05-08T03:04:19.704810+0000","last_became_active":"2024-05-08T02:51:09.493372+0000","last_became_peered":"2024-05-08T02:51:09.493372+0000","last_unstale":"2024-05-08T03:04:19.704810+0000","last_undegraded":"2024-05-08T03:04:19.704810+0000","last_fullsized":"2024-05-08T03:04:19.704810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.743603+0000","last_change":"2024-05-08T02:51:09.478707+0000","last_active":"2024-05-08T03:04:19.743603+0000","last_peered":"2024-05-08T03:04:19.743603+0000","last_clean":"2024-05-08T03:04:19.743603+0000","last_became_active":"2024-05-08T02:51:09.466931+0000","last_became_peered":"2024-05-08T02:51:09.466931+0000","last_unstale":"2024-05-08T03:04:19.743603+0000","last_undegraded":"2024-05-08T03:04:19.743603+0000","last_fullsized":"2024-05-08T03:04:19.743603+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.727210+0000","last_change":"2024-05-08T02:51:09.485829+0000","last_active":"2024-05-08T03:04:19.727210+0000","last_peered":"2024-05-08T03:04:19.727210+0000","last_clean":"2024-05-08T03:04:19.727210+0000","last_became_active":"2024-05-08T02:51:09.475586+0000","last_became_peered":"2024-05-08T02:51:09.475586+0000","last_unstale":"2024-05-08T03:04:19.727210+0000","last_undegraded":"2024-05-08T03:04:19.727210+0000","last_fullsized":"2024-05-08T03:04:19.727210+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.620157+0000","last_change":"2024-05-08T02:51:09.459058+0000","last_active":"2024-05-08T03:04:19.620157+0000","last_peered":"2024-05-08T03:04:19.620157+0000","last_clean":"2024-05-08T03:04:19.620157+0000","last_became_active":"2024-05-08T02:51:09.448780+0000","last_became_peered":"2024-05-08T02:51:09.448780+0000","last_unstale":"2024-05-08T03:04:19.620157+0000","last_undegraded":"2024-05-08T03:04:19.620157+0000","last_fullsized":"2024-05-08T03:04:19.620157+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.899212+0000","last_change":"2024-05-08T02:51:09.452398+0000","last_active":"2024-05-08T03:04:17.899212+0000","last_peered":"2024-05-08T03:04:17.899212+0000","last_clean":"2024-05-08T03:04:17.899212+0000","last_became_active":"2024-05-08T02:51:09.440069+0000","last_became_peered":"2024-05-08T02:51:09.440069+0000","last_unstale":"2024-05-08T03:04:17.899212+0000","last_undegraded":"2024-05-08T03:04:17.899212+0000","last_fullsized":"2024-05-08T03:04:17.899212+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.872326+0000","last_change":"2024-05-08T02:51:09.479443+0000","last_active":"2024-05-08T03:04:17.872326+0000","last_peered":"2024-05-08T03:04:17.872326+0000","last_clean":"2024-05-08T03:04:17.872326+0000","last_became_active":"2024-05-08T02:51:09.472343+0000","last_became_peered":"2024-05-08T02:51:09.472343+0000","last_unstale":"2024-05-08T03:04:17.872326+0000","last_undegraded":"2024-05-08T03:04:17.872326+0000","last_fullsized":"2024-05-08T03:04:17.872326+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.465288+0000","last_change":"2024-05-08T02:51:09.539867+0000","last_active":"2024-05-08T03:04:16.465288+0000","last_peered":"2024-05-08T03:04:16.465288+0000","last_clean":"2024-05-08T03:04:16.465288+0000","last_became_active":"2024-05-08T02:51:09.532094+0000","last_became_peered":"2024-05-08T02:51:09.532094+0000","last_unstale":"2024-05-08T03:04:16.465288+0000","last_undegraded":"2024-05-08T03:04:16.465288+0000","last_fullsized":"2024-05-08T03:04:16.465288+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.857431+0000","last_change":"2024-05-08T02:51:09.459701+0000","last_active":"2024-05-08T03:04:17.857431+0000","last_peered":"2024-05-08T03:04:17.857431+0000","last_clean":"2024-05-08T03:04:17.857431+0000","last_became_active":"2024-05-08T02:51:09.443431+0000","last_became_peered":"2024-05-08T02:51:09.443431+0000","last_unstale":"2024-05-08T03:04:17.857431+0000","last_undegraded":"2024-05-08T03:04:17.857431+0000","last_fullsized":"2024-05-08T03:04:17.857431+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.536157+0000","last_change":"2024-05-08T02:51:09.523580+0000","last_active":"2024-05-08T03:04:16.536157+0000","last_peered":"2024-05-08T03:04:16.536157+0000","last_clean":"2024-05-08T03:04:16.536157+0000","last_became_active":"2024-05-08T02:51:09.515226+0000","last_became_peered":"2024-05-08T02:51:09.515226+0000","last_unstale":"2024-05-08T03:04:16.536157+0000","last_undegraded":"2024-05-08T03:04:16.536157+0000","last_fullsized":"2024-05-08T03:04:16.536157+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.521789+0000","last_change":"2024-05-08T02:51:09.446239+0000","last_active":"2024-05-08T03:04:16.521789+0000","last_peered":"2024-05-08T03:04:16.521789+0000","last_clean":"2024-05-08T03:04:16.521789+0000","last_became_active":"2024-05-08T02:51:09.433946+0000","last_became_peered":"2024-05-08T02:51:09.433946+0000","last_unstale":"2024-05-08T03:04:16.521789+0000","last_undegraded":"2024-05-08T03:04:16.521789+0000","last_fullsized":"2024-05-08T03:04:16.521789+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.509222+0000","last_change":"2024-05-08T02:51:09.577416+0000","last_active":"2024-05-08T03:04:16.509222+0000","last_peered":"2024-05-08T03:04:16.509222+0000","last_clean":"2024-05-08T03:04:16.509222+0000","last_became_active":"2024-05-08T02:51:09.570979+0000","last_became_peered":"2024-05-08T02:51:09.570979+0000","last_unstale":"2024-05-08T03:04:16.509222+0000","last_undegraded":"2024-05-08T03:04:16.509222+0000","last_fullsized":"2024-05-08T03:04:16.509222+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1302,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.737519+0000","last_change":"2024-05-08T02:51:09.425933+0000","last_active":"2024-05-08T03:04:19.737519+0000","last_peered":"2024-05-08T03:04:19.737519+0000","last_clean":"2024-05-08T03:04:19.737519+0000","last_became_active":"2024-05-08T02:51:09.419747+0000","last_became_peered":"2024-05-08T02:51:09.419747+0000","last_unstale":"2024-05-08T03:04:19.737519+0000","last_undegraded":"2024-05-08T03:04:19.737519+0000","last_fullsized":"2024-05-08T03:04:19.737519+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.636523+0000","last_change":"2024-05-08T02:51:09.462720+0000","last_active":"2024-05-08T03:04:19.636523+0000","last_peered":"2024-05-08T03:04:19.636523+0000","last_clean":"2024-05-08T03:04:19.636523+0000","last_became_active":"2024-05-08T02:51:09.454882+0000","last_became_peered":"2024-05-08T02:51:09.454882+0000","last_unstale":"2024-05-08T03:04:19.636523+0000","last_undegraded":"2024-05-08T03:04:19.636523+0000","last_fullsized":"2024-05-08T03:04:19.636523+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1887,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.858939+0000","last_change":"2024-05-08T02:45:31.653041+0000","last_active":"2024-05-08T03:04:19.858939+0000","last_peered":"2024-05-08T03:04:19.858939+0000","last_clean":"2024-05-08T03:04:19.858939+0000","last_became_active":"2024-05-08T02:45:31.647316+0000","last_became_peered":"2024-05-08T02:45:31.647316+0000","last_unstale":"2024-05-08T03:04:19.858939+0000","last_undegraded":"2024-05-08T03:04:19.858939+0000","last_fullsized":"2024-05-08T03:04:19.858939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1891,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.757287+0000","last_change":"2024-05-08T02:45:31.640980+0000","last_active":"2024-05-08T03:04:19.757287+0000","last_peered":"2024-05-08T03:04:19.757287+0000","last_clean":"2024-05-08T03:04:19.757287+0000","last_became_active":"2024-05-08T02:45:31.636059+0000","last_became_peered":"2024-05-08T02:45:31.636059+0000","last_unstale":"2024-05-08T03:04:19.757287+0000","last_undegraded":"2024-05-08T03:04:19.757287+0000","last_fullsized":"2024-05-08T03:04:19.757287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1869,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:18.049760+0000","last_change":"2024-05-08T02:45:31.616723+0000","last_active":"2024-05-08T03:04:18.049760+0000","last_peered":"2024-05-08T03:04:18.049760+0000","last_clean":"2024-05-08T03:04:18.049760+0000","last_became_active":"2024-05-08T02:45:31.611005+0000","last_became_peered":"2024-05-08T02:45:31.611005+0000","last_unstale":"2024-05-08T03:04:18.049760+0000","last_undegraded":"2024-05-08T03:04:18.049760+0000","last_fullsized":"2024-05-08T03:04:18.049760+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1891,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.606003+0000","last_change":"2024-05-08T02:45:31.623778+0000","last_active":"2024-05-08T03:04:19.606003+0000","last_peered":"2024-05-08T03:04:19.606003+0000","last_clean":"2024-05-08T03:04:19.606003+0000","last_became_active":"2024-05-08T02:45:31.617883+0000","last_became_peered":"2024-05-08T02:45:31.617883+0000","last_unstale":"2024-05-08T03:04:19.606003+0000","last_undegraded":"2024-05-08T03:04:19.606003+0000","last_fullsized":"2024-05-08T03:04:19.606003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1881,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.769811+0000","last_change":"2024-05-08T02:45:31.634126+0000","last_active":"2024-05-08T03:04:16.769811+0000","last_peered":"2024-05-08T03:04:16.769811+0000","last_clean":"2024-05-08T03:04:16.769811+0000","last_became_active":"2024-05-08T02:45:31.628702+0000","last_became_peered":"2024-05-08T02:45:31.628702+0000","last_unstale":"2024-05-08T03:04:16.769811+0000","last_undegraded":"2024-05-08T03:04:16.769811+0000","last_fullsized":"2024-05-08T03:04:16.769811+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1887,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.728207+0000","last_change":"2024-05-08T02:45:31.621292+0000","last_active":"2024-05-08T03:04:19.728207+0000","last_peered":"2024-05-08T03:04:19.728207+0000","last_clean":"2024-05-08T03:04:19.728207+0000","last_became_active":"2024-05-08T02:45:31.615285+0000","last_became_peered":"2024-05-08T02:45:31.615285+0000","last_unstale":"2024-05-08T03:04:19.728207+0000","last_undegraded":"2024-05-08T03:04:19.728207+0000","last_fullsized":"2024-05-08T03:04:19.728207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1881,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.643267+0000","last_change":"2024-05-08T02:45:31.635093+0000","last_active":"2024-05-08T03:04:16.643267+0000","last_peered":"2024-05-08T03:04:16.643267+0000","last_clean":"2024-05-08T03:04:16.643267+0000","last_became_active":"2024-05-08T02:45:31.629721+0000","last_became_peered":"2024-05-08T02:45:31.629721+0000","last_unstale":"2024-05-08T03:04:16.643267+0000","last_undegraded":"2024-05-08T03:04:16.643267+0000","last_fullsized":"2024-05-08T03:04:16.643267+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1887,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.926275+0000","last_change":"2024-05-08T02:45:31.648464+0000","last_active":"2024-05-08T03:04:19.926275+0000","last_peered":"2024-05-08T03:04:19.926275+0000","last_clean":"2024-05-08T03:04:19.926275+0000","last_became_active":"2024-05-08T02:45:31.642977+0000","last_became_peered":"2024-05-08T02:45:31.642977+0000","last_unstale":"2024-05-08T03:04:19.926275+0000","last_undegraded":"2024-05-08T03:04:19.926275+0000","last_fullsized":"2024-05-08T03:04:19.926275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2002,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.907539+0000","last_change":"2024-05-08T02:45:29.600723+0000","last_active":"2024-05-08T03:04:17.907539+0000","last_peered":"2024-05-08T03:04:17.907539+0000","last_clean":"2024-05-08T03:04:17.907539+0000","last_became_active":"2024-05-08T02:45:29.595527+0000","last_became_peered":"2024-05-08T02:45:29.595527+0000","last_unstale":"2024-05-08T03:04:17.907539+0000","last_undegraded":"2024-05-08T03:04:17.907539+0000","last_fullsized":"2024-05-08T03:04:17.907539+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_clean_scrub_stamp":"2024-05-08T02:45:28.553006+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77892,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779708,"statfs":{"total":107374182400,"available":107294420992,"internally_reserved":0,"allocated":2420736,"data_stored":1207077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64948,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792652,"statfs":{"total":107374182400,"available":107307675648,"internally_reserved":0,"allocated":1945600,"data_stored":655816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64876,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792724,"statfs":{"total":107374182400,"available":107307749376,"internally_reserved":0,"allocated":1871872,"data_stored":652657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":65480,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792120,"statfs":{"total":107374182400,"available":107307130880,"internally_reserved":0,"allocated":2490368,"data_stored":1259619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T03:04:49.836 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T03:04:49.836 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T03:04:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.961+0000 7f228ff9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.967+0000 7f228ff9d640 1 Processor -- start 2024-05-08T03:04:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.968+0000 7f228ff9d640 1 -- start start 2024-05-08T03:04:49.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.969+0000 7f228ff9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f22880709f0 0x7f2288070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:49.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.969+0000 7f228ff9d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2288072390 con 0x7f2288071340 2024-05-08T03:04:49.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.969+0000 7f228ff9d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f22880720f0 con 0x7f22880709f0 2024-05-08T03:04:49.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.969+0000 7f228dd39640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f22880709f0 0x7f2288070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:49.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.970+0000 7f228d538640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2288071340 0x7f228812f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52980/0 (socket says 172.21.15.46:52980) 2024-05-08T03:04:49.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.970+0000 7f228d538640 1 -- 172.21.15.46:0/2246049595 learned_addr learned my addr 172.21.15.46:0/2246049595 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:49.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.970+0000 7f228dd39640 1 -- 172.21.15.46:0/2246049595 >> v1:172.21.15.46:6789/0 conn(0x7f2288071340 legacy=0x7f228812f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.970+0000 7f228cd37640 1 -- 172.21.15.46:0/2246049595 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135417108 0 0) 0x7f2288072390 con 0x7f2288071340 2024-05-08T03:04:49.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.970+0000 7f228dd39640 1 -- 172.21.15.46:0/2246049595 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2288073b60 con 0x7f22880709f0 2024-05-08T03:04:49.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.970+0000 7f228dd39640 1 --2- 172.21.15.46:0/2246049595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 0x7f2288070e00 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5013ddb5506af57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:49.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.970+0000 7f228cd37640 1 -- 172.21.15.46:0/2246049595 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2284009d90 con 0x7f22880709f0 2024-05-08T03:04:49.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.971+0000 7f228cd37640 1 -- 172.21.15.46:0/2246049595 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f228400e230 con 0x7f22880709f0 2024-05-08T03:04:49.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.971+0000 7f228cd37640 1 -- 172.21.15.46:0/2246049595 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f228400e4d0 con 0x7f22880709f0 2024-05-08T03:04:49.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.972+0000 7f228ff9d640 1 -- 172.21.15.46:0/2246049595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 msgr2=0x7f2288070e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:49.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.972+0000 7f228ff9d640 1 --2- 172.21.15.46:0/2246049595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 0x7f2288070e00 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.972+0000 7f228ff9d640 1 -- 172.21.15.46:0/2246049595 shutdown_connections 2024-05-08T03:04:49.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.972+0000 7f228ff9d640 1 --2- 172.21.15.46:0/2246049595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 0x7f2288070e00 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:49.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.972+0000 7f228ff9d640 1 -- 172.21.15.46:0/2246049595 >> 172.21.15.46:0/2246049595 conn(0x7f22880a1830 msgr2=0x7f22880a1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:49.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.972+0000 7f228ff9d640 1 -- 172.21.15.46:0/2246049595 shutdown_connections 2024-05-08T03:04:49.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.972+0000 7f228ff9d640 1 -- 172.21.15.46:0/2246049595 wait complete. 2024-05-08T03:04:49.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.972+0000 7f228ff9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:49.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.975+0000 7f228ff9d640 1 Processor -- start 2024-05-08T03:04:49.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.975+0000 7f228ff9d640 1 -- start start 2024-05-08T03:04:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.978+0000 7f228ff9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 0x7f228811ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.978+0000 7f228ff9d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2288074e70 con 0x7f22880709f0 2024-05-08T03:04:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.978+0000 7f228dd39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 0x7f228811ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.978+0000 7f228dd39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 0x7f228811ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58706/0 (socket says 172.21.15.46:58706) 2024-05-08T03:04:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.978+0000 7f228dd39640 1 -- 172.21.15.46:0/3354195637 learned_addr learned my addr 172.21.15.46:0/3354195637 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:49.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.979+0000 7f228dd39640 1 -- 172.21.15.46:0/3354195637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2288123020 con 0x7f22880709f0 2024-05-08T03:04:49.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.979+0000 7f228dd39640 1 --2- 172.21.15.46:0/3354195637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 0x7f228811ef90 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:49.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.979+0000 7f227e7fc640 1 -- 172.21.15.46:0/3354195637 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2284013610 con 0x7f22880709f0 2024-05-08T03:04:49.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.979+0000 7f227e7fc640 1 -- 172.21.15.46:0/3354195637 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2284013770 con 0x7f22880709f0 2024-05-08T03:04:49.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.979+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2288120b30 con 0x7f22880709f0 2024-05-08T03:04:49.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.979+0000 7f227e7fc640 1 -- 172.21.15.46:0/3354195637 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2284013a10 con 0x7f22880709f0 2024-05-08T03:04:49.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.979+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228812ff90 con 0x7f22880709f0 2024-05-08T03:04:49.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.980+0000 7f227e7fc640 1 -- 172.21.15.46:0/3354195637 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f2284013bc0 con 0x7f22880709f0 2024-05-08T03:04:49.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.981+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2288063900 con 0x7f22880709f0 2024-05-08T03:04:49.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.981+0000 7f227e7fc640 1 --2- 172.21.15.46:0/3354195637 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f226c038980 0x7f226c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:49.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.981+0000 7f227e7fc640 1 -- 172.21.15.46:0/3354195637 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7f2284018040 con 0x7f22880709f0 2024-05-08T03:04:49.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.981+0000 7f228d538640 1 --2- 172.21.15.46:0/3354195637 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f226c038980 0x7f226c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:49.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.982+0000 7f228d538640 1 --2- 172.21.15.46:0/3354195637 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f226c038980 0x7f226c03ae90 crc :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:49.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:49.991+0000 7f227e7fc640 1 -- 172.21.15.46:0/3354195637 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f2284011380 con 0x7f22880709f0 2024-05-08T03:04:50.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.182+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2288073850 con 0x7f226c038980 2024-05-08T03:04:50.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.186+0000 7f227e7fc640 1 -- 172.21.15.46:0/3354195637 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109144 (crc 0 0 0) 0x7f2278005930 con 0x7f226c038980 2024-05-08T03:04:50.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T03:04:50.191 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-08T03:04:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.188+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f226c038980 msgr2=0x7f226c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.188+0000 7f228ff9d640 1 --2- 172.21.15.46:0/3354195637 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f226c038980 0x7f226c03ae90 crc :-1 s=READY pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.188+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 msgr2=0x7f228811ef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.188+0000 7f228ff9d640 1 --2- 172.21.15.46:0/3354195637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 0x7f228811ef90 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.189+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 shutdown_connections 2024-05-08T03:04:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.189+0000 7f228ff9d640 1 --2- 172.21.15.46:0/3354195637 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f226c038980 0x7f226c03ae90 unknown :-1 s=CLOSED pgs=3876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.189+0000 7f228ff9d640 1 --2- 172.21.15.46:0/3354195637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22880709f0 0x7f228811ef90 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.189+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 >> 172.21.15.46:0/3354195637 conn(0x7f22880a1830 msgr2=0x7f2288131fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:50.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.189+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 shutdown_connections 2024-05-08T03:04:50.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.189+0000 7f228ff9d640 1 -- 172.21.15.46:0/3354195637 wait complete. 2024-05-08T03:04:50.203 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1288,"stamp":"2024-05-08T03:04:48.802023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":273196,"kb_used_data":8524,"kb_used_omap":0,"kb_used_meta":264640,"kb_avail":419157204,"statfs":{"total":429496729600,"available":429216976896,"internally_reserved":0,"allocated":8728576,"data_stored":3775169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":270991360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-299550,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002571"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.746337+0000","last_change":"2024-05-08T02:51:09.430157+0000","last_active":"2024-05-08T03:04:19.746337+0000","last_peered":"2024-05-08T03:04:19.746337+0000","last_clean":"2024-05-08T03:04:19.746337+0000","last_became_active":"2024-05-08T02:51:09.414974+0000","last_became_peered":"2024-05-08T02:51:09.414974+0000","last_unstale":"2024-05-08T03:04:19.746337+0000","last_undegraded":"2024-05-08T03:04:19.746337+0000","last_fullsized":"2024-05-08T03:04:19.746337+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.472460+0000","last_change":"2024-05-08T02:51:09.437442+0000","last_active":"2024-05-08T03:04:16.472460+0000","last_peered":"2024-05-08T03:04:16.472460+0000","last_clean":"2024-05-08T03:04:16.472460+0000","last_became_active":"2024-05-08T02:51:09.429857+0000","last_became_peered":"2024-05-08T02:51:09.429857+0000","last_unstale":"2024-05-08T03:04:16.472460+0000","last_undegraded":"2024-05-08T03:04:16.472460+0000","last_fullsized":"2024-05-08T03:04:16.472460+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.640820+0000","last_change":"2024-05-08T02:51:09.428422+0000","last_active":"2024-05-08T03:04:19.640820+0000","last_peered":"2024-05-08T03:04:19.640820+0000","last_clean":"2024-05-08T03:04:19.640820+0000","last_became_active":"2024-05-08T02:51:09.422128+0000","last_became_peered":"2024-05-08T02:51:09.422128+0000","last_unstale":"2024-05-08T03:04:19.640820+0000","last_undegraded":"2024-05-08T03:04:19.640820+0000","last_fullsized":"2024-05-08T03:04:19.640820+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.909774+0000","last_change":"2024-05-08T02:51:09.514243+0000","last_active":"2024-05-08T03:04:17.909774+0000","last_peered":"2024-05-08T03:04:17.909774+0000","last_clean":"2024-05-08T03:04:17.909774+0000","last_became_active":"2024-05-08T02:51:09.509773+0000","last_became_peered":"2024-05-08T02:51:09.509773+0000","last_unstale":"2024-05-08T03:04:17.909774+0000","last_undegraded":"2024-05-08T03:04:17.909774+0000","last_fullsized":"2024-05-08T03:04:17.909774+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.706769+0000","last_change":"2024-05-08T02:51:09.525448+0000","last_active":"2024-05-08T03:04:19.706769+0000","last_peered":"2024-05-08T03:04:19.706769+0000","last_clean":"2024-05-08T03:04:19.706769+0000","last_became_active":"2024-05-08T02:51:09.520146+0000","last_became_peered":"2024-05-08T02:51:09.520146+0000","last_unstale":"2024-05-08T03:04:19.706769+0000","last_undegraded":"2024-05-08T03:04:19.706769+0000","last_fullsized":"2024-05-08T03:04:19.706769+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.529961+0000","last_change":"2024-05-08T02:51:09.479496+0000","last_active":"2024-05-08T03:04:16.529961+0000","last_peered":"2024-05-08T03:04:16.529961+0000","last_clean":"2024-05-08T03:04:16.529961+0000","last_became_active":"2024-05-08T02:51:09.464789+0000","last_became_peered":"2024-05-08T02:51:09.464789+0000","last_unstale":"2024-05-08T03:04:16.529961+0000","last_undegraded":"2024-05-08T03:04:16.529961+0000","last_fullsized":"2024-05-08T03:04:16.529961+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.515528+0000","last_change":"2024-05-08T02:51:09.495786+0000","last_active":"2024-05-08T03:04:16.515528+0000","last_peered":"2024-05-08T03:04:16.515528+0000","last_clean":"2024-05-08T03:04:16.515528+0000","last_became_active":"2024-05-08T02:51:09.490174+0000","last_became_peered":"2024-05-08T02:51:09.490174+0000","last_unstale":"2024-05-08T03:04:16.515528+0000","last_undegraded":"2024-05-08T03:04:16.515528+0000","last_fullsized":"2024-05-08T03:04:16.515528+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.489022+0000","last_change":"2024-05-08T02:51:09.483583+0000","last_active":"2024-05-08T03:04:16.489022+0000","last_peered":"2024-05-08T03:04:16.489022+0000","last_clean":"2024-05-08T03:04:16.489022+0000","last_became_active":"2024-05-08T02:51:09.473858+0000","last_became_peered":"2024-05-08T02:51:09.473858+0000","last_unstale":"2024-05-08T03:04:16.489022+0000","last_undegraded":"2024-05-08T03:04:16.489022+0000","last_fullsized":"2024-05-08T03:04:16.489022+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.841052+0000","last_change":"2024-05-08T02:51:09.428825+0000","last_active":"2024-05-08T03:04:17.841052+0000","last_peered":"2024-05-08T03:04:17.841052+0000","last_clean":"2024-05-08T03:04:17.841052+0000","last_became_active":"2024-05-08T02:51:09.419746+0000","last_became_peered":"2024-05-08T02:51:09.419746+0000","last_unstale":"2024-05-08T03:04:17.841052+0000","last_undegraded":"2024-05-08T03:04:17.841052+0000","last_fullsized":"2024-05-08T03:04:17.841052+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.657736+0000","last_change":"2024-05-08T02:51:09.425411+0000","last_active":"2024-05-08T03:04:19.657736+0000","last_peered":"2024-05-08T03:04:19.657736+0000","last_clean":"2024-05-08T03:04:19.657736+0000","last_became_active":"2024-05-08T02:51:09.412840+0000","last_became_peered":"2024-05-08T02:51:09.412840+0000","last_unstale":"2024-05-08T03:04:19.657736+0000","last_undegraded":"2024-05-08T03:04:19.657736+0000","last_fullsized":"2024-05-08T03:04:19.657736+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.881641+0000","last_change":"2024-05-08T02:51:09.535779+0000","last_active":"2024-05-08T03:04:17.881641+0000","last_peered":"2024-05-08T03:04:17.881641+0000","last_clean":"2024-05-08T03:04:17.881641+0000","last_became_active":"2024-05-08T02:51:09.531607+0000","last_became_peered":"2024-05-08T02:51:09.531607+0000","last_unstale":"2024-05-08T03:04:17.881641+0000","last_undegraded":"2024-05-08T03:04:17.881641+0000","last_fullsized":"2024-05-08T03:04:17.881641+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.480717+0000","last_change":"2024-05-08T02:51:09.485826+0000","last_active":"2024-05-08T03:04:16.480717+0000","last_peered":"2024-05-08T03:04:16.480717+0000","last_clean":"2024-05-08T03:04:16.480717+0000","last_became_active":"2024-05-08T02:51:09.469507+0000","last_became_peered":"2024-05-08T02:51:09.469507+0000","last_unstale":"2024-05-08T03:04:16.480717+0000","last_undegraded":"2024-05-08T03:04:16.480717+0000","last_fullsized":"2024-05-08T03:04:16.480717+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.873475+0000","last_change":"2024-05-08T02:51:09.469162+0000","last_active":"2024-05-08T03:04:17.873475+0000","last_peered":"2024-05-08T03:04:17.873475+0000","last_clean":"2024-05-08T03:04:17.873475+0000","last_became_active":"2024-05-08T02:51:09.455287+0000","last_became_peered":"2024-05-08T02:51:09.455287+0000","last_unstale":"2024-05-08T03:04:17.873475+0000","last_undegraded":"2024-05-08T03:04:17.873475+0000","last_fullsized":"2024-05-08T03:04:17.873475+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.898314+0000","last_change":"2024-05-08T02:51:09.498571+0000","last_active":"2024-05-08T03:04:17.898314+0000","last_peered":"2024-05-08T03:04:17.898314+0000","last_clean":"2024-05-08T03:04:17.898314+0000","last_became_active":"2024-05-08T02:51:09.492168+0000","last_became_peered":"2024-05-08T02:51:09.492168+0000","last_unstale":"2024-05-08T03:04:17.898314+0000","last_undegraded":"2024-05-08T03:04:17.898314+0000","last_fullsized":"2024-05-08T03:04:17.898314+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.439741+0000","last_change":"2024-05-08T02:51:09.552657+0000","last_active":"2024-05-08T03:04:16.439741+0000","last_peered":"2024-05-08T03:04:16.439741+0000","last_clean":"2024-05-08T03:04:16.439741+0000","last_became_active":"2024-05-08T02:51:09.545524+0000","last_became_peered":"2024-05-08T02:51:09.545524+0000","last_unstale":"2024-05-08T03:04:16.439741+0000","last_undegraded":"2024-05-08T03:04:16.439741+0000","last_fullsized":"2024-05-08T03:04:16.439741+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.510341+0000","last_change":"2024-05-08T02:51:09.505576+0000","last_active":"2024-05-08T03:04:16.510341+0000","last_peered":"2024-05-08T03:04:16.510341+0000","last_clean":"2024-05-08T03:04:16.510341+0000","last_became_active":"2024-05-08T02:51:09.498798+0000","last_became_peered":"2024-05-08T02:51:09.498798+0000","last_unstale":"2024-05-08T03:04:16.510341+0000","last_undegraded":"2024-05-08T03:04:16.510341+0000","last_fullsized":"2024-05-08T03:04:16.510341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.506929+0000","last_change":"2024-05-08T02:51:09.449392+0000","last_active":"2024-05-08T03:04:16.506929+0000","last_peered":"2024-05-08T03:04:16.506929+0000","last_clean":"2024-05-08T03:04:16.506929+0000","last_became_active":"2024-05-08T02:51:09.440822+0000","last_became_peered":"2024-05-08T02:51:09.440822+0000","last_unstale":"2024-05-08T03:04:16.506929+0000","last_undegraded":"2024-05-08T03:04:16.506929+0000","last_fullsized":"2024-05-08T03:04:16.506929+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.893036+0000","last_change":"2024-05-08T02:51:09.462545+0000","last_active":"2024-05-08T03:04:17.893036+0000","last_peered":"2024-05-08T03:04:17.893036+0000","last_clean":"2024-05-08T03:04:17.893036+0000","last_became_active":"2024-05-08T02:51:09.449604+0000","last_became_peered":"2024-05-08T02:51:09.449604+0000","last_unstale":"2024-05-08T03:04:17.893036+0000","last_undegraded":"2024-05-08T03:04:17.893036+0000","last_fullsized":"2024-05-08T03:04:17.893036+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.645218+0000","last_change":"2024-05-08T02:51:09.416372+0000","last_active":"2024-05-08T03:04:19.645218+0000","last_peered":"2024-05-08T03:04:19.645218+0000","last_clean":"2024-05-08T03:04:19.645218+0000","last_became_active":"2024-05-08T02:51:09.408878+0000","last_became_peered":"2024-05-08T02:51:09.408878+0000","last_unstale":"2024-05-08T03:04:19.645218+0000","last_undegraded":"2024-05-08T03:04:19.645218+0000","last_fullsized":"2024-05-08T03:04:19.645218+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.704810+0000","last_change":"2024-05-08T02:51:09.499815+0000","last_active":"2024-05-08T03:04:19.704810+0000","last_peered":"2024-05-08T03:04:19.704810+0000","last_clean":"2024-05-08T03:04:19.704810+0000","last_became_active":"2024-05-08T02:51:09.493372+0000","last_became_peered":"2024-05-08T02:51:09.493372+0000","last_unstale":"2024-05-08T03:04:19.704810+0000","last_undegraded":"2024-05-08T03:04:19.704810+0000","last_fullsized":"2024-05-08T03:04:19.704810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.743603+0000","last_change":"2024-05-08T02:51:09.478707+0000","last_active":"2024-05-08T03:04:19.743603+0000","last_peered":"2024-05-08T03:04:19.743603+0000","last_clean":"2024-05-08T03:04:19.743603+0000","last_became_active":"2024-05-08T02:51:09.466931+0000","last_became_peered":"2024-05-08T02:51:09.466931+0000","last_unstale":"2024-05-08T03:04:19.743603+0000","last_undegraded":"2024-05-08T03:04:19.743603+0000","last_fullsized":"2024-05-08T03:04:19.743603+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1289,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.727210+0000","last_change":"2024-05-08T02:51:09.485829+0000","last_active":"2024-05-08T03:04:19.727210+0000","last_peered":"2024-05-08T03:04:19.727210+0000","last_clean":"2024-05-08T03:04:19.727210+0000","last_became_active":"2024-05-08T02:51:09.475586+0000","last_became_peered":"2024-05-08T02:51:09.475586+0000","last_unstale":"2024-05-08T03:04:19.727210+0000","last_undegraded":"2024-05-08T03:04:19.727210+0000","last_fullsized":"2024-05-08T03:04:19.727210+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.620157+0000","last_change":"2024-05-08T02:51:09.459058+0000","last_active":"2024-05-08T03:04:19.620157+0000","last_peered":"2024-05-08T03:04:19.620157+0000","last_clean":"2024-05-08T03:04:19.620157+0000","last_became_active":"2024-05-08T02:51:09.448780+0000","last_became_peered":"2024-05-08T02:51:09.448780+0000","last_unstale":"2024-05-08T03:04:19.620157+0000","last_undegraded":"2024-05-08T03:04:19.620157+0000","last_fullsized":"2024-05-08T03:04:19.620157+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.899212+0000","last_change":"2024-05-08T02:51:09.452398+0000","last_active":"2024-05-08T03:04:17.899212+0000","last_peered":"2024-05-08T03:04:17.899212+0000","last_clean":"2024-05-08T03:04:17.899212+0000","last_became_active":"2024-05-08T02:51:09.440069+0000","last_became_peered":"2024-05-08T02:51:09.440069+0000","last_unstale":"2024-05-08T03:04:17.899212+0000","last_undegraded":"2024-05-08T03:04:17.899212+0000","last_fullsized":"2024-05-08T03:04:17.899212+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.872326+0000","last_change":"2024-05-08T02:51:09.479443+0000","last_active":"2024-05-08T03:04:17.872326+0000","last_peered":"2024-05-08T03:04:17.872326+0000","last_clean":"2024-05-08T03:04:17.872326+0000","last_became_active":"2024-05-08T02:51:09.472343+0000","last_became_peered":"2024-05-08T02:51:09.472343+0000","last_unstale":"2024-05-08T03:04:17.872326+0000","last_undegraded":"2024-05-08T03:04:17.872326+0000","last_fullsized":"2024-05-08T03:04:17.872326+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.465288+0000","last_change":"2024-05-08T02:51:09.539867+0000","last_active":"2024-05-08T03:04:16.465288+0000","last_peered":"2024-05-08T03:04:16.465288+0000","last_clean":"2024-05-08T03:04:16.465288+0000","last_became_active":"2024-05-08T02:51:09.532094+0000","last_became_peered":"2024-05-08T02:51:09.532094+0000","last_unstale":"2024-05-08T03:04:16.465288+0000","last_undegraded":"2024-05-08T03:04:16.465288+0000","last_fullsized":"2024-05-08T03:04:16.465288+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1261,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.857431+0000","last_change":"2024-05-08T02:51:09.459701+0000","last_active":"2024-05-08T03:04:17.857431+0000","last_peered":"2024-05-08T03:04:17.857431+0000","last_clean":"2024-05-08T03:04:17.857431+0000","last_became_active":"2024-05-08T02:51:09.443431+0000","last_became_peered":"2024-05-08T02:51:09.443431+0000","last_unstale":"2024-05-08T03:04:17.857431+0000","last_undegraded":"2024-05-08T03:04:17.857431+0000","last_fullsized":"2024-05-08T03:04:17.857431+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.536157+0000","last_change":"2024-05-08T02:51:09.523580+0000","last_active":"2024-05-08T03:04:16.536157+0000","last_peered":"2024-05-08T03:04:16.536157+0000","last_clean":"2024-05-08T03:04:16.536157+0000","last_became_active":"2024-05-08T02:51:09.515226+0000","last_became_peered":"2024-05-08T02:51:09.515226+0000","last_unstale":"2024-05-08T03:04:16.536157+0000","last_undegraded":"2024-05-08T03:04:16.536157+0000","last_fullsized":"2024-05-08T03:04:16.536157+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.521789+0000","last_change":"2024-05-08T02:51:09.446239+0000","last_active":"2024-05-08T03:04:16.521789+0000","last_peered":"2024-05-08T03:04:16.521789+0000","last_clean":"2024-05-08T03:04:16.521789+0000","last_became_active":"2024-05-08T02:51:09.433946+0000","last_became_peered":"2024-05-08T02:51:09.433946+0000","last_unstale":"2024-05-08T03:04:16.521789+0000","last_undegraded":"2024-05-08T03:04:16.521789+0000","last_fullsized":"2024-05-08T03:04:16.521789+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.509222+0000","last_change":"2024-05-08T02:51:09.577416+0000","last_active":"2024-05-08T03:04:16.509222+0000","last_peered":"2024-05-08T03:04:16.509222+0000","last_clean":"2024-05-08T03:04:16.509222+0000","last_became_active":"2024-05-08T02:51:09.570979+0000","last_became_peered":"2024-05-08T02:51:09.570979+0000","last_unstale":"2024-05-08T03:04:16.509222+0000","last_undegraded":"2024-05-08T03:04:16.509222+0000","last_fullsized":"2024-05-08T03:04:16.509222+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1302,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.737519+0000","last_change":"2024-05-08T02:51:09.425933+0000","last_active":"2024-05-08T03:04:19.737519+0000","last_peered":"2024-05-08T03:04:19.737519+0000","last_clean":"2024-05-08T03:04:19.737519+0000","last_became_active":"2024-05-08T02:51:09.419747+0000","last_became_peered":"2024-05-08T02:51:09.419747+0000","last_unstale":"2024-05-08T03:04:19.737519+0000","last_undegraded":"2024-05-08T03:04:19.737519+0000","last_fullsized":"2024-05-08T03:04:19.737519+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1291,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.636523+0000","last_change":"2024-05-08T02:51:09.462720+0000","last_active":"2024-05-08T03:04:19.636523+0000","last_peered":"2024-05-08T03:04:19.636523+0000","last_clean":"2024-05-08T03:04:19.636523+0000","last_became_active":"2024-05-08T02:51:09.454882+0000","last_became_peered":"2024-05-08T02:51:09.454882+0000","last_unstale":"2024-05-08T03:04:19.636523+0000","last_undegraded":"2024-05-08T03:04:19.636523+0000","last_fullsized":"2024-05-08T03:04:19.636523+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1887,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.858939+0000","last_change":"2024-05-08T02:45:31.653041+0000","last_active":"2024-05-08T03:04:19.858939+0000","last_peered":"2024-05-08T03:04:19.858939+0000","last_clean":"2024-05-08T03:04:19.858939+0000","last_became_active":"2024-05-08T02:45:31.647316+0000","last_became_peered":"2024-05-08T02:45:31.647316+0000","last_unstale":"2024-05-08T03:04:19.858939+0000","last_undegraded":"2024-05-08T03:04:19.858939+0000","last_fullsized":"2024-05-08T03:04:19.858939+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1891,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.757287+0000","last_change":"2024-05-08T02:45:31.640980+0000","last_active":"2024-05-08T03:04:19.757287+0000","last_peered":"2024-05-08T03:04:19.757287+0000","last_clean":"2024-05-08T03:04:19.757287+0000","last_became_active":"2024-05-08T02:45:31.636059+0000","last_became_peered":"2024-05-08T02:45:31.636059+0000","last_unstale":"2024-05-08T03:04:19.757287+0000","last_undegraded":"2024-05-08T03:04:19.757287+0000","last_fullsized":"2024-05-08T03:04:19.757287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1869,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:18.049760+0000","last_change":"2024-05-08T02:45:31.616723+0000","last_active":"2024-05-08T03:04:18.049760+0000","last_peered":"2024-05-08T03:04:18.049760+0000","last_clean":"2024-05-08T03:04:18.049760+0000","last_became_active":"2024-05-08T02:45:31.611005+0000","last_became_peered":"2024-05-08T02:45:31.611005+0000","last_unstale":"2024-05-08T03:04:18.049760+0000","last_undegraded":"2024-05-08T03:04:18.049760+0000","last_fullsized":"2024-05-08T03:04:18.049760+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1891,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.606003+0000","last_change":"2024-05-08T02:45:31.623778+0000","last_active":"2024-05-08T03:04:19.606003+0000","last_peered":"2024-05-08T03:04:19.606003+0000","last_clean":"2024-05-08T03:04:19.606003+0000","last_became_active":"2024-05-08T02:45:31.617883+0000","last_became_peered":"2024-05-08T02:45:31.617883+0000","last_unstale":"2024-05-08T03:04:19.606003+0000","last_undegraded":"2024-05-08T03:04:19.606003+0000","last_fullsized":"2024-05-08T03:04:19.606003+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1881,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.769811+0000","last_change":"2024-05-08T02:45:31.634126+0000","last_active":"2024-05-08T03:04:16.769811+0000","last_peered":"2024-05-08T03:04:16.769811+0000","last_clean":"2024-05-08T03:04:16.769811+0000","last_became_active":"2024-05-08T02:45:31.628702+0000","last_became_peered":"2024-05-08T02:45:31.628702+0000","last_unstale":"2024-05-08T03:04:16.769811+0000","last_undegraded":"2024-05-08T03:04:16.769811+0000","last_fullsized":"2024-05-08T03:04:16.769811+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1887,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.728207+0000","last_change":"2024-05-08T02:45:31.621292+0000","last_active":"2024-05-08T03:04:19.728207+0000","last_peered":"2024-05-08T03:04:19.728207+0000","last_clean":"2024-05-08T03:04:19.728207+0000","last_became_active":"2024-05-08T02:45:31.615285+0000","last_became_peered":"2024-05-08T02:45:31.615285+0000","last_unstale":"2024-05-08T03:04:19.728207+0000","last_undegraded":"2024-05-08T03:04:19.728207+0000","last_fullsized":"2024-05-08T03:04:19.728207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1881,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:16.643267+0000","last_change":"2024-05-08T02:45:31.635093+0000","last_active":"2024-05-08T03:04:16.643267+0000","last_peered":"2024-05-08T03:04:16.643267+0000","last_clean":"2024-05-08T03:04:16.643267+0000","last_became_active":"2024-05-08T02:45:31.629721+0000","last_became_peered":"2024-05-08T02:45:31.629721+0000","last_unstale":"2024-05-08T03:04:16.643267+0000","last_undegraded":"2024-05-08T03:04:16.643267+0000","last_fullsized":"2024-05-08T03:04:16.643267+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1887,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:19.926275+0000","last_change":"2024-05-08T02:45:31.648464+0000","last_active":"2024-05-08T03:04:19.926275+0000","last_peered":"2024-05-08T03:04:19.926275+0000","last_clean":"2024-05-08T03:04:19.926275+0000","last_became_active":"2024-05-08T02:45:31.642977+0000","last_became_peered":"2024-05-08T02:45:31.642977+0000","last_unstale":"2024-05-08T03:04:19.926275+0000","last_undegraded":"2024-05-08T03:04:19.926275+0000","last_fullsized":"2024-05-08T03:04:19.926275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2002,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-05-08T03:04:17.907539+0000","last_change":"2024-05-08T02:45:29.600723+0000","last_active":"2024-05-08T03:04:17.907539+0000","last_peered":"2024-05-08T03:04:17.907539+0000","last_clean":"2024-05-08T03:04:17.907539+0000","last_became_active":"2024-05-08T02:45:29.595527+0000","last_became_peered":"2024-05-08T02:45:29.595527+0000","last_unstale":"2024-05-08T03:04:17.907539+0000","last_undegraded":"2024-05-08T03:04:17.907539+0000","last_fullsized":"2024-05-08T03:04:17.907539+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_clean_scrub_stamp":"2024-05-08T02:45:28.553006+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77892,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779708,"statfs":{"total":107374182400,"available":107294420992,"internally_reserved":0,"allocated":2420736,"data_stored":1207077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64948,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792652,"statfs":{"total":107374182400,"available":107307675648,"internally_reserved":0,"allocated":1945600,"data_stored":655816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64876,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792724,"statfs":{"total":107374182400,"available":107307749376,"internally_reserved":0,"allocated":1871872,"data_stored":652657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":65480,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792120,"statfs":{"total":107374182400,"available":107307130880,"internally_reserved":0,"allocated":2490368,"data_stored":1259619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T03:04:50.205 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T03:04:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.313+0000 7f2d3579d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.318+0000 7f2d3579d640 1 Processor -- start 2024-05-08T03:04:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.318+0000 7f2d3579d640 1 -- start start 2024-05-08T03:04:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.319+0000 7f2d3579d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d300a2fe0 0x7f2d30139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.319+0000 7f2d3579d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d300a0120 con 0x7f2d3009e7c0 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.319+0000 7f2d3579d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f2d3006f270 con 0x7f2d300a2fe0 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.320+0000 7f2d27fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2d300a2fe0 0x7f2d30139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.320+0000 7f2d2effd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2d3009e7c0 0x7f2d300a28d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52994/0 (socket says 172.21.15.46:52994) 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.320+0000 7f2d2effd640 1 -- 172.21.15.46:0/2207210113 learned_addr learned my addr 172.21.15.46:0/2207210113 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.320+0000 7f2d27fff640 1 -- 172.21.15.46:0/2207210113 >> v1:172.21.15.46:6789/0 conn(0x7f2d3009e7c0 legacy=0x7f2d300a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.320+0000 7f2d27fff640 1 -- 172.21.15.46:0/2207210113 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3009e430 con 0x7f2d300a2fe0 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.320+0000 7f2d27fff640 1 --2- 172.21.15.46:0/2207210113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 0x7f2d30139ea0 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141c092728c9f08d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.320+0000 7f2d2e7fc640 1 -- 172.21.15.46:0/2207210113 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2d18009d90 con 0x7f2d300a2fe0 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.320+0000 7f2d2e7fc640 1 -- 172.21.15.46:0/2207210113 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2d1800e230 con 0x7f2d300a2fe0 2024-05-08T03:04:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.320+0000 7f2d2e7fc640 1 -- 172.21.15.46:0/2207210113 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2d1800e4d0 con 0x7f2d300a2fe0 2024-05-08T03:04:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.321+0000 7f2d3579d640 1 -- 172.21.15.46:0/2207210113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 msgr2=0x7f2d30139ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.321+0000 7f2d3579d640 1 --2- 172.21.15.46:0/2207210113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 0x7f2d30139ea0 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.321+0000 7f2d3579d640 1 -- 172.21.15.46:0/2207210113 shutdown_connections 2024-05-08T03:04:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.321+0000 7f2d3579d640 1 --2- 172.21.15.46:0/2207210113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 0x7f2d30139ea0 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.321+0000 7f2d3579d640 1 -- 172.21.15.46:0/2207210113 >> 172.21.15.46:0/2207210113 conn(0x7f2d3006e2c0 msgr2=0x7f2d3006e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.321+0000 7f2d3579d640 1 -- 172.21.15.46:0/2207210113 shutdown_connections 2024-05-08T03:04:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.321+0000 7f2d3579d640 1 -- 172.21.15.46:0/2207210113 wait complete. 2024-05-08T03:04:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.321+0000 7f2d3579d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.323+0000 7f2d3579d640 1 Processor -- start 2024-05-08T03:04:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.323+0000 7f2d3579d640 1 -- start start 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d3579d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 0x7f2d30121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d3579d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2d30124820 con 0x7f2d300a2fe0 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d2effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 0x7f2d30121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d2effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 0x7f2d30121180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58736/0 (socket says 172.21.15.46:58736) 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d2effd640 1 -- 172.21.15.46:0/2831853907 learned_addr learned my addr 172.21.15.46:0/2831853907 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d2effd640 1 -- 172.21.15.46:0/2831853907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d301321b0 con 0x7f2d300a2fe0 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d2effd640 1 --2- 172.21.15.46:0/2831853907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 0x7f2d30121180 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d277fe640 1 -- 172.21.15.46:0/2831853907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2d20005a60 con 0x7f2d300a2fe0 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d277fe640 1 -- 172.21.15.46:0/2831853907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2d20005bc0 con 0x7f2d300a2fe0 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d301324a0 con 0x7f2d300a2fe0 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d277fe640 1 -- 172.21.15.46:0/2831853907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2d20005e60 con 0x7f2d300a2fe0 2024-05-08T03:04:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.325+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d30122d50 con 0x7f2d300a2fe0 2024-05-08T03:04:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.326+0000 7f2d277fe640 1 -- 172.21.15.46:0/2831853907 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f2d2000c780 con 0x7f2d300a2fe0 2024-05-08T03:04:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.326+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3006cf60 con 0x7f2d300a2fe0 2024-05-08T03:04:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.327+0000 7f2d277fe640 1 --2- 172.21.15.46:0/2831853907 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2d10038980 0x7f2d1003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.327+0000 7f2d277fe640 1 -- 172.21.15.46:0/2831853907 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7f2d20048470 con 0x7f2d300a2fe0 2024-05-08T03:04:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.327+0000 7f2d27fff640 1 --2- 172.21.15.46:0/2831853907 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2d10038980 0x7f2d1003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.328+0000 7f2d27fff640 1 --2- 172.21.15.46:0/2831853907 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2d10038980 0x7f2d1003ae90 crc :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:50.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.332+0000 7f2d277fe640 1 -- 172.21.15.46:0/2831853907 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f2d2000d330 con 0x7f2d300a2fe0 2024-05-08T03:04:50.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.519+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d30063900 con 0x7f2d300a2fe0 2024-05-08T03:04:50.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.520+0000 7f2d277fe640 1 -- 172.21.15.46:0/2831853907 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v714) ==== 74+0+11127 (crc 0 0 0) 0x7f2d2000d150 con 0x7f2d300a2fe0 2024-05-08T03:04:50.524 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T03:04:50.524 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":714,"fsid":"3c41076c-82d6-4569-8543-dcb021c14d35","created":"2024-05-08T02:45:20.092180+0000","modified":"2024-05-08T03:04:48.383733+0000","last_up_change":"2024-05-08T02:45:26.547871+0000","last_in_change":"2024-05-08T02:45:22.225801+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":201,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T02:45:28.537086+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T02:45:30.405125+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-05-08T02:51:07.282767+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"238","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b109fb80-69d6-4e98-b5a0-5244abc7c70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6801","nonce":3562168766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3562168766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6811","nonce":3562168766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3562168766}]},"public_addr":"172.21.15.46:6801/3562168766","cluster_addr":"172.21.15.46:6802/3562168766","heartbeat_back_addr":"172.21.15.46:6811/3562168766","heartbeat_front_addr":"172.21.15.46:6812/3562168766","state":["exists","up"]},{"osd":1,"uuid":"2d6fc267-c018-4cfd-b873-7f310b704694","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":2291706666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6805","nonce":2291706666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6807","nonce":2291706666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6803","nonce":2291706666}]},"public_addr":"172.21.15.46:6806/2291706666","cluster_addr":"172.21.15.46:6805/2291706666","heartbeat_back_addr":"172.21.15.46:6807/2291706666","heartbeat_front_addr":"172.21.15.46:6803/2291706666","state":["exists","up"]},{"osd":2,"uuid":"d39b74fe-9bab-4194-8443-20462cbf2445","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6805","nonce":1892248062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":1892248062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":1892248062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6809","nonce":1892248062}]},"public_addr":"172.21.15.80:6805/1892248062","cluster_addr":"172.21.15.80:6804/1892248062","heartbeat_back_addr":"172.21.15.80:6808/1892248062","heartbeat_front_addr":"172.21.15.80:6809/1892248062","state":["exists","up"]},{"osd":3,"uuid":"9c4e5819-7dd8-4be4-bc0a-74351c97b323","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6807","nonce":3216858417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3216858417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3216858417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6803","nonce":3216858417}]},"public_addr":"172.21.15.80:6807/3216858417","cluster_addr":"172.21.15.80:6806/3216858417","heartbeat_back_addr":"172.21.15.80:6802/3216858417","heartbeat_front_addr":"172.21.15.80:6803/3216858417","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":4},{"begin":9,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":181,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":1}]},{"pool":184,"snaps":[{"begin":1,"length":2}]},{"pool":185,"snaps":[{"begin":3,"length":1}]},{"pool":188,"snaps":[{"begin":2,"length":2}]},{"pool":190,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T03:04:50.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2d10038980 msgr2=0x7f2d1003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:50.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 --2- 172.21.15.46:0/2831853907 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2d10038980 0x7f2d1003ae90 crc :-1 s=READY pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 msgr2=0x7f2d30121180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:50.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 --2- 172.21.15.46:0/2831853907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 0x7f2d30121180 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 shutdown_connections 2024-05-08T03:04:50.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 --2- 172.21.15.46:0/2831853907 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f2d10038980 0x7f2d1003ae90 unknown :-1 s=CLOSED pgs=3877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 --2- 172.21.15.46:0/2831853907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d300a2fe0 0x7f2d30121180 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:50.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 >> 172.21.15.46:0/2831853907 conn(0x7f2d3006e2c0 msgr2=0x7f2d3009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:50.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 shutdown_connections 2024-05-08T03:04:50.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:50.522+0000 7f2d3579d640 1 -- 172.21.15.46:0/2831853907 wait complete. 2024-05-08T03:04:51.538 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T03:04:51.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T03:04:51.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.658+0000 7fc51e20f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:51.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.669+0000 7fc51e20f640 1 Processor -- start 2024-05-08T03:04:51.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.669+0000 7fc51e20f640 1 -- start start 2024-05-08T03:04:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.670+0000 7fc51e20f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc518137ca0 0x7fc51813a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.670+0000 7fc51e20f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc51809de70 con 0x7fc51809e750 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.670+0000 7fc51e20f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fc5180a0690 con 0x7fc518137ca0 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc516ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc518137ca0 0x7fc51813a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc5177fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc51809e750 0x7fc5180a0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53002/0 (socket says 172.21.15.46:53002) 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc516ffd640 1 --2- 172.21.15.46:0/243556347 >> v2:172.21.15.46:3300/0 conn(0x7fc518137ca0 0x7fc51813a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58744/0 (socket says 172.21.15.46:58744) 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc5177fe640 1 -- 172.21.15.46:0/243556347 learned_addr learned my addr 172.21.15.46:0/243556347 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc516ffd640 1 -- 172.21.15.46:0/243556347 >> v1:172.21.15.46:6789/0 conn(0x7fc51809e750 legacy=0x7fc5180a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc5167fc640 1 -- 172.21.15.46:0/243556347 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2413353297 0 0) 0x7fc51809de70 con 0x7fc51809e750 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc516ffd640 1 -- 172.21.15.46:0/243556347 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5180a0380 con 0x7fc518137ca0 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc516ffd640 1 --2- 172.21.15.46:0/243556347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc518137ca0 0x7fc51813a0c0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6af3811f85a33c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:51.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc5167fc640 1 -- 172.21.15.46:0/243556347 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc50c009d90 con 0x7fc518137ca0 2024-05-08T03:04:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc5167fc640 1 -- 172.21.15.46:0/243556347 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc50c00e230 con 0x7fc518137ca0 2024-05-08T03:04:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.671+0000 7fc5167fc640 1 -- 172.21.15.46:0/243556347 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc50c00e4d0 con 0x7fc518137ca0 2024-05-08T03:04:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.672+0000 7fc51e20f640 1 -- 172.21.15.46:0/243556347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc518137ca0 msgr2=0x7fc51813a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.672+0000 7fc51e20f640 1 --2- 172.21.15.46:0/243556347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc518137ca0 0x7fc51813a0c0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.672+0000 7fc51e20f640 1 -- 172.21.15.46:0/243556347 shutdown_connections 2024-05-08T03:04:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.672+0000 7fc51e20f640 1 --2- 172.21.15.46:0/243556347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc518137ca0 0x7fc51813a0c0 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.672+0000 7fc51e20f640 1 -- 172.21.15.46:0/243556347 >> 172.21.15.46:0/243556347 conn(0x7fc5180a3d60 msgr2=0x7fc5180a4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.672+0000 7fc51e20f640 1 -- 172.21.15.46:0/243556347 shutdown_connections 2024-05-08T03:04:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.672+0000 7fc51e20f640 1 -- 172.21.15.46:0/243556347 wait complete. 2024-05-08T03:04:51.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.672+0000 7fc51e20f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:51.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.674+0000 7fc51e20f640 1 Processor -- start 2024-05-08T03:04:51.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.674+0000 7fc51e20f640 1 -- start start 2024-05-08T03:04:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.676+0000 7fc51e20f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51809e750 0x7fc5181c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.676+0000 7fc51e20f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc5181324d0 con 0x7fc51809e750 2024-05-08T03:04:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.676+0000 7fc5177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51809e750 0x7fc5181c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.676+0000 7fc5177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51809e750 0x7fc5181c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58746/0 (socket says 172.21.15.46:58746) 2024-05-08T03:04:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.676+0000 7fc5177fe640 1 -- 172.21.15.46:0/530712828 learned_addr learned my addr 172.21.15.46:0/530712828 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.676+0000 7fc5177fe640 1 -- 172.21.15.46:0/530712828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc518120ac0 con 0x7fc51809e750 2024-05-08T03:04:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.677+0000 7fc5177fe640 1 --2- 172.21.15.46:0/530712828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51809e750 0x7fc5181c6370 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.677+0000 7fc4fffff640 1 -- 172.21.15.46:0/530712828 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc508004b80 con 0x7fc51809e750 2024-05-08T03:04:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.677+0000 7fc4fffff640 1 -- 172.21.15.46:0/530712828 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc508004ce0 con 0x7fc51809e750 2024-05-08T03:04:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.677+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5181213a0 con 0x7fc51809e750 2024-05-08T03:04:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.677+0000 7fc4fffff640 1 -- 172.21.15.46:0/530712828 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc508007120 con 0x7fc51809e750 2024-05-08T03:04:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.677+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc518122ac0 con 0x7fc51809e750 2024-05-08T03:04:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.678+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc518121c20 con 0x7fc51809e750 2024-05-08T03:04:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.678+0000 7fc4fffff640 1 -- 172.21.15.46:0/530712828 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc5080072d0 con 0x7fc51809e750 2024-05-08T03:04:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.678+0000 7fc4fffff640 1 --2- 172.21.15.46:0/530712828 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc504038980 0x7fc50403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.678+0000 7fc4fffff640 1 -- 172.21.15.46:0/530712828 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7fc508048520 con 0x7fc51809e750 2024-05-08T03:04:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.678+0000 7fc4fffff640 1 --2- 172.21.15.46:0/530712828 >> v2:172.21.15.46:6801/3562168766 conn(0x7fc50403eaa0 0x7fc504040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.678+0000 7fc4fffff640 1 -- 172.21.15.46:0/530712828 --> v2:172.21.15.46:6801/3562168766 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc504041620 con 0x7fc50403eaa0 2024-05-08T03:04:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.678+0000 7fc4fffff640 1 -- 172.21.15.46:0/530712828 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7fc50804a990 con 0x7fc51809e750 2024-05-08T03:04:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.679+0000 7fc516ffd640 1 --2- 172.21.15.46:0/530712828 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc504038980 0x7fc50403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.679+0000 7fc516ffd640 1 --2- 172.21.15.46:0/530712828 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc504038980 0x7fc50403ae90 crc :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:51.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.679+0000 7fc517fff640 1 --2- 172.21.15.46:0/530712828 >> v2:172.21.15.46:6801/3562168766 conn(0x7fc50403eaa0 0x7fc504040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:04:51.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.683+0000 7fc517fff640 1 --2- 172.21.15.46:0/530712828 >> v2:172.21.15.46:6801/3562168766 conn(0x7fc50403eaa0 0x7fc504040f90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:51.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.684+0000 7fc4fffff640 1 -- 172.21.15.46:0/530712828 <== osd.0 v2:172.21.15.46:6801/3562168766 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7fc504041620 con 0x7fc50403eaa0 2024-05-08T03:04:51.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.688+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 --> v2:172.21.15.46:6801/3562168766 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc51809f3c0 con 0x7fc50403eaa0 2024-05-08T03:04:51.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.689+0000 7fc4fffff640 1 -- 172.21.15.46:0/530712828 <== osd.0 v2:172.21.15.46:6801/3562168766 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fc51000a820 con 0x7fc50403eaa0 2024-05-08T03:04:51.693 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-08T03:04:51.693 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "" 2024-05-08T03:04:51.693 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-08T03:04:51.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 >> v2:172.21.15.46:6801/3562168766 conn(0x7fc50403eaa0 msgr2=0x7fc504040f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:51.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 --2- 172.21.15.46:0/530712828 >> v2:172.21.15.46:6801/3562168766 conn(0x7fc50403eaa0 0x7fc504040f90 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc504038980 msgr2=0x7fc50403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:51.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 --2- 172.21.15.46:0/530712828 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc504038980 0x7fc50403ae90 crc :-1 s=READY pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51809e750 msgr2=0x7fc5181c6370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:51.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 --2- 172.21.15.46:0/530712828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51809e750 0x7fc5181c6370 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 shutdown_connections 2024-05-08T03:04:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 --2- 172.21.15.46:0/530712828 >> v2:172.21.15.46:6801/3562168766 conn(0x7fc50403eaa0 0x7fc504040f90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 --2- 172.21.15.46:0/530712828 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fc504038980 0x7fc50403ae90 unknown :-1 s=CLOSED pgs=3878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 --2- 172.21.15.46:0/530712828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51809e750 0x7fc5181c6370 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 >> 172.21.15.46:0/530712828 conn(0x7fc5180a3d60 msgr2=0x7fc51809ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 shutdown_connections 2024-05-08T03:04:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.690+0000 7fc51e20f640 1 -- 172.21.15.46:0/530712828 wait complete. 2024-05-08T03:04:51.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T03:04:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.812+0000 7f349c99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.818+0000 7f349c99d640 1 Processor -- start 2024-05-08T03:04:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.818+0000 7f349c99d640 1 -- start start 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f349c99d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f34980a0e00 0x7f3498139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f349c99d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f349809fa40 con 0x7f349809f630 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f349c99d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f34980a1210 con 0x7f34980a0e00 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f348ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f34980a0e00 0x7f3498139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f349659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f349809f630 0x7f34980a06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53012/0 (socket says 172.21.15.46:53012) 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f348ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f34980a0e00 0x7f3498139c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58760/0 (socket says 172.21.15.46:58760) 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f349659c640 1 -- 172.21.15.46:0/1242416610 learned_addr learned my addr 172.21.15.46:0/1242416610 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f348ffff640 1 -- 172.21.15.46:0/1242416610 >> v1:172.21.15.46:6789/0 conn(0x7f349809f630 legacy=0x7f34980a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f348ffff640 1 -- 172.21.15.46:0/1242416610 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349809ddd0 con 0x7f34980a0e00 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f348ffff640 1 --2- 172.21.15.46:0/1242416610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34980a0e00 0x7f3498139c60 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcaf7bea5742170 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.820+0000 7f3495d9b640 1 -- 172.21.15.46:0/1242416610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3480009d90 con 0x7f34980a0e00 2024-05-08T03:04:51.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.821+0000 7f3495d9b640 1 -- 172.21.15.46:0/1242416610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f348000e230 con 0x7f34980a0e00 2024-05-08T03:04:51.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.821+0000 7f3495d9b640 1 -- 172.21.15.46:0/1242416610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f348000e4d0 con 0x7f34980a0e00 2024-05-08T03:04:51.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.821+0000 7f349c99d640 1 -- 172.21.15.46:0/1242416610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34980a0e00 msgr2=0x7f3498139c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.821+0000 7f349c99d640 1 --2- 172.21.15.46:0/1242416610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34980a0e00 0x7f3498139c60 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.821+0000 7f349c99d640 1 -- 172.21.15.46:0/1242416610 shutdown_connections 2024-05-08T03:04:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.821+0000 7f349c99d640 1 --2- 172.21.15.46:0/1242416610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34980a0e00 0x7f3498139c60 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.821+0000 7f349c99d640 1 -- 172.21.15.46:0/1242416610 >> 172.21.15.46:0/1242416610 conn(0x7f349806be40 msgr2=0x7f349806c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.821+0000 7f349c99d640 1 -- 172.21.15.46:0/1242416610 shutdown_connections 2024-05-08T03:04:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.821+0000 7f349c99d640 1 -- 172.21.15.46:0/1242416610 wait complete. 2024-05-08T03:04:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.822+0000 7f349c99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.823+0000 7f349c99d640 1 Processor -- start 2024-05-08T03:04:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.824+0000 7f349c99d640 1 -- start start 2024-05-08T03:04:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.825+0000 7f349c99d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349809f630 0x7f349811df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.825+0000 7f349c99d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f34981322e0 con 0x7f349809f630 2024-05-08T03:04:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.825+0000 7f349659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349809f630 0x7f349811df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.825+0000 7f349659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349809f630 0x7f349811df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58776/0 (socket says 172.21.15.46:58776) 2024-05-08T03:04:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.825+0000 7f349659c640 1 -- 172.21.15.46:0/2781682381 learned_addr learned my addr 172.21.15.46:0/2781682381 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.825+0000 7f349659c640 1 -- 172.21.15.46:0/2781682381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3498131ff0 con 0x7f349809f630 2024-05-08T03:04:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.826+0000 7f349659c640 1 --2- 172.21.15.46:0/2781682381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349809f630 0x7f349811df40 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.826+0000 7f348effd640 1 -- 172.21.15.46:0/2781682381 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3488005a60 con 0x7f349809f630 2024-05-08T03:04:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.826+0000 7f348effd640 1 -- 172.21.15.46:0/2781682381 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3488005bc0 con 0x7f349809f630 2024-05-08T03:04:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.826+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3498122050 con 0x7f349809f630 2024-05-08T03:04:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.826+0000 7f348effd640 1 -- 172.21.15.46:0/2781682381 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3488005e60 con 0x7f349809f630 2024-05-08T03:04:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.826+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349806cdd0 con 0x7f349809f630 2024-05-08T03:04:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.827+0000 7f348effd640 1 -- 172.21.15.46:0/2781682381 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f348800c780 con 0x7f349809f630 2024-05-08T03:04:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.827+0000 7f348effd640 1 --2- 172.21.15.46:0/2781682381 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3478038980 0x7f347803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.827+0000 7f348effd640 1 -- 172.21.15.46:0/2781682381 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7f3488048460 con 0x7f349809f630 2024-05-08T03:04:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.827+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3498063900 con 0x7f349809f630 2024-05-08T03:04:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.827+0000 7f348ffff640 1 --2- 172.21.15.46:0/2781682381 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3478038980 0x7f347803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.828+0000 7f348ffff640 1 --2- 172.21.15.46:0/2781682381 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3478038980 0x7f347803ae90 crc :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:51.832+0000 7f348effd640 1 -- 172.21.15.46:0/2781682381 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f348800d330 con 0x7f349809f630 2024-05-08T03:04:52.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.023+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f34980a03e0 con 0x7f3478038980 2024-05-08T03:04:52.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.023+0000 7f348effd640 1 -- 172.21.15.46:0/2781682381 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f3480009db0 con 0x7f3478038980 2024-05-08T03:04:52.027 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T03:04:52.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3478038980 msgr2=0x7f347803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 --2- 172.21.15.46:0/2781682381 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3478038980 0x7f347803ae90 crc :-1 s=READY pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349809f630 msgr2=0x7f349811df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 --2- 172.21.15.46:0/2781682381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349809f630 0x7f349811df40 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 shutdown_connections 2024-05-08T03:04:52.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 --2- 172.21.15.46:0/2781682381 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3478038980 0x7f347803ae90 unknown :-1 s=CLOSED pgs=3879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 --2- 172.21.15.46:0/2781682381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f349809f630 0x7f349811df40 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 >> 172.21.15.46:0/2781682381 conn(0x7f349806be40 msgr2=0x7f34981ba950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:52.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 shutdown_connections 2024-05-08T03:04:52.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.026+0000 7f349c99d640 1 -- 172.21.15.46:0/2781682381 wait complete. 2024-05-08T03:04:52.046 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T03:04:52.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T03:04:52.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.159+0000 7f0be391d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:52.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.168+0000 7f0be391d640 1 Processor -- start 2024-05-08T03:04:52.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.169+0000 7f0be391d640 1 -- start start 2024-05-08T03:04:52.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.170+0000 7f0be391d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0bdc09ea00 0x7f0bdc132de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.170+0000 7f0be391d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bdc073ea0 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.170+0000 7f0be391d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f0bdc0a15a0 con 0x7f0bdc09ea00 2024-05-08T03:04:52.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.170+0000 7f0be0eb8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0bdc09ea00 0x7f0bdc132de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.170+0000 7f0be16b9640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0bdc09e5f0 0x7f0bdc1326d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53018/0 (socket says 172.21.15.46:53018) 2024-05-08T03:04:52.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.170+0000 7f0be16b9640 1 -- 172.21.15.46:0/2822965974 learned_addr learned my addr 172.21.15.46:0/2822965974 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.171+0000 7f0be0eb8640 1 -- 172.21.15.46:0/2822965974 >> v1:172.21.15.46:6789/0 conn(0x7f0bdc09e5f0 legacy=0x7f0bdc1326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.171+0000 7f0be0eb8640 1 -- 172.21.15.46:0/2822965974 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc09e1c0 con 0x7f0bdc09ea00 2024-05-08T03:04:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.171+0000 7f0be0eb8640 1 --2- 172.21.15.46:0/2822965974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09ea00 0x7f0bdc132de0 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d02069aabf7fbaf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.171+0000 7f0bd3fff640 1 -- 172.21.15.46:0/2822965974 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bcc009d90 con 0x7f0bdc09ea00 2024-05-08T03:04:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.171+0000 7f0bd3fff640 1 -- 172.21.15.46:0/2822965974 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0bcc00e230 con 0x7f0bdc09ea00 2024-05-08T03:04:52.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.171+0000 7f0bd3fff640 1 -- 172.21.15.46:0/2822965974 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bcc00e4d0 con 0x7f0bdc09ea00 2024-05-08T03:04:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.172+0000 7f0be391d640 1 -- 172.21.15.46:0/2822965974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09ea00 msgr2=0x7f0bdc132de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.172+0000 7f0be391d640 1 --2- 172.21.15.46:0/2822965974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09ea00 0x7f0bdc132de0 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.172+0000 7f0be391d640 1 -- 172.21.15.46:0/2822965974 shutdown_connections 2024-05-08T03:04:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.172+0000 7f0be391d640 1 --2- 172.21.15.46:0/2822965974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09ea00 0x7f0bdc132de0 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.172+0000 7f0be391d640 1 -- 172.21.15.46:0/2822965974 >> 172.21.15.46:0/2822965974 conn(0x7f0bdc0a1b30 msgr2=0x7f0bdc0a1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.172+0000 7f0be391d640 1 -- 172.21.15.46:0/2822965974 shutdown_connections 2024-05-08T03:04:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.172+0000 7f0be391d640 1 -- 172.21.15.46:0/2822965974 wait complete. 2024-05-08T03:04:52.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.172+0000 7f0be391d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.174+0000 7f0be391d640 1 Processor -- start 2024-05-08T03:04:52.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.174+0000 7f0be391d640 1 -- start start 2024-05-08T03:04:52.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.175+0000 7f0be391d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09e5f0 0x7f0bdc1c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.175+0000 7f0be391d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0bdc11ebf0 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.175+0000 7f0be16b9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09e5f0 0x7f0bdc1c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.175+0000 7f0be16b9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09e5f0 0x7f0bdc1c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58792/0 (socket says 172.21.15.46:58792) 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.175+0000 7f0be16b9640 1 -- 172.21.15.46:0/2282925076 learned_addr learned my addr 172.21.15.46:0/2282925076 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.176+0000 7f0be16b9640 1 -- 172.21.15.46:0/2282925076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bdc120300 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.176+0000 7f0be16b9640 1 --2- 172.21.15.46:0/2282925076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09e5f0 0x7f0bdc1c7d40 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.176+0000 7f0bd1ffb640 1 -- 172.21.15.46:0/2282925076 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bd8005a60 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.176+0000 7f0bd1ffb640 1 -- 172.21.15.46:0/2282925076 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0bd8005bc0 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.176+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bdc11d550 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.176+0000 7f0bd1ffb640 1 -- 172.21.15.46:0/2282925076 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bd8005e60 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.176+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bdc11f7b0 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.177+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bdc09c2d0 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.177+0000 7f0bd1ffb640 1 -- 172.21.15.46:0/2282925076 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0bd80070b0 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.177+0000 7f0bd1ffb640 1 --2- 172.21.15.46:0/2282925076 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0bc0038980 0x7f0bc003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.177+0000 7f0bd1ffb640 1 -- 172.21.15.46:0/2282925076 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7f0bd80483f0 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.177+0000 7f0bd1ffb640 1 --2- 172.21.15.46:0/2282925076 >> v2:172.21.15.46:6806/2291706666 conn(0x7f0bc003ea40 0x7f0bc0040f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.177+0000 7f0bd1ffb640 1 -- 172.21.15.46:0/2282925076 --> v2:172.21.15.46:6806/2291706666 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bc00415c0 con 0x7f0bc003ea40 2024-05-08T03:04:52.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.177+0000 7f0bd1ffb640 1 -- 172.21.15.46:0/2282925076 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7f0bd804a8e0 con 0x7f0bdc09e5f0 2024-05-08T03:04:52.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.178+0000 7f0be0eb8640 1 --2- 172.21.15.46:0/2282925076 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0bc0038980 0x7f0bc003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.178+0000 7f0be1eba640 1 --2- 172.21.15.46:0/2282925076 >> v2:172.21.15.46:6806/2291706666 conn(0x7f0bc003ea40 0x7f0bc0040f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:04:52.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.178+0000 7f0be0eb8640 1 --2- 172.21.15.46:0/2282925076 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0bc0038980 0x7f0bc003ae90 crc :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.181+0000 7f0be1eba640 1 --2- 172.21.15.46:0/2282925076 >> v2:172.21.15.46:6806/2291706666 conn(0x7f0bc003ea40 0x7f0bc0040f30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.182+0000 7f0bd1ffb640 1 -- 172.21.15.46:0/2282925076 <== osd.1 v2:172.21.15.46:6806/2291706666 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f0bc00415c0 con 0x7f0bc003ea40 2024-05-08T03:04:52.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.185+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 --> v2:172.21.15.46:6806/2291706666 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0bdc09d7c0 con 0x7f0bc003ea40 2024-05-08T03:04:52.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.186+0000 7f0bd1ffb640 1 -- 172.21.15.46:0/2282925076 <== osd.1 v2:172.21.15.46:6806/2291706666 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f0bd400a820 con 0x7f0bc003ea40 2024-05-08T03:04:52.190 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-08T03:04:52.190 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "" 2024-05-08T03:04:52.190 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-08T03:04:52.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 >> v2:172.21.15.46:6806/2291706666 conn(0x7f0bc003ea40 msgr2=0x7f0bc0040f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 --2- 172.21.15.46:0/2282925076 >> v2:172.21.15.46:6806/2291706666 conn(0x7f0bc003ea40 0x7f0bc0040f30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0bc0038980 msgr2=0x7f0bc003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 --2- 172.21.15.46:0/2282925076 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0bc0038980 0x7f0bc003ae90 crc :-1 s=READY pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09e5f0 msgr2=0x7f0bdc1c7d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 --2- 172.21.15.46:0/2282925076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09e5f0 0x7f0bdc1c7d40 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 shutdown_connections 2024-05-08T03:04:52.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 --2- 172.21.15.46:0/2282925076 >> v2:172.21.15.46:6806/2291706666 conn(0x7f0bc003ea40 0x7f0bc0040f30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 --2- 172.21.15.46:0/2282925076 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f0bc0038980 0x7f0bc003ae90 unknown :-1 s=CLOSED pgs=3880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 --2- 172.21.15.46:0/2282925076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0bdc09e5f0 0x7f0bdc1c7d40 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 >> 172.21.15.46:0/2282925076 conn(0x7f0bdc0a1b30 msgr2=0x7f0bdc1ba980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:52.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 shutdown_connections 2024-05-08T03:04:52.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.187+0000 7f0be391d640 1 -- 172.21.15.46:0/2282925076 wait complete. 2024-05-08T03:04:52.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T03:04:52.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.307+0000 7fda3a26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:52.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.314+0000 7fda3a26d640 1 Processor -- start 2024-05-08T03:04:52.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.314+0000 7fda3a26d640 1 -- start start 2024-05-08T03:04:52.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.315+0000 7fda3a26d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fda34132c10 0x7fda34133020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.315+0000 7fda3a26d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda34132800 con 0x7fda340a0630 2024-05-08T03:04:52.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.315+0000 7fda3a26d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fda3409dcf0 con 0x7fda34132c10 2024-05-08T03:04:52.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.315+0000 7fda33fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fda34132c10 0x7fda34133020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.315+0000 7fda337fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fda340a0630 0x7fda340a0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53022/0 (socket says 172.21.15.46:53022) 2024-05-08T03:04:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.316+0000 7fda337fe640 1 -- 172.21.15.46:0/570667414 learned_addr learned my addr 172.21.15.46:0/570667414 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.316+0000 7fda33fff640 1 -- 172.21.15.46:0/570667414 >> v1:172.21.15.46:6789/0 conn(0x7fda340a0630 legacy=0x7fda340a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.316+0000 7fda33fff640 1 -- 172.21.15.46:0/570667414 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda34073ba0 con 0x7fda34132c10 2024-05-08T03:04:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.316+0000 7fda33fff640 1 --2- 172.21.15.46:0/570667414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda34132c10 0x7fda34133020 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6d6476be09632a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.316+0000 7fda32ffd640 1 -- 172.21.15.46:0/570667414 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda24009d90 con 0x7fda34132c10 2024-05-08T03:04:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.316+0000 7fda32ffd640 1 -- 172.21.15.46:0/570667414 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda2400e230 con 0x7fda34132c10 2024-05-08T03:04:52.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.316+0000 7fda32ffd640 1 -- 172.21.15.46:0/570667414 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda2400e4d0 con 0x7fda34132c10 2024-05-08T03:04:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.317+0000 7fda3a26d640 1 -- 172.21.15.46:0/570667414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda34132c10 msgr2=0x7fda34133020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.317+0000 7fda3a26d640 1 --2- 172.21.15.46:0/570667414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda34132c10 0x7fda34133020 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.317+0000 7fda3a26d640 1 -- 172.21.15.46:0/570667414 shutdown_connections 2024-05-08T03:04:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.317+0000 7fda3a26d640 1 --2- 172.21.15.46:0/570667414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda34132c10 0x7fda34133020 unknown :-1 s=CLOSED pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.317+0000 7fda3a26d640 1 -- 172.21.15.46:0/570667414 >> 172.21.15.46:0/570667414 conn(0x7fda3409aa00 msgr2=0x7fda3409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.317+0000 7fda3a26d640 1 -- 172.21.15.46:0/570667414 shutdown_connections 2024-05-08T03:04:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.317+0000 7fda3a26d640 1 -- 172.21.15.46:0/570667414 wait complete. 2024-05-08T03:04:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.317+0000 7fda3a26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:52.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.319+0000 7fda3a26d640 1 Processor -- start 2024-05-08T03:04:52.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.319+0000 7fda3a26d640 1 -- start start 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda3a26d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda340a0630 0x7fda3406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda3a26d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fda34121b90 con 0x7fda340a0630 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda33fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda340a0630 0x7fda3406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda33fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda340a0630 0x7fda3406d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58810/0 (socket says 172.21.15.46:58810) 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda33fff640 1 -- 172.21.15.46:0/3676390163 learned_addr learned my addr 172.21.15.46:0/3676390163 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda33fff640 1 -- 172.21.15.46:0/3676390163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda34122110 con 0x7fda340a0630 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda33fff640 1 --2- 172.21.15.46:0/3676390163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda340a0630 0x7fda3406d9b0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda30ff9640 1 -- 172.21.15.46:0/3676390163 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda24014620 con 0x7fda340a0630 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda30ff9640 1 -- 172.21.15.46:0/3676390163 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda24014780 con 0x7fda340a0630 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda34120cc0 con 0x7fda340a0630 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda30ff9640 1 -- 172.21.15.46:0/3676390163 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda24014a20 con 0x7fda340a0630 2024-05-08T03:04:52.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.321+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda34121470 con 0x7fda340a0630 2024-05-08T03:04:52.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.323+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda34121920 con 0x7fda340a0630 2024-05-08T03:04:52.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.323+0000 7fda30ff9640 1 -- 172.21.15.46:0/3676390163 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fda24014bd0 con 0x7fda340a0630 2024-05-08T03:04:52.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.323+0000 7fda30ff9640 1 --2- 172.21.15.46:0/3676390163 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fda20038980 0x7fda2003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.323+0000 7fda30ff9640 1 -- 172.21.15.46:0/3676390163 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7fda24019040 con 0x7fda340a0630 2024-05-08T03:04:52.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.323+0000 7fda337fe640 1 --2- 172.21.15.46:0/3676390163 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fda20038980 0x7fda2003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.324+0000 7fda337fe640 1 --2- 172.21.15.46:0/3676390163 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fda20038980 0x7fda2003ae90 crc :-1 s=READY pgs=3881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.328+0000 7fda30ff9640 1 -- 172.21.15.46:0/3676390163 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fda24018190 con 0x7fda340a0630 2024-05-08T03:04:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.514+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fda34133560 con 0x7fda20038980 2024-05-08T03:04:52.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.515+0000 7fda30ff9640 1 -- 172.21.15.46:0/3676390163 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fda28005930 con 0x7fda20038980 2024-05-08T03:04:52.518 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T03:04:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fda20038980 msgr2=0x7fda2003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 --2- 172.21.15.46:0/3676390163 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fda20038980 0x7fda2003ae90 crc :-1 s=READY pgs=3881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda340a0630 msgr2=0x7fda3406d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 --2- 172.21.15.46:0/3676390163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda340a0630 0x7fda3406d9b0 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 shutdown_connections 2024-05-08T03:04:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 --2- 172.21.15.46:0/3676390163 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fda20038980 0x7fda2003ae90 unknown :-1 s=CLOSED pgs=3881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 --2- 172.21.15.46:0/3676390163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda340a0630 0x7fda3406d9b0 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 >> 172.21.15.46:0/3676390163 conn(0x7fda3409aa00 msgr2=0x7fda341ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 shutdown_connections 2024-05-08T03:04:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.517+0000 7fda3a26d640 1 -- 172.21.15.46:0/3676390163 wait complete. 2024-05-08T03:04:52.535 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T03:04:52.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T03:04:52.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.643+0000 7fd16be6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:52.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.653+0000 7fd16be6d640 1 Processor -- start 2024-05-08T03:04:52.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.653+0000 7fd16be6d640 1 -- start start 2024-05-08T03:04:52.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.655+0000 7fd16be6d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd1641340a0 0x7fd1641364c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.655+0000 7fd16be6d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16412e6a0 con 0x7fd16412db80 2024-05-08T03:04:52.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.655+0000 7fd16be6d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fd16409cf10 con 0x7fd1641340a0 2024-05-08T03:04:52.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.655+0000 7fd169408640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd1641340a0 0x7fd1641364c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.655+0000 7fd169c09640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd16412db80 0x7fd16412df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:53036/0 (socket says 172.21.15.46:53036) 2024-05-08T03:04:52.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.655+0000 7fd169c09640 1 -- 172.21.15.46:0/303441227 learned_addr learned my addr 172.21.15.46:0/303441227 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.655+0000 7fd169408640 1 -- 172.21.15.46:0/303441227 >> v1:172.21.15.46:6789/0 conn(0x7fd16412db80 legacy=0x7fd16412df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.655+0000 7fd169408640 1 -- 172.21.15.46:0/303441227 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16409caa0 con 0x7fd1641340a0 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.655+0000 7fd168c07640 1 -- 172.21.15.46:0/303441227 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702058306 0 0) 0x7fd16412e6a0 con 0x7fd16412db80 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.656+0000 7fd169408640 1 --2- 172.21.15.46:0/303441227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1641340a0 0x7fd1641364c0 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97109b10aa28ec6a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.656+0000 7fd168c07640 1 -- 172.21.15.46:0/303441227 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd15400ad20 con 0x7fd1641340a0 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.656+0000 7fd168c07640 1 -- 172.21.15.46:0/303441227 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd15400ae80 con 0x7fd1641340a0 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.656+0000 7fd168c07640 1 -- 172.21.15.46:0/303441227 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd15400f470 con 0x7fd1641340a0 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.656+0000 7fd16be6d640 1 -- 172.21.15.46:0/303441227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1641340a0 msgr2=0x7fd1641364c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.656+0000 7fd16be6d640 1 --2- 172.21.15.46:0/303441227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1641340a0 0x7fd1641364c0 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.657+0000 7fd16be6d640 1 -- 172.21.15.46:0/303441227 shutdown_connections 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.657+0000 7fd16be6d640 1 --2- 172.21.15.46:0/303441227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1641340a0 0x7fd1641364c0 unknown :-1 s=CLOSED pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.657+0000 7fd16be6d640 1 -- 172.21.15.46:0/303441227 >> 172.21.15.46:0/303441227 conn(0x7fd1640a0990 msgr2=0x7fd1640a0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:52.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.657+0000 7fd16be6d640 1 -- 172.21.15.46:0/303441227 shutdown_connections 2024-05-08T03:04:52.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.657+0000 7fd16be6d640 1 -- 172.21.15.46:0/303441227 wait complete. 2024-05-08T03:04:52.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.657+0000 7fd16be6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:52.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.659+0000 7fd16be6d640 1 Processor -- start 2024-05-08T03:04:52.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.659+0000 7fd16be6d640 1 -- start start 2024-05-08T03:04:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.660+0000 7fd16be6d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd16412db80 0x7fd164071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.660+0000 7fd16be6d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd16412aec0 con 0x7fd16412db80 2024-05-08T03:04:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.660+0000 7fd169c09640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd16412db80 0x7fd164071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.660+0000 7fd169c09640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd16412db80 0x7fd164071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58842/0 (socket says 172.21.15.46:58842) 2024-05-08T03:04:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.660+0000 7fd169c09640 1 -- 172.21.15.46:0/3352134535 learned_addr learned my addr 172.21.15.46:0/3352134535 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.661+0000 7fd169c09640 1 -- 172.21.15.46:0/3352134535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd164119320 con 0x7fd16412db80 2024-05-08T03:04:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.661+0000 7fd169c09640 1 --2- 172.21.15.46:0/3352134535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd16412db80 0x7fd164071ff0 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.661+0000 7fd15a7fc640 1 -- 172.21.15.46:0/3352134535 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd160004cf0 con 0x7fd16412db80 2024-05-08T03:04:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.661+0000 7fd15a7fc640 1 -- 172.21.15.46:0/3352134535 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd160004e50 con 0x7fd16412db80 2024-05-08T03:04:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.661+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16406b380 con 0x7fd16412db80 2024-05-08T03:04:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.661+0000 7fd15a7fc640 1 -- 172.21.15.46:0/3352134535 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd160007250 con 0x7fd16412db80 2024-05-08T03:04:52.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.661+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1641199a0 con 0x7fd16412db80 2024-05-08T03:04:52.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.662+0000 7fd15a7fc640 1 -- 172.21.15.46:0/3352134535 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fd160007450 con 0x7fd16412db80 2024-05-08T03:04:52.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.662+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd16406ecf0 con 0x7fd16412db80 2024-05-08T03:04:52.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.662+0000 7fd15a7fc640 1 --2- 172.21.15.46:0/3352134535 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd148038930 0x7fd14803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.663+0000 7fd15a7fc640 1 -- 172.21.15.46:0/3352134535 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7fd160048da0 con 0x7fd16412db80 2024-05-08T03:04:52.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.663+0000 7fd15a7fc640 1 --2- 172.21.15.46:0/3352134535 >> v2:172.21.15.80:6805/1892248062 conn(0x7fd14803e9f0 0x7fd148040ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.663+0000 7fd15a7fc640 1 -- 172.21.15.46:0/3352134535 --> v2:172.21.15.80:6805/1892248062 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd148041570 con 0x7fd14803e9f0 2024-05-08T03:04:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.663+0000 7fd15a7fc640 1 -- 172.21.15.46:0/3352134535 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7fd1600060b0 con 0x7fd16412db80 2024-05-08T03:04:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.663+0000 7fd169408640 1 --2- 172.21.15.46:0/3352134535 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd148038930 0x7fd14803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.663+0000 7fd169408640 1 --2- 172.21.15.46:0/3352134535 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd148038930 0x7fd14803ae40 crc :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.664+0000 7fd16a40a640 1 --2- 172.21.15.46:0/3352134535 >> v2:172.21.15.80:6805/1892248062 conn(0x7fd14803e9f0 0x7fd148040ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:04:52.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.669+0000 7fd16a40a640 1 --2- 172.21.15.46:0/3352134535 >> v2:172.21.15.80:6805/1892248062 conn(0x7fd14803e9f0 0x7fd148040ee0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.670+0000 7fd15a7fc640 1 -- 172.21.15.46:0/3352134535 <== osd.2 v2:172.21.15.80:6805/1892248062 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7fd148041570 con 0x7fd14803e9f0 2024-05-08T03:04:52.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.674+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 --> v2:172.21.15.80:6805/1892248062 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd16406f890 con 0x7fd14803e9f0 2024-05-08T03:04:52.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.675+0000 7fd15a7fc640 1 -- 172.21.15.46:0/3352134535 <== osd.2 v2:172.21.15.80:6805/1892248062 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fd15c009830 con 0x7fd14803e9f0 2024-05-08T03:04:52.679 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-08T03:04:52.679 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "" 2024-05-08T03:04:52.679 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-08T03:04:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.675+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 >> v2:172.21.15.80:6805/1892248062 conn(0x7fd14803e9f0 msgr2=0x7fd148040ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.675+0000 7fd16be6d640 1 --2- 172.21.15.46:0/3352134535 >> v2:172.21.15.80:6805/1892248062 conn(0x7fd14803e9f0 0x7fd148040ee0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd148038930 msgr2=0x7fd14803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 --2- 172.21.15.46:0/3352134535 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd148038930 0x7fd14803ae40 crc :-1 s=READY pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd16412db80 msgr2=0x7fd164071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 --2- 172.21.15.46:0/3352134535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd16412db80 0x7fd164071ff0 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 shutdown_connections 2024-05-08T03:04:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 --2- 172.21.15.46:0/3352134535 >> v2:172.21.15.80:6805/1892248062 conn(0x7fd14803e9f0 0x7fd148040ee0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 --2- 172.21.15.46:0/3352134535 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fd148038930 0x7fd14803ae40 unknown :-1 s=CLOSED pgs=3882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 --2- 172.21.15.46:0/3352134535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd16412db80 0x7fd164071ff0 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 >> 172.21.15.46:0/3352134535 conn(0x7fd1640a0990 msgr2=0x7fd16412c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:52.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 shutdown_connections 2024-05-08T03:04:52.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.676+0000 7fd16be6d640 1 -- 172.21.15.46:0/3352134535 wait complete. 2024-05-08T03:04:52.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T03:04:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.799+0000 7f352deed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:52.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.806+0000 7f352deed640 1 Processor -- start 2024-05-08T03:04:52.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.806+0000 7f352deed640 1 -- start start 2024-05-08T03:04:52.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.807+0000 7f352deed640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3528134cc0 0x7f35281370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.807+0000 7f352deed640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f352809adf0 con 0x7f3528131f80 2024-05-08T03:04:52.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.807+0000 7f352deed640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f352806f460 con 0x7f3528134cc0 2024-05-08T03:04:52.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.807+0000 7f3526ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3528134cc0 0x7f35281370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.807+0000 7f35277fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3528131f80 0x7f3528132390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52888/0 (socket says 172.21.15.46:52888) 2024-05-08T03:04:52.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.807+0000 7f35277fe640 1 -- 172.21.15.46:0/937201420 learned_addr learned my addr 172.21.15.46:0/937201420 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:52.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.808+0000 7f3526ffd640 1 -- 172.21.15.46:0/937201420 >> v1:172.21.15.46:6789/0 conn(0x7f3528131f80 legacy=0x7f3528132390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.808+0000 7f3526ffd640 1 -- 172.21.15.46:0/937201420 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352809b0b0 con 0x7f3528134cc0 2024-05-08T03:04:52.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.808+0000 7f3526ffd640 1 --2- 172.21.15.46:0/937201420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528134cc0 0x7f35281370e0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f654ddfaa5902f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.808+0000 7f35267fc640 1 -- 172.21.15.46:0/937201420 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f351c009d90 con 0x7f3528134cc0 2024-05-08T03:04:52.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.808+0000 7f35267fc640 1 -- 172.21.15.46:0/937201420 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f351c00e230 con 0x7f3528134cc0 2024-05-08T03:04:52.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.808+0000 7f35267fc640 1 -- 172.21.15.46:0/937201420 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f351c00e4d0 con 0x7f3528134cc0 2024-05-08T03:04:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.809+0000 7f352deed640 1 -- 172.21.15.46:0/937201420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528134cc0 msgr2=0x7f35281370e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.809+0000 7f352deed640 1 --2- 172.21.15.46:0/937201420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528134cc0 0x7f35281370e0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.809+0000 7f352deed640 1 -- 172.21.15.46:0/937201420 shutdown_connections 2024-05-08T03:04:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.809+0000 7f352deed640 1 --2- 172.21.15.46:0/937201420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528134cc0 0x7f35281370e0 unknown :-1 s=CLOSED pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.809+0000 7f352deed640 1 -- 172.21.15.46:0/937201420 >> 172.21.15.46:0/937201420 conn(0x7f35280a2df0 msgr2=0x7f35280a3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.809+0000 7f352deed640 1 -- 172.21.15.46:0/937201420 shutdown_connections 2024-05-08T03:04:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.809+0000 7f352deed640 1 -- 172.21.15.46:0/937201420 wait complete. 2024-05-08T03:04:52.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.809+0000 7f352deed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:52.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.811+0000 7f352deed640 1 Processor -- start 2024-05-08T03:04:52.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.811+0000 7f352deed640 1 -- start start 2024-05-08T03:04:52.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.812+0000 7f352deed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528131f80 0x7f352811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.812+0000 7f352deed640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f352811c1a0 con 0x7f3528131f80 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.812+0000 7f35277fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528131f80 0x7f352811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.813+0000 7f35277fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528131f80 0x7f352811b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55710/0 (socket says 172.21.15.46:55710) 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.813+0000 7f35277fe640 1 -- 172.21.15.46:0/783164604 learned_addr learned my addr 172.21.15.46:0/783164604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.813+0000 7f35277fe640 1 -- 172.21.15.46:0/783164604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352811f1f0 con 0x7f3528131f80 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.813+0000 7f35277fe640 1 --2- 172.21.15.46:0/783164604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528131f80 0x7f352811b100 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.813+0000 7f350ffff640 1 -- 172.21.15.46:0/783164604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3518005a60 con 0x7f3528131f80 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.813+0000 7f350ffff640 1 -- 172.21.15.46:0/783164604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3518005bc0 con 0x7f3528131f80 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.813+0000 7f350ffff640 1 -- 172.21.15.46:0/783164604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3518005e60 con 0x7f3528131f80 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.813+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f352812f260 con 0x7f3528131f80 2024-05-08T03:04:52.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.813+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f352811d550 con 0x7f3528131f80 2024-05-08T03:04:52.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.814+0000 7f350ffff640 1 -- 172.21.15.46:0/783164604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f351800c780 con 0x7f3528131f80 2024-05-08T03:04:52.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.814+0000 7f350ffff640 1 --2- 172.21.15.46:0/783164604 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3514038980 0x7f351403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:52.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.814+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f352811d910 con 0x7f3528131f80 2024-05-08T03:04:52.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.814+0000 7f350ffff640 1 -- 172.21.15.46:0/783164604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7f3518048530 con 0x7f3528131f80 2024-05-08T03:04:52.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.815+0000 7f3526ffd640 1 --2- 172.21.15.46:0/783164604 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3514038980 0x7f351403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:52.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.815+0000 7f3526ffd640 1 --2- 172.21.15.46:0/783164604 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3514038980 0x7f351403ae90 crc :-1 s=READY pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:52.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:52.820+0000 7f350ffff640 1 -- 172.21.15.46:0/783164604 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f351800d150 con 0x7f3528131f80 2024-05-08T03:04:53.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.008+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f352806ef90 con 0x7f3514038980 2024-05-08T03:04:53.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.009+0000 7f350ffff640 1 -- 172.21.15.46:0/783164604 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f351c00e3a0 con 0x7f3514038980 2024-05-08T03:04:53.012 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T03:04:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3514038980 msgr2=0x7f351403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 --2- 172.21.15.46:0/783164604 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3514038980 0x7f351403ae90 crc :-1 s=READY pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528131f80 msgr2=0x7f352811b100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 --2- 172.21.15.46:0/783164604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528131f80 0x7f352811b100 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 shutdown_connections 2024-05-08T03:04:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 --2- 172.21.15.46:0/783164604 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f3514038980 0x7f351403ae90 unknown :-1 s=CLOSED pgs=3883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 --2- 172.21.15.46:0/783164604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3528131f80 0x7f352811b100 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 >> 172.21.15.46:0/783164604 conn(0x7f35280a2df0 msgr2=0x7f35281b9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:53.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 shutdown_connections 2024-05-08T03:04:53.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.011+0000 7f352deed640 1 -- 172.21.15.46:0/783164604 wait complete. 2024-05-08T03:04:53.026 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T03:04:53.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T03:04:53.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.133+0000 7fdead06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:53.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.142+0000 7fdead06d640 1 Processor -- start 2024-05-08T03:04:53.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.142+0000 7fdead06d640 1 -- start start 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdead06d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdea809e5f0 0x7fdea809ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdead06d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea8073ea0 con 0x7fdea81326d0 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdead06d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fdea809ef40 con 0x7fdea809e5f0 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdea6d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdea809e5f0 0x7fdea809ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdea659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdea81326d0 0x7fdea8132ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52902/0 (socket says 172.21.15.46:52902) 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdea659c640 1 -- 172.21.15.46:0/2148796047 learned_addr learned my addr 172.21.15.46:0/2148796047 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdea6d9d640 1 -- 172.21.15.46:0/2148796047 >> v1:172.21.15.46:6789/0 conn(0x7fdea81326d0 legacy=0x7fdea8132ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdea6d9d640 1 -- 172.21.15.46:0/2148796047 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea80a15a0 con 0x7fdea809e5f0 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdea6d9d640 1 --2- 172.21.15.46:0/2148796047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 0x7fdea809ea00 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90419787c382c4d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdea5d9b640 1 -- 172.21.15.46:0/2148796047 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fde98009d90 con 0x7fdea809e5f0 2024-05-08T03:04:53.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdea5d9b640 1 -- 172.21.15.46:0/2148796047 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fde9800e230 con 0x7fdea809e5f0 2024-05-08T03:04:53.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.144+0000 7fdea5d9b640 1 -- 172.21.15.46:0/2148796047 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fde9800e4d0 con 0x7fdea809e5f0 2024-05-08T03:04:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.145+0000 7fdead06d640 1 -- 172.21.15.46:0/2148796047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 msgr2=0x7fdea809ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.145+0000 7fdead06d640 1 --2- 172.21.15.46:0/2148796047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 0x7fdea809ea00 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.145+0000 7fdead06d640 1 -- 172.21.15.46:0/2148796047 shutdown_connections 2024-05-08T03:04:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.145+0000 7fdead06d640 1 --2- 172.21.15.46:0/2148796047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 0x7fdea809ea00 unknown :-1 s=CLOSED pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.145+0000 7fdead06d640 1 -- 172.21.15.46:0/2148796047 >> 172.21.15.46:0/2148796047 conn(0x7fdea80a1b30 msgr2=0x7fdea80a1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.145+0000 7fdead06d640 1 -- 172.21.15.46:0/2148796047 shutdown_connections 2024-05-08T03:04:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.145+0000 7fdead06d640 1 -- 172.21.15.46:0/2148796047 wait complete. 2024-05-08T03:04:53.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.145+0000 7fdead06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:53.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.147+0000 7fdead06d640 1 Processor -- start 2024-05-08T03:04:53.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.148+0000 7fdead06d640 1 -- start start 2024-05-08T03:04:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.149+0000 7fdead06d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 0x7fdea81c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.149+0000 7fdead06d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdea811e280 con 0x7fdea809e5f0 2024-05-08T03:04:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.149+0000 7fdea6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 0x7fdea81c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:53.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.149+0000 7fdea6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 0x7fdea81c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55718/0 (socket says 172.21.15.46:55718) 2024-05-08T03:04:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.149+0000 7fdea6d9d640 1 -- 172.21.15.46:0/4109506571 learned_addr learned my addr 172.21.15.46:0/4109506571 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.149+0000 7fdea6d9d640 1 -- 172.21.15.46:0/4109506571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea811d1c0 con 0x7fdea809e5f0 2024-05-08T03:04:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.150+0000 7fdea6d9d640 1 --2- 172.21.15.46:0/4109506571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 0x7fdea81c7990 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.150+0000 7fde8f7fe640 1 -- 172.21.15.46:0/4109506571 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fde98014540 con 0x7fdea809e5f0 2024-05-08T03:04:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.150+0000 7fde8f7fe640 1 -- 172.21.15.46:0/4109506571 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fde980146a0 con 0x7fdea809e5f0 2024-05-08T03:04:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.150+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea811e780 con 0x7fdea809e5f0 2024-05-08T03:04:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.150+0000 7fde8f7fe640 1 -- 172.21.15.46:0/4109506571 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fde98014940 con 0x7fdea809e5f0 2024-05-08T03:04:53.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.150+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea811f000 con 0x7fdea809e5f0 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.151+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdea811fcb0 con 0x7fdea809e5f0 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.151+0000 7fde8f7fe640 1 -- 172.21.15.46:0/4109506571 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fde98014af0 con 0x7fdea809e5f0 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.151+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/4109506571 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fde94038980 0x7fde9403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.151+0000 7fde8f7fe640 1 -- 172.21.15.46:0/4109506571 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7fde98019040 con 0x7fdea809e5f0 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.151+0000 7fde8f7fe640 1 --2- 172.21.15.46:0/4109506571 >> v2:172.21.15.80:6807/3216858417 conn(0x7fde9403ea40 0x7fde94040f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.151+0000 7fde8f7fe640 1 -- 172.21.15.46:0/4109506571 --> v2:172.21.15.80:6807/3216858417 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde940415c0 con 0x7fde9403ea40 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.151+0000 7fde8f7fe640 1 -- 172.21.15.46:0/4109506571 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7fde9804c140 con 0x7fdea809e5f0 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.152+0000 7fdea659c640 1 --2- 172.21.15.46:0/4109506571 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fde94038980 0x7fde9403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.152+0000 7fdea659c640 1 --2- 172.21.15.46:0/4109506571 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fde94038980 0x7fde9403ae90 crc :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.152+0000 7fdea759e640 1 --2- 172.21.15.46:0/4109506571 >> v2:172.21.15.80:6807/3216858417 conn(0x7fde9403ea40 0x7fde94040f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-05-08T03:04:53.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.155+0000 7fdea759e640 1 --2- 172.21.15.46:0/4109506571 >> v2:172.21.15.80:6807/3216858417 conn(0x7fde9403ea40 0x7fde94040f30 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.157+0000 7fde8f7fe640 1 -- 172.21.15.46:0/4109506571 <== osd.3 v2:172.21.15.80:6807/3216858417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7fde940415c0 con 0x7fde9403ea40 2024-05-08T03:04:53.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.160+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 --> v2:172.21.15.80:6807/3216858417 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdea8132920 con 0x7fde9403ea40 2024-05-08T03:04:53.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fde8f7fe640 1 -- 172.21.15.46:0/4109506571 <== osd.3 v2:172.21.15.80:6807/3216858417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fdea8132920 con 0x7fde9403ea40 2024-05-08T03:04:53.165 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-05-08T03:04:53.165 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "" 2024-05-08T03:04:53.165 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-05-08T03:04:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 >> v2:172.21.15.80:6807/3216858417 conn(0x7fde9403ea40 msgr2=0x7fde94040f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 --2- 172.21.15.46:0/4109506571 >> v2:172.21.15.80:6807/3216858417 conn(0x7fde9403ea40 0x7fde94040f30 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fde94038980 msgr2=0x7fde9403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 --2- 172.21.15.46:0/4109506571 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fde94038980 0x7fde9403ae90 crc :-1 s=READY pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 msgr2=0x7fdea81c7990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 --2- 172.21.15.46:0/4109506571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 0x7fdea81c7990 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 shutdown_connections 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 --2- 172.21.15.46:0/4109506571 >> v2:172.21.15.80:6807/3216858417 conn(0x7fde9403ea40 0x7fde94040f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 --2- 172.21.15.46:0/4109506571 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fde94038980 0x7fde9403ae90 unknown :-1 s=CLOSED pgs=3884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 --2- 172.21.15.46:0/4109506571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdea809e5f0 0x7fdea81c7990 unknown :-1 s=CLOSED pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 >> 172.21.15.46:0/4109506571 conn(0x7fdea80a1b30 msgr2=0x7fdea81ba980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 shutdown_connections 2024-05-08T03:04:53.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.162+0000 7fdead06d640 1 -- 172.21.15.46:0/4109506571 wait complete. 2024-05-08T03:04:53.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T03:04:53.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.282+0000 7fb812aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.289+0000 7fb812aad640 1 Processor -- start 2024-05-08T03:04:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.289+0000 7fb812aad640 1 -- start start 2024-05-08T03:04:53.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb812aad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb80c1317a0 0x7fb80c131bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb812aad640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c06f760 con 0x7fb80c1320f0 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb812aad640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7fb80c06fa00 con 0x7fb80c1317a0 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb810849640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb80c1317a0 0x7fb80c131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb80bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb80c1320f0 0x7fb80c0a0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52908/0 (socket says 172.21.15.46:52908) 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb80bfff640 1 -- 172.21.15.46:0/968039291 learned_addr learned my addr 172.21.15.46:0/968039291 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb810849640 1 -- 172.21.15.46:0/968039291 >> v1:172.21.15.46:6789/0 conn(0x7fb80c1320f0 legacy=0x7fb80c0a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb810849640 1 -- 172.21.15.46:0/968039291 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c09b920 con 0x7fb80c1317a0 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb810849640 1 --2- 172.21.15.46:0/968039291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 0x7fb80c131bb0 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1e26def89d11a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb80b7fe640 1 -- 172.21.15.46:0/968039291 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7fc009d90 con 0x7fb80c1317a0 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb80b7fe640 1 -- 172.21.15.46:0/968039291 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb7fc00e230 con 0x7fb80c1317a0 2024-05-08T03:04:53.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.291+0000 7fb80b7fe640 1 -- 172.21.15.46:0/968039291 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7fc00e4d0 con 0x7fb80c1317a0 2024-05-08T03:04:53.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.292+0000 7fb812aad640 1 -- 172.21.15.46:0/968039291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 msgr2=0x7fb80c131bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.292+0000 7fb812aad640 1 --2- 172.21.15.46:0/968039291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 0x7fb80c131bb0 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.292+0000 7fb812aad640 1 -- 172.21.15.46:0/968039291 shutdown_connections 2024-05-08T03:04:53.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.292+0000 7fb812aad640 1 --2- 172.21.15.46:0/968039291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 0x7fb80c131bb0 unknown :-1 s=CLOSED pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.292+0000 7fb812aad640 1 -- 172.21.15.46:0/968039291 >> 172.21.15.46:0/968039291 conn(0x7fb80c09aa00 msgr2=0x7fb80c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:53.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.292+0000 7fb812aad640 1 -- 172.21.15.46:0/968039291 shutdown_connections 2024-05-08T03:04:53.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.292+0000 7fb812aad640 1 -- 172.21.15.46:0/968039291 wait complete. 2024-05-08T03:04:53.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.292+0000 7fb812aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:53.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.294+0000 7fb812aad640 1 Processor -- start 2024-05-08T03:04:53.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.294+0000 7fb812aad640 1 -- start start 2024-05-08T03:04:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.296+0000 7fb812aad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 0x7fb80c1336b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.296+0000 7fb812aad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c131550 con 0x7fb80c1317a0 2024-05-08T03:04:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.296+0000 7fb810849640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 0x7fb80c1336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.296+0000 7fb810849640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 0x7fb80c1336b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55738/0 (socket says 172.21.15.46:55738) 2024-05-08T03:04:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.296+0000 7fb810849640 1 -- 172.21.15.46:0/3999249966 learned_addr learned my addr 172.21.15.46:0/3999249966 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.296+0000 7fb810849640 1 -- 172.21.15.46:0/3999249966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c135270 con 0x7fb80c1317a0 2024-05-08T03:04:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.296+0000 7fb810849640 1 --2- 172.21.15.46:0/3999249966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 0x7fb80c1336b0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.297+0000 7fb8097fa640 1 -- 172.21.15.46:0/3999249966 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7fc014620 con 0x7fb80c1317a0 2024-05-08T03:04:53.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.297+0000 7fb8097fa640 1 -- 172.21.15.46:0/3999249966 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb7fc014780 con 0x7fb80c1317a0 2024-05-08T03:04:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.297+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80c121290 con 0x7fb80c1317a0 2024-05-08T03:04:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.297+0000 7fb8097fa640 1 -- 172.21.15.46:0/3999249966 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7fc014a20 con 0x7fb80c1317a0 2024-05-08T03:04:53.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.297+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb80c11fc30 con 0x7fb80c1317a0 2024-05-08T03:04:53.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.298+0000 7fb8097fa640 1 -- 172.21.15.46:0/3999249966 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb7fc014bd0 con 0x7fb80c1317a0 2024-05-08T03:04:53.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.297+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80c06f420 con 0x7fb80c1317a0 2024-05-08T03:04:53.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.298+0000 7fb8097fa640 1 --2- 172.21.15.46:0/3999249966 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb7f8038980 0x7fb7f803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.298+0000 7fb8097fa640 1 -- 172.21.15.46:0/3999249966 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7fb7fc019040 con 0x7fb80c1317a0 2024-05-08T03:04:53.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.298+0000 7fb80bfff640 1 --2- 172.21.15.46:0/3999249966 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb7f8038980 0x7fb7f803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:53.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.299+0000 7fb80bfff640 1 --2- 172.21.15.46:0/3999249966 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb7f8038980 0x7fb7f803ae90 crc :-1 s=READY pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.303+0000 7fb8097fa640 1 -- 172.21.15.46:0/3999249966 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fb7fc013e40 con 0x7fb80c1317a0 2024-05-08T03:04:53.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.490+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb80c1313e0 con 0x7fb7f8038980 2024-05-08T03:04:53.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.490+0000 7fb8097fa640 1 -- 172.21.15.46:0/3999249966 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fb80c1313e0 con 0x7fb7f8038980 2024-05-08T03:04:53.494 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T03:04:53.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb7f8038980 msgr2=0x7fb7f803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 --2- 172.21.15.46:0/3999249966 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb7f8038980 0x7fb7f803ae90 crc :-1 s=READY pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 msgr2=0x7fb80c1336b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 --2- 172.21.15.46:0/3999249966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 0x7fb80c1336b0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 shutdown_connections 2024-05-08T03:04:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 --2- 172.21.15.46:0/3999249966 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7fb7f8038980 0x7fb7f803ae90 unknown :-1 s=CLOSED pgs=3885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 --2- 172.21.15.46:0/3999249966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb80c1317a0 0x7fb80c1336b0 unknown :-1 s=CLOSED pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 >> 172.21.15.46:0/3999249966 conn(0x7fb80c09aa00 msgr2=0x7fb80c0708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 shutdown_connections 2024-05-08T03:04:53.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.493+0000 7fb812aad640 1 -- 172.21.15.46:0/3999249966 wait complete. 2024-05-08T03:04:53.508 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T03:04:53.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.616+0000 7f86d76ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:53.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.621+0000 7f86d76ad640 1 Processor -- start 2024-05-08T03:04:53.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.621+0000 7f86d76ad640 1 -- start start 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.623+0000 7f86d76ad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f86d00a0630 0x7f86d00a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.623+0000 7f86d76ad640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d006dd10 con 0x7f86d00a0f80 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.623+0000 7f86d76ad640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f86d006dab0 con 0x7f86d00a0630 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.623+0000 7f86d5449640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f86d00a0630 0x7f86d00a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.623+0000 7f86d4c48640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f86d00a0f80 0x7f86d01317a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:52914/0 (socket says 172.21.15.46:52914) 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.623+0000 7f86d4c48640 1 -- 172.21.15.46:0/3899905930 learned_addr learned my addr 172.21.15.46:0/3899905930 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.623+0000 7f86d5449640 1 -- 172.21.15.46:0/3899905930 >> v1:172.21.15.46:6789/0 conn(0x7f86d00a0f80 legacy=0x7f86d01317a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.623+0000 7f86d5449640 1 -- 172.21.15.46:0/3899905930 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d006d7d0 con 0x7f86d00a0630 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.624+0000 7f86d5449640 1 --2- 172.21.15.46:0/3899905930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 0x7f86d00a0a40 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e901896623c4aaa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.624+0000 7f86cffff640 1 -- 172.21.15.46:0/3899905930 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f86c8009d90 con 0x7f86d00a0630 2024-05-08T03:04:53.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.624+0000 7f86cffff640 1 -- 172.21.15.46:0/3899905930 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f86c800e230 con 0x7f86d00a0630 2024-05-08T03:04:53.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.624+0000 7f86cffff640 1 -- 172.21.15.46:0/3899905930 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f86c800e4d0 con 0x7f86d00a0630 2024-05-08T03:04:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.624+0000 7f86d76ad640 1 -- 172.21.15.46:0/3899905930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 msgr2=0x7f86d00a0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.624+0000 7f86d76ad640 1 --2- 172.21.15.46:0/3899905930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 0x7f86d00a0a40 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.624+0000 7f86d76ad640 1 -- 172.21.15.46:0/3899905930 shutdown_connections 2024-05-08T03:04:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.624+0000 7f86d76ad640 1 --2- 172.21.15.46:0/3899905930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 0x7f86d00a0a40 unknown :-1 s=CLOSED pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.624+0000 7f86d76ad640 1 -- 172.21.15.46:0/3899905930 >> 172.21.15.46:0/3899905930 conn(0x7f86d009aa00 msgr2=0x7f86d009ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.625+0000 7f86d76ad640 1 -- 172.21.15.46:0/3899905930 shutdown_connections 2024-05-08T03:04:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.625+0000 7f86d76ad640 1 -- 172.21.15.46:0/3899905930 wait complete. 2024-05-08T03:04:53.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.625+0000 7f86d76ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:04:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.627+0000 7f86d76ad640 1 Processor -- start 2024-05-08T03:04:53.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.627+0000 7f86d76ad640 1 -- start start 2024-05-08T03:04:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.628+0000 7f86d76ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 0x7f86d011f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.628+0000 7f86d76ad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f86d009dfb0 con 0x7f86d00a0630 2024-05-08T03:04:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.628+0000 7f86d5449640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 0x7f86d011f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.628+0000 7f86d5449640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 0x7f86d011f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55766/0 (socket says 172.21.15.46:55766) 2024-05-08T03:04:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.628+0000 7f86d5449640 1 -- 172.21.15.46:0/3506834331 learned_addr learned my addr 172.21.15.46:0/3506834331 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:04:53.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.629+0000 7f86d5449640 1 -- 172.21.15.46:0/3506834331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d009ebb0 con 0x7f86d00a0630 2024-05-08T03:04:53.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.629+0000 7f86d5449640 1 --2- 172.21.15.46:0/3506834331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 0x7f86d011f680 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.629+0000 7f86cdffb640 1 -- 172.21.15.46:0/3506834331 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f86c8014620 con 0x7f86d00a0630 2024-05-08T03:04:53.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.629+0000 7f86cdffb640 1 -- 172.21.15.46:0/3506834331 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f86c8014780 con 0x7f86d00a0630 2024-05-08T03:04:53.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.629+0000 7f86cdffb640 1 -- 172.21.15.46:0/3506834331 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f86c8014a20 con 0x7f86d00a0630 2024-05-08T03:04:53.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.629+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d0120fe0 con 0x7f86d00a0630 2024-05-08T03:04:53.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.629+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d01219a0 con 0x7f86d00a0630 2024-05-08T03:04:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.630+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d0121cb0 con 0x7f86d00a0630 2024-05-08T03:04:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.630+0000 7f86cdffb640 1 -- 172.21.15.46:0/3506834331 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f86c8014bd0 con 0x7f86d00a0630 2024-05-08T03:04:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.630+0000 7f86cdffb640 1 --2- 172.21.15.46:0/3506834331 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f86bc038980 0x7f86bc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:04:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.631+0000 7f86cdffb640 1 -- 172.21.15.46:0/3506834331 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7f86c8019040 con 0x7f86d00a0630 2024-05-08T03:04:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.631+0000 7f86d4c48640 1 --2- 172.21.15.46:0/3506834331 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f86bc038980 0x7f86bc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:04:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.631+0000 7f86d4c48640 1 --2- 172.21.15.46:0/3506834331 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f86bc038980 0x7f86bc03ae90 crc :-1 s=READY pgs=3886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:04:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.635+0000 7f86cdffb640 1 -- 172.21.15.46:0/3506834331 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f86c8018190 con 0x7f86d00a0630 2024-05-08T03:04:53.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.823+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86d006f380 con 0x7f86bc038980 2024-05-08T03:04:53.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.826+0000 7f86cdffb640 1 -- 172.21.15.46:0/3506834331 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109144 (crc 0 0 0) 0x7f86c4001350 con 0x7f86bc038980 2024-05-08T03:04:53.830 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T03:04:53.831 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-08T03:04:53.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f86bc038980 msgr2=0x7f86bc03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 --2- 172.21.15.46:0/3506834331 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f86bc038980 0x7f86bc03ae90 crc :-1 s=READY pgs=3886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 msgr2=0x7f86d011f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:04:53.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 --2- 172.21.15.46:0/3506834331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 0x7f86d011f680 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 shutdown_connections 2024-05-08T03:04:53.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 --2- 172.21.15.46:0/3506834331 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f86bc038980 0x7f86bc03ae90 unknown :-1 s=CLOSED pgs=3886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 --2- 172.21.15.46:0/3506834331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86d00a0630 0x7f86d011f680 unknown :-1 s=CLOSED pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:04:53.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 >> 172.21.15.46:0/3506834331 conn(0x7f86d009aa00 msgr2=0x7f86d01bca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:04:53.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 shutdown_connections 2024-05-08T03:04:53.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:04:53.829+0000 7f86d76ad640 1 -- 172.21.15.46:0/3506834331 wait complete. 2024-05-08T03:04:53.844 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1290,"stamp":"2024-05-08T03:04:52.802844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":272704,"kb_used_data":8032,"kb_used_omap":0,"kb_used_meta":264640,"kb_avail":419157696,"statfs":{"total":429496729600,"available":429217480704,"internally_reserved":0,"allocated":8224768,"data_stored":3221499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":270991360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-299550,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002121"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:48.550599+0000","last_change":"2024-05-08T02:51:09.430157+0000","last_active":"2024-05-08T03:04:48.550599+0000","last_peered":"2024-05-08T03:04:48.550599+0000","last_clean":"2024-05-08T03:04:48.550599+0000","last_became_active":"2024-05-08T02:51:09.414974+0000","last_became_peered":"2024-05-08T02:51:09.414974+0000","last_unstale":"2024-05-08T03:04:48.550599+0000","last_undegraded":"2024-05-08T03:04:48.550599+0000","last_fullsized":"2024-05-08T03:04:48.550599+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.725862+0000","last_change":"2024-05-08T02:51:09.437442+0000","last_active":"2024-05-08T03:04:49.725862+0000","last_peered":"2024-05-08T03:04:49.725862+0000","last_clean":"2024-05-08T03:04:49.725862+0000","last_became_active":"2024-05-08T02:51:09.429857+0000","last_became_peered":"2024-05-08T02:51:09.429857+0000","last_unstale":"2024-05-08T03:04:49.725862+0000","last_undegraded":"2024-05-08T03:04:49.725862+0000","last_fullsized":"2024-05-08T03:04:49.725862+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1297,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.783272+0000","last_change":"2024-05-08T02:51:09.428422+0000","last_active":"2024-05-08T03:04:49.783272+0000","last_peered":"2024-05-08T03:04:49.783272+0000","last_clean":"2024-05-08T03:04:49.783272+0000","last_became_active":"2024-05-08T02:51:09.422128+0000","last_became_peered":"2024-05-08T02:51:09.422128+0000","last_unstale":"2024-05-08T03:04:49.783272+0000","last_undegraded":"2024-05-08T03:04:49.783272+0000","last_fullsized":"2024-05-08T03:04:49.783272+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1265,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.725827+0000","last_change":"2024-05-08T02:51:09.514243+0000","last_active":"2024-05-08T03:04:49.725827+0000","last_peered":"2024-05-08T03:04:49.725827+0000","last_clean":"2024-05-08T03:04:49.725827+0000","last_became_active":"2024-05-08T02:51:09.509773+0000","last_became_peered":"2024-05-08T02:51:09.509773+0000","last_unstale":"2024-05-08T03:04:49.725827+0000","last_undegraded":"2024-05-08T03:04:49.725827+0000","last_fullsized":"2024-05-08T03:04:49.725827+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:48.456810+0000","last_change":"2024-05-08T02:51:09.525448+0000","last_active":"2024-05-08T03:04:48.456810+0000","last_peered":"2024-05-08T03:04:48.456810+0000","last_clean":"2024-05-08T03:04:48.456810+0000","last_became_active":"2024-05-08T02:51:09.520146+0000","last_became_peered":"2024-05-08T02:51:09.520146+0000","last_unstale":"2024-05-08T03:04:48.456810+0000","last_undegraded":"2024-05-08T03:04:48.456810+0000","last_fullsized":"2024-05-08T03:04:48.456810+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.769921+0000","last_change":"2024-05-08T02:51:09.479496+0000","last_active":"2024-05-08T03:04:49.769921+0000","last_peered":"2024-05-08T03:04:49.769921+0000","last_clean":"2024-05-08T03:04:49.769921+0000","last_became_active":"2024-05-08T02:51:09.464789+0000","last_became_peered":"2024-05-08T02:51:09.464789+0000","last_unstale":"2024-05-08T03:04:49.769921+0000","last_undegraded":"2024-05-08T03:04:49.769921+0000","last_fullsized":"2024-05-08T03:04:49.769921+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.833727+0000","last_change":"2024-05-08T02:51:09.495786+0000","last_active":"2024-05-08T03:04:49.833727+0000","last_peered":"2024-05-08T03:04:49.833727+0000","last_clean":"2024-05-08T03:04:49.833727+0000","last_became_active":"2024-05-08T02:51:09.490174+0000","last_became_peered":"2024-05-08T02:51:09.490174+0000","last_unstale":"2024-05-08T03:04:49.833727+0000","last_undegraded":"2024-05-08T03:04:49.833727+0000","last_fullsized":"2024-05-08T03:04:49.833727+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.781283+0000","last_change":"2024-05-08T02:51:09.483583+0000","last_active":"2024-05-08T03:04:49.781283+0000","last_peered":"2024-05-08T03:04:49.781283+0000","last_clean":"2024-05-08T03:04:49.781283+0000","last_became_active":"2024-05-08T02:51:09.473858+0000","last_became_peered":"2024-05-08T02:51:09.473858+0000","last_unstale":"2024-05-08T03:04:49.781283+0000","last_undegraded":"2024-05-08T03:04:49.781283+0000","last_fullsized":"2024-05-08T03:04:49.781283+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1265,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.717808+0000","last_change":"2024-05-08T02:51:09.428825+0000","last_active":"2024-05-08T03:04:49.717808+0000","last_peered":"2024-05-08T03:04:49.717808+0000","last_clean":"2024-05-08T03:04:49.717808+0000","last_became_active":"2024-05-08T02:51:09.419746+0000","last_became_peered":"2024-05-08T02:51:09.419746+0000","last_unstale":"2024-05-08T03:04:49.717808+0000","last_undegraded":"2024-05-08T03:04:49.717808+0000","last_fullsized":"2024-05-08T03:04:49.717808+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1297,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.737226+0000","last_change":"2024-05-08T02:51:09.425411+0000","last_active":"2024-05-08T03:04:49.737226+0000","last_peered":"2024-05-08T03:04:49.737226+0000","last_clean":"2024-05-08T03:04:49.737226+0000","last_became_active":"2024-05-08T02:51:09.412840+0000","last_became_peered":"2024-05-08T02:51:09.412840+0000","last_unstale":"2024-05-08T03:04:49.737226+0000","last_undegraded":"2024-05-08T03:04:49.737226+0000","last_fullsized":"2024-05-08T03:04:49.737226+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1265,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.707430+0000","last_change":"2024-05-08T02:51:09.535779+0000","last_active":"2024-05-08T03:04:49.707430+0000","last_peered":"2024-05-08T03:04:49.707430+0000","last_clean":"2024-05-08T03:04:49.707430+0000","last_became_active":"2024-05-08T02:51:09.531607+0000","last_became_peered":"2024-05-08T02:51:09.531607+0000","last_unstale":"2024-05-08T03:04:49.707430+0000","last_undegraded":"2024-05-08T03:04:49.707430+0000","last_fullsized":"2024-05-08T03:04:49.707430+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.848784+0000","last_change":"2024-05-08T02:51:09.485826+0000","last_active":"2024-05-08T03:04:49.848784+0000","last_peered":"2024-05-08T03:04:49.848784+0000","last_clean":"2024-05-08T03:04:49.848784+0000","last_became_active":"2024-05-08T02:51:09.469507+0000","last_became_peered":"2024-05-08T02:51:09.469507+0000","last_unstale":"2024-05-08T03:04:49.848784+0000","last_undegraded":"2024-05-08T03:04:49.848784+0000","last_fullsized":"2024-05-08T03:04:49.848784+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1265,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.704623+0000","last_change":"2024-05-08T02:51:09.469162+0000","last_active":"2024-05-08T03:04:49.704623+0000","last_peered":"2024-05-08T03:04:49.704623+0000","last_clean":"2024-05-08T03:04:49.704623+0000","last_became_active":"2024-05-08T02:51:09.455287+0000","last_became_peered":"2024-05-08T02:51:09.455287+0000","last_unstale":"2024-05-08T03:04:49.704623+0000","last_undegraded":"2024-05-08T03:04:49.704623+0000","last_fullsized":"2024-05-08T03:04:49.704623+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1265,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.699722+0000","last_change":"2024-05-08T02:51:09.498571+0000","last_active":"2024-05-08T03:04:49.699722+0000","last_peered":"2024-05-08T03:04:49.699722+0000","last_clean":"2024-05-08T03:04:49.699722+0000","last_became_active":"2024-05-08T02:51:09.492168+0000","last_became_peered":"2024-05-08T02:51:09.492168+0000","last_unstale":"2024-05-08T03:04:49.699722+0000","last_undegraded":"2024-05-08T03:04:49.699722+0000","last_fullsized":"2024-05-08T03:04:49.699722+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.821004+0000","last_change":"2024-05-08T02:51:09.552657+0000","last_active":"2024-05-08T03:04:49.821004+0000","last_peered":"2024-05-08T03:04:49.821004+0000","last_clean":"2024-05-08T03:04:49.821004+0000","last_became_active":"2024-05-08T02:51:09.545524+0000","last_became_peered":"2024-05-08T02:51:09.545524+0000","last_unstale":"2024-05-08T03:04:49.821004+0000","last_undegraded":"2024-05-08T03:04:49.821004+0000","last_fullsized":"2024-05-08T03:04:49.821004+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.753667+0000","last_change":"2024-05-08T02:51:09.505576+0000","last_active":"2024-05-08T03:04:49.753667+0000","last_peered":"2024-05-08T03:04:49.753667+0000","last_clean":"2024-05-08T03:04:49.753667+0000","last_became_active":"2024-05-08T02:51:09.498798+0000","last_became_peered":"2024-05-08T02:51:09.498798+0000","last_unstale":"2024-05-08T03:04:49.753667+0000","last_undegraded":"2024-05-08T03:04:49.753667+0000","last_fullsized":"2024-05-08T03:04:49.753667+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.835132+0000","last_change":"2024-05-08T02:51:09.449392+0000","last_active":"2024-05-08T03:04:49.835132+0000","last_peered":"2024-05-08T03:04:49.835132+0000","last_clean":"2024-05-08T03:04:49.835132+0000","last_became_active":"2024-05-08T02:51:09.440822+0000","last_became_peered":"2024-05-08T02:51:09.440822+0000","last_unstale":"2024-05-08T03:04:49.835132+0000","last_undegraded":"2024-05-08T03:04:49.835132+0000","last_fullsized":"2024-05-08T03:04:49.835132+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1265,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.706127+0000","last_change":"2024-05-08T02:51:09.462545+0000","last_active":"2024-05-08T03:04:49.706127+0000","last_peered":"2024-05-08T03:04:49.706127+0000","last_clean":"2024-05-08T03:04:49.706127+0000","last_became_active":"2024-05-08T02:51:09.449604+0000","last_became_peered":"2024-05-08T02:51:09.449604+0000","last_unstale":"2024-05-08T03:04:49.706127+0000","last_undegraded":"2024-05-08T03:04:49.706127+0000","last_fullsized":"2024-05-08T03:04:49.706127+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1297,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.765428+0000","last_change":"2024-05-08T02:51:09.416372+0000","last_active":"2024-05-08T03:04:49.765428+0000","last_peered":"2024-05-08T03:04:49.765428+0000","last_clean":"2024-05-08T03:04:49.765428+0000","last_became_active":"2024-05-08T02:51:09.408878+0000","last_became_peered":"2024-05-08T02:51:09.408878+0000","last_unstale":"2024-05-08T03:04:49.765428+0000","last_undegraded":"2024-05-08T03:04:49.765428+0000","last_fullsized":"2024-05-08T03:04:49.765428+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:48.489346+0000","last_change":"2024-05-08T02:51:09.499815+0000","last_active":"2024-05-08T03:04:48.489346+0000","last_peered":"2024-05-08T03:04:48.489346+0000","last_clean":"2024-05-08T03:04:48.489346+0000","last_became_active":"2024-05-08T02:51:09.493372+0000","last_became_peered":"2024-05-08T02:51:09.493372+0000","last_unstale":"2024-05-08T03:04:48.489346+0000","last_undegraded":"2024-05-08T03:04:48.489346+0000","last_fullsized":"2024-05-08T03:04:48.489346+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:48.600572+0000","last_change":"2024-05-08T02:51:09.478707+0000","last_active":"2024-05-08T03:04:48.600572+0000","last_peered":"2024-05-08T03:04:48.600572+0000","last_clean":"2024-05-08T03:04:48.600572+0000","last_became_active":"2024-05-08T02:51:09.466931+0000","last_became_peered":"2024-05-08T02:51:09.466931+0000","last_unstale":"2024-05-08T03:04:48.600572+0000","last_undegraded":"2024-05-08T03:04:48.600572+0000","last_fullsized":"2024-05-08T03:04:48.600572+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:48.469117+0000","last_change":"2024-05-08T02:51:09.485829+0000","last_active":"2024-05-08T03:04:48.469117+0000","last_peered":"2024-05-08T03:04:48.469117+0000","last_clean":"2024-05-08T03:04:48.469117+0000","last_became_active":"2024-05-08T02:51:09.475586+0000","last_became_peered":"2024-05-08T02:51:09.475586+0000","last_unstale":"2024-05-08T03:04:48.469117+0000","last_undegraded":"2024-05-08T03:04:48.469117+0000","last_fullsized":"2024-05-08T03:04:48.469117+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1297,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.763693+0000","last_change":"2024-05-08T02:51:09.459058+0000","last_active":"2024-05-08T03:04:49.763693+0000","last_peered":"2024-05-08T03:04:49.763693+0000","last_clean":"2024-05-08T03:04:49.763693+0000","last_became_active":"2024-05-08T02:51:09.448780+0000","last_became_peered":"2024-05-08T02:51:09.448780+0000","last_unstale":"2024-05-08T03:04:49.763693+0000","last_undegraded":"2024-05-08T03:04:49.763693+0000","last_fullsized":"2024-05-08T03:04:49.763693+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1265,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.718987+0000","last_change":"2024-05-08T02:51:09.452398+0000","last_active":"2024-05-08T03:04:49.718987+0000","last_peered":"2024-05-08T03:04:49.718987+0000","last_clean":"2024-05-08T03:04:49.718987+0000","last_became_active":"2024-05-08T02:51:09.440069+0000","last_became_peered":"2024-05-08T02:51:09.440069+0000","last_unstale":"2024-05-08T03:04:49.718987+0000","last_undegraded":"2024-05-08T03:04:49.718987+0000","last_fullsized":"2024-05-08T03:04:49.718987+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1265,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.676415+0000","last_change":"2024-05-08T02:51:09.479443+0000","last_active":"2024-05-08T03:04:49.676415+0000","last_peered":"2024-05-08T03:04:49.676415+0000","last_clean":"2024-05-08T03:04:49.676415+0000","last_became_active":"2024-05-08T02:51:09.472343+0000","last_became_peered":"2024-05-08T02:51:09.472343+0000","last_unstale":"2024-05-08T03:04:49.676415+0000","last_undegraded":"2024-05-08T03:04:49.676415+0000","last_fullsized":"2024-05-08T03:04:49.676415+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.822945+0000","last_change":"2024-05-08T02:51:09.539867+0000","last_active":"2024-05-08T03:04:49.822945+0000","last_peered":"2024-05-08T03:04:49.822945+0000","last_clean":"2024-05-08T03:04:49.822945+0000","last_became_active":"2024-05-08T02:51:09.532094+0000","last_became_peered":"2024-05-08T02:51:09.532094+0000","last_unstale":"2024-05-08T03:04:49.822945+0000","last_undegraded":"2024-05-08T03:04:49.822945+0000","last_fullsized":"2024-05-08T03:04:49.822945+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1265,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.723545+0000","last_change":"2024-05-08T02:51:09.459701+0000","last_active":"2024-05-08T03:04:49.723545+0000","last_peered":"2024-05-08T03:04:49.723545+0000","last_clean":"2024-05-08T03:04:49.723545+0000","last_became_active":"2024-05-08T02:51:09.443431+0000","last_became_peered":"2024-05-08T02:51:09.443431+0000","last_unstale":"2024-05-08T03:04:49.723545+0000","last_undegraded":"2024-05-08T03:04:49.723545+0000","last_fullsized":"2024-05-08T03:04:49.723545+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.772422+0000","last_change":"2024-05-08T02:51:09.523580+0000","last_active":"2024-05-08T03:04:49.772422+0000","last_peered":"2024-05-08T03:04:49.772422+0000","last_clean":"2024-05-08T03:04:49.772422+0000","last_became_active":"2024-05-08T02:51:09.515226+0000","last_became_peered":"2024-05-08T02:51:09.515226+0000","last_unstale":"2024-05-08T03:04:49.772422+0000","last_undegraded":"2024-05-08T03:04:49.772422+0000","last_fullsized":"2024-05-08T03:04:49.772422+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.740830+0000","last_change":"2024-05-08T02:51:09.446239+0000","last_active":"2024-05-08T03:04:49.740830+0000","last_peered":"2024-05-08T03:04:49.740830+0000","last_clean":"2024-05-08T03:04:49.740830+0000","last_became_active":"2024-05-08T02:51:09.433946+0000","last_became_peered":"2024-05-08T02:51:09.433946+0000","last_unstale":"2024-05-08T03:04:49.740830+0000","last_undegraded":"2024-05-08T03:04:49.740830+0000","last_fullsized":"2024-05-08T03:04:49.740830+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.787442+0000","last_change":"2024-05-08T02:51:09.577416+0000","last_active":"2024-05-08T03:04:49.787442+0000","last_peered":"2024-05-08T03:04:49.787442+0000","last_clean":"2024-05-08T03:04:49.787442+0000","last_became_active":"2024-05-08T02:51:09.570979+0000","last_became_peered":"2024-05-08T02:51:09.570979+0000","last_unstale":"2024-05-08T03:04:49.787442+0000","last_undegraded":"2024-05-08T03:04:49.787442+0000","last_fullsized":"2024-05-08T03:04:49.787442+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1306,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:48.586493+0000","last_change":"2024-05-08T02:51:09.425933+0000","last_active":"2024-05-08T03:04:48.586493+0000","last_peered":"2024-05-08T03:04:48.586493+0000","last_clean":"2024-05-08T03:04:48.586493+0000","last_became_active":"2024-05-08T02:51:09.419747+0000","last_became_peered":"2024-05-08T02:51:09.419747+0000","last_unstale":"2024-05-08T03:04:48.586493+0000","last_undegraded":"2024-05-08T03:04:48.586493+0000","last_fullsized":"2024-05-08T03:04:48.586493+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1297,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.791976+0000","last_change":"2024-05-08T02:51:09.462720+0000","last_active":"2024-05-08T03:04:49.791976+0000","last_peered":"2024-05-08T03:04:49.791976+0000","last_clean":"2024-05-08T03:04:49.791976+0000","last_became_active":"2024-05-08T02:51:09.454882+0000","last_became_peered":"2024-05-08T02:51:09.454882+0000","last_unstale":"2024-05-08T03:04:49.791976+0000","last_undegraded":"2024-05-08T03:04:49.791976+0000","last_fullsized":"2024-05-08T03:04:49.791976+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:51:08.203784+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1891,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:48.703419+0000","last_change":"2024-05-08T02:45:31.653041+0000","last_active":"2024-05-08T03:04:48.703419+0000","last_peered":"2024-05-08T03:04:48.703419+0000","last_clean":"2024-05-08T03:04:48.703419+0000","last_became_active":"2024-05-08T02:45:31.647316+0000","last_became_peered":"2024-05-08T02:45:31.647316+0000","last_unstale":"2024-05-08T03:04:48.703419+0000","last_undegraded":"2024-05-08T03:04:48.703419+0000","last_fullsized":"2024-05-08T03:04:48.703419+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1897,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.873714+0000","last_change":"2024-05-08T02:45:31.640980+0000","last_active":"2024-05-08T03:04:49.873714+0000","last_peered":"2024-05-08T03:04:49.873714+0000","last_clean":"2024-05-08T03:04:49.873714+0000","last_became_active":"2024-05-08T02:45:31.636059+0000","last_became_peered":"2024-05-08T02:45:31.636059+0000","last_unstale":"2024-05-08T03:04:49.873714+0000","last_undegraded":"2024-05-08T03:04:49.873714+0000","last_fullsized":"2024-05-08T03:04:49.873714+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1873,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.893192+0000","last_change":"2024-05-08T02:45:31.616723+0000","last_active":"2024-05-08T03:04:49.893192+0000","last_peered":"2024-05-08T03:04:49.893192+0000","last_clean":"2024-05-08T03:04:49.893192+0000","last_became_active":"2024-05-08T02:45:31.611005+0000","last_became_peered":"2024-05-08T02:45:31.611005+0000","last_unstale":"2024-05-08T03:04:49.893192+0000","last_undegraded":"2024-05-08T03:04:49.893192+0000","last_fullsized":"2024-05-08T03:04:49.893192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1897,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.684161+0000","last_change":"2024-05-08T02:45:31.623778+0000","last_active":"2024-05-08T03:04:49.684161+0000","last_peered":"2024-05-08T03:04:49.684161+0000","last_clean":"2024-05-08T03:04:49.684161+0000","last_became_active":"2024-05-08T02:45:31.617883+0000","last_became_peered":"2024-05-08T02:45:31.617883+0000","last_unstale":"2024-05-08T03:04:49.684161+0000","last_undegraded":"2024-05-08T03:04:49.684161+0000","last_fullsized":"2024-05-08T03:04:49.684161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1885,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.872004+0000","last_change":"2024-05-08T02:45:31.634126+0000","last_active":"2024-05-08T03:04:49.872004+0000","last_peered":"2024-05-08T03:04:49.872004+0000","last_clean":"2024-05-08T03:04:49.872004+0000","last_became_active":"2024-05-08T02:45:31.628702+0000","last_became_peered":"2024-05-08T02:45:31.628702+0000","last_unstale":"2024-05-08T03:04:49.872004+0000","last_undegraded":"2024-05-08T03:04:49.872004+0000","last_fullsized":"2024-05-08T03:04:49.872004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1891,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:48.506834+0000","last_change":"2024-05-08T02:45:31.621292+0000","last_active":"2024-05-08T03:04:48.506834+0000","last_peered":"2024-05-08T03:04:48.506834+0000","last_clean":"2024-05-08T03:04:48.506834+0000","last_became_active":"2024-05-08T02:45:31.615285+0000","last_became_peered":"2024-05-08T02:45:31.615285+0000","last_unstale":"2024-05-08T03:04:48.506834+0000","last_undegraded":"2024-05-08T03:04:48.506834+0000","last_fullsized":"2024-05-08T03:04:48.506834+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1885,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.870445+0000","last_change":"2024-05-08T02:45:31.635093+0000","last_active":"2024-05-08T03:04:49.870445+0000","last_peered":"2024-05-08T03:04:49.870445+0000","last_clean":"2024-05-08T03:04:49.870445+0000","last_became_active":"2024-05-08T02:45:31.629721+0000","last_became_peered":"2024-05-08T02:45:31.629721+0000","last_unstale":"2024-05-08T03:04:49.870445+0000","last_undegraded":"2024-05-08T03:04:49.870445+0000","last_fullsized":"2024-05-08T03:04:49.870445+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1891,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:48.706513+0000","last_change":"2024-05-08T02:45:31.648464+0000","last_active":"2024-05-08T03:04:48.706513+0000","last_peered":"2024-05-08T03:04:48.706513+0000","last_clean":"2024-05-08T03:04:48.706513+0000","last_became_active":"2024-05-08T02:45:31.642977+0000","last_became_peered":"2024-05-08T02:45:31.642977+0000","last_unstale":"2024-05-08T03:04:48.706513+0000","last_undegraded":"2024-05-08T03:04:48.706513+0000","last_fullsized":"2024-05-08T03:04:48.706513+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:30.560655+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2006,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:49.656646+0000","last_change":"2024-05-08T02:45:29.600723+0000","last_active":"2024-05-08T03:04:49.656646+0000","last_peered":"2024-05-08T03:04:49.656646+0000","last_clean":"2024-05-08T03:04:49.656646+0000","last_became_active":"2024-05-08T02:45:29.595527+0000","last_became_peered":"2024-05-08T02:45:29.595527+0000","last_unstale":"2024-05-08T03:04:49.656646+0000","last_undegraded":"2024-05-08T03:04:49.656646+0000","last_fullsized":"2024-05-08T03:04:49.656646+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T02:45:28.553006+0000","last_clean_scrub_stamp":"2024-05-08T02:45:28.553006+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706827,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77808,"kb_used_data":2280,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779792,"statfs":{"total":107374182400,"available":107294507008,"internally_reserved":0,"allocated":2334720,"data_stored":1107601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706827,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64816,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792784,"statfs":{"total":107374182400,"available":107307810816,"internally_reserved":0,"allocated":1810432,"data_stored":508412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706827,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64744,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792856,"statfs":{"total":107374182400,"available":107307884544,"internally_reserved":0,"allocated":1736704,"data_stored":505253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706827,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":65336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792264,"statfs":{"total":107374182400,"available":107307278336,"internally_reserved":0,"allocated":2342912,"data_stored":1100233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T03:04:53.851 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.852 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.852 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.852 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.852 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.852 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.852 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.852 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.852 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.853 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.854 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.854 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.854 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.854 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.854 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.854 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.854 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.854 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.855 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.855 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.855 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.855 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.855 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-05-08T02:51:08.203784+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=51, tm_sec=8, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.855 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T02:45:30.560655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=45, tm_sec=30, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.855 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T02:45:30.560655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=45, tm_sec=30, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.855 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T02:45:30.560655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=45, tm_sec=30, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.855 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T02:45:30.560655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=45, tm_sec=30, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.856 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T02:45:30.560655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=45, tm_sec=30, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.856 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T02:45:30.560655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=45, tm_sec=30, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.856 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T02:45:30.560655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=45, tm_sec=30, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.856 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T02:45:30.560655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=45, tm_sec=30, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.856 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T02:45:28.553006+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=2, tm_min=45, tm_sec=28, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=3, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T03:04:53.856 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T03:05:13.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T03:05:13.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.977+0000 7f1332eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:05:13.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.983+0000 7f1332eed640 1 Processor -- start 2024-05-08T03:05:13.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.983+0000 7f1332eed640 1 -- start start 2024-05-08T03:05:13.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.984+0000 7f1332eed640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f132c09e7c0 0x7f132c0a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:05:13.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.984+0000 7f1332eed640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f132c0a0120 con 0x7f132c0a2e10 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.984+0000 7f1332eed640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7f132c06f270 con 0x7f132c09e7c0 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f1330c89640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f132c09e7c0 0x7f132c0a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f132bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f132c0a2e10 0x7f132c131650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51688/0 (socket says 172.21.15.46:51688) 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f1330c89640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f132c09e7c0 0x7f132c0a28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37284/0 (socket says 172.21.15.46:37284) 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f132bfff640 1 -- 172.21.15.46:0/3431388613 learned_addr learned my addr 172.21.15.46:0/3431388613 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f1330c89640 1 -- 172.21.15.46:0/3431388613 >> v1:172.21.15.46:6789/0 conn(0x7f132c0a2e10 legacy=0x7f132c131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f1330c89640 1 -- 172.21.15.46:0/3431388613 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c09e430 con 0x7f132c09e7c0 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f1330c89640 1 --2- 172.21.15.46:0/3431388613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c09e7c0 0x7f132c0a28d0 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cc7ce0f103940d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f132b7fe640 1 -- 172.21.15.46:0/3431388613 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1320009d90 con 0x7f132c09e7c0 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f132b7fe640 1 -- 172.21.15.46:0/3431388613 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f132000e230 con 0x7f132c09e7c0 2024-05-08T03:05:13.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.985+0000 7f132b7fe640 1 -- 172.21.15.46:0/3431388613 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f132000e4d0 con 0x7f132c09e7c0 2024-05-08T03:05:13.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.986+0000 7f1332eed640 1 -- 172.21.15.46:0/3431388613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c09e7c0 msgr2=0x7f132c0a28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:05:13.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.986+0000 7f1332eed640 1 --2- 172.21.15.46:0/3431388613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c09e7c0 0x7f132c0a28d0 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:13.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.986+0000 7f1332eed640 1 -- 172.21.15.46:0/3431388613 shutdown_connections 2024-05-08T03:05:13.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.986+0000 7f1332eed640 1 --2- 172.21.15.46:0/3431388613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c09e7c0 0x7f132c0a28d0 unknown :-1 s=CLOSED pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:13.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.986+0000 7f1332eed640 1 -- 172.21.15.46:0/3431388613 >> 172.21.15.46:0/3431388613 conn(0x7f132c06e2c0 msgr2=0x7f132c06e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:05:13.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.986+0000 7f1332eed640 1 -- 172.21.15.46:0/3431388613 shutdown_connections 2024-05-08T03:05:13.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.986+0000 7f1332eed640 1 -- 172.21.15.46:0/3431388613 wait complete. 2024-05-08T03:05:13.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.986+0000 7f1332eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:05:13.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.988+0000 7f1332eed640 1 Processor -- start 2024-05-08T03:05:13.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.988+0000 7f1332eed640 1 -- start start 2024-05-08T03:05:13.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.990+0000 7f1332eed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c0a2e10 0x7f132c11e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:05:13.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.990+0000 7f1332eed640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f132c1213c0 con 0x7f132c0a2e10 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.990+0000 7f1330c89640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c0a2e10 0x7f132c11e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.990+0000 7f1330c89640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c0a2e10 0x7f132c11e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37290/0 (socket says 172.21.15.46:37290) 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.990+0000 7f1330c89640 1 -- 172.21.15.46:0/361106567 learned_addr learned my addr 172.21.15.46:0/361106567 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.990+0000 7f1330c89640 1 -- 172.21.15.46:0/361106567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c121da0 con 0x7f132c0a2e10 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.991+0000 7f1330c89640 1 --2- 172.21.15.46:0/361106567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c0a2e10 0x7f132c11e790 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.991+0000 7f13297fa640 1 -- 172.21.15.46:0/361106567 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1320014620 con 0x7f132c0a2e10 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.991+0000 7f13297fa640 1 -- 172.21.15.46:0/361106567 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1320014780 con 0x7f132c0a2e10 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.991+0000 7f13297fa640 1 -- 172.21.15.46:0/361106567 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1320014a20 con 0x7f132c0a2e10 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.991+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132c11e1d0 con 0x7f132c0a2e10 2024-05-08T03:05:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.991+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132c11dec0 con 0x7f132c0a2e10 2024-05-08T03:05:13.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.992+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132c063900 con 0x7f132c0a2e10 2024-05-08T03:05:13.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.992+0000 7f13297fa640 1 -- 172.21.15.46:0/361106567 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1320014bd0 con 0x7f132c0a2e10 2024-05-08T03:05:13.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.992+0000 7f13297fa640 1 --2- 172.21.15.46:0/361106567 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1310038980 0x7f131003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:05:13.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.992+0000 7f13297fa640 1 -- 172.21.15.46:0/361106567 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7f1320019040 con 0x7f132c0a2e10 2024-05-08T03:05:13.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.993+0000 7f132bfff640 1 --2- 172.21.15.46:0/361106567 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1310038980 0x7f131003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:05:13.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.993+0000 7f132bfff640 1 --2- 172.21.15.46:0/361106567 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1310038980 0x7f131003ae90 crc :-1 s=READY pgs=3887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:05:14.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:13.997+0000 7f13297fa640 1 -- 172.21.15.46:0/361106567 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f13200185a0 con 0x7f132c0a2e10 2024-05-08T03:05:14.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.181+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 --> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f132c09f4c0 con 0x7f1310038980 2024-05-08T03:05:14.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.185+0000 7f13297fa640 1 -- 172.21.15.46:0/361106567 <== mgr.4102 v2:172.21.15.80:6800/280569916 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109134 (crc 0 0 0) 0x7f13180012b0 con 0x7f1310038980 2024-05-08T03:05:14.189 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-05-08T03:05:14.190 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-05-08T03:05:14.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1310038980 msgr2=0x7f131003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:05:14.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 --2- 172.21.15.46:0/361106567 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1310038980 0x7f131003ae90 crc :-1 s=READY pgs=3887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c0a2e10 msgr2=0x7f132c11e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:05:14.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 --2- 172.21.15.46:0/361106567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c0a2e10 0x7f132c11e790 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 shutdown_connections 2024-05-08T03:05:14.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 --2- 172.21.15.46:0/361106567 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7f1310038980 0x7f131003ae90 unknown :-1 s=CLOSED pgs=3887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 --2- 172.21.15.46:0/361106567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f132c0a2e10 0x7f132c11e790 unknown :-1 s=CLOSED pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 >> 172.21.15.46:0/361106567 conn(0x7f132c06e2c0 msgr2=0x7f132c1ba980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:05:14.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 shutdown_connections 2024-05-08T03:05:14.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.188+0000 7f1332eed640 1 -- 172.21.15.46:0/361106567 wait complete. 2024-05-08T03:05:14.202 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":1300,"stamp":"2024-05-08T03:05:12.808566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":272704,"kb_used_data":8032,"kb_used_omap":0,"kb_used_meta":264640,"kb_avail":419157696,"statfs":{"total":429496729600,"available":429217480704,"internally_reserved":0,"allocated":8224768,"data_stored":3221499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":270991360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003398"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.533057+0000","last_change":"2024-05-08T03:04:52.547337+0000","last_active":"2024-05-08T03:04:52.533057+0000","last_peered":"2024-05-08T03:04:52.533057+0000","last_clean":"2024-05-08T03:04:52.533057+0000","last_became_active":"2024-05-08T02:51:09.414974+0000","last_became_peered":"2024-05-08T02:51:09.414974+0000","last_unstale":"2024-05-08T03:04:52.533057+0000","last_undegraded":"2024-05-08T03:04:52.533057+0000","last_fullsized":"2024-05-08T03:04:52.533057+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.547156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.547156+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.058229+0000","last_change":"2024-05-08T03:04:52.075517+0000","last_active":"2024-05-08T03:04:52.058229+0000","last_peered":"2024-05-08T03:04:52.058229+0000","last_clean":"2024-05-08T03:04:52.058229+0000","last_became_active":"2024-05-08T02:51:09.429857+0000","last_became_peered":"2024-05-08T02:51:09.429857+0000","last_unstale":"2024-05-08T03:04:52.058229+0000","last_undegraded":"2024-05-08T03:04:52.058229+0000","last_fullsized":"2024-05-08T03:04:52.058229+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.075346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.075346+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.021192+0000","last_change":"2024-05-08T03:04:53.040053+0000","last_active":"2024-05-08T03:04:53.021192+0000","last_peered":"2024-05-08T03:04:53.021192+0000","last_clean":"2024-05-08T03:04:53.021192+0000","last_became_active":"2024-05-08T02:51:09.422128+0000","last_became_peered":"2024-05-08T02:51:09.422128+0000","last_unstale":"2024-05-08T03:04:53.021192+0000","last_undegraded":"2024-05-08T03:04:53.021192+0000","last_fullsized":"2024-05-08T03:04:53.021192+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.039845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.039845+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1267,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.519159+0000","last_change":"2024-05-08T03:04:53.546703+0000","last_active":"2024-05-08T03:04:53.519159+0000","last_peered":"2024-05-08T03:04:53.519159+0000","last_clean":"2024-05-08T03:04:53.519159+0000","last_became_active":"2024-05-08T02:51:09.509773+0000","last_became_peered":"2024-05-08T02:51:09.509773+0000","last_unstale":"2024-05-08T03:04:53.519159+0000","last_undegraded":"2024-05-08T03:04:53.519159+0000","last_fullsized":"2024-05-08T03:04:53.519159+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.546541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.546541+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.528167+0000","last_change":"2024-05-08T03:04:52.553436+0000","last_active":"2024-05-08T03:04:52.528167+0000","last_peered":"2024-05-08T03:04:52.528167+0000","last_clean":"2024-05-08T03:04:52.528167+0000","last_became_active":"2024-05-08T02:51:09.520146+0000","last_became_peered":"2024-05-08T02:51:09.520146+0000","last_unstale":"2024-05-08T03:04:52.528167+0000","last_undegraded":"2024-05-08T03:04:52.528167+0000","last_fullsized":"2024-05-08T03:04:52.528167+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.553251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.553251+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.054719+0000","last_change":"2024-05-08T03:04:52.072755+0000","last_active":"2024-05-08T03:04:52.054719+0000","last_peered":"2024-05-08T03:04:52.054719+0000","last_clean":"2024-05-08T03:04:52.054719+0000","last_became_active":"2024-05-08T02:51:09.464789+0000","last_became_peered":"2024-05-08T02:51:09.464789+0000","last_unstale":"2024-05-08T03:04:52.054719+0000","last_undegraded":"2024-05-08T03:04:52.054719+0000","last_fullsized":"2024-05-08T03:04:52.054719+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.072577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.072577+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.049396+0000","last_change":"2024-05-08T03:04:52.065448+0000","last_active":"2024-05-08T03:04:52.049396+0000","last_peered":"2024-05-08T03:04:52.049396+0000","last_clean":"2024-05-08T03:04:52.049396+0000","last_became_active":"2024-05-08T02:51:09.490174+0000","last_became_peered":"2024-05-08T02:51:09.490174+0000","last_unstale":"2024-05-08T03:04:52.049396+0000","last_undegraded":"2024-05-08T03:04:52.049396+0000","last_fullsized":"2024-05-08T03:04:52.049396+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.065262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.065262+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.045178+0000","last_change":"2024-05-08T03:04:52.061401+0000","last_active":"2024-05-08T03:04:52.045178+0000","last_peered":"2024-05-08T03:04:52.045178+0000","last_clean":"2024-05-08T03:04:52.045178+0000","last_became_active":"2024-05-08T02:51:09.473858+0000","last_became_peered":"2024-05-08T02:51:09.473858+0000","last_unstale":"2024-05-08T03:04:52.045178+0000","last_undegraded":"2024-05-08T03:04:52.045178+0000","last_fullsized":"2024-05-08T03:04:52.045178+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.061208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.061208+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1267,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.516102+0000","last_change":"2024-05-08T03:04:53.544176+0000","last_active":"2024-05-08T03:04:53.516102+0000","last_peered":"2024-05-08T03:04:53.516102+0000","last_clean":"2024-05-08T03:04:53.516102+0000","last_became_active":"2024-05-08T02:51:09.419746+0000","last_became_peered":"2024-05-08T02:51:09.419746+0000","last_unstale":"2024-05-08T03:04:53.516102+0000","last_undegraded":"2024-05-08T03:04:53.516102+0000","last_fullsized":"2024-05-08T03:04:53.516102+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.544009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.544009+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.020028+0000","last_change":"2024-05-08T03:04:53.038534+0000","last_active":"2024-05-08T03:04:53.020028+0000","last_peered":"2024-05-08T03:04:53.020028+0000","last_clean":"2024-05-08T03:04:53.020028+0000","last_became_active":"2024-05-08T02:51:09.412840+0000","last_became_peered":"2024-05-08T02:51:09.412840+0000","last_unstale":"2024-05-08T03:04:53.020028+0000","last_undegraded":"2024-05-08T03:04:53.020028+0000","last_fullsized":"2024-05-08T03:04:53.020028+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.038354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.038354+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1267,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.513004+0000","last_change":"2024-05-08T03:04:53.540834+0000","last_active":"2024-05-08T03:04:53.513004+0000","last_peered":"2024-05-08T03:04:53.513004+0000","last_clean":"2024-05-08T03:04:53.513004+0000","last_became_active":"2024-05-08T02:51:09.531607+0000","last_became_peered":"2024-05-08T02:51:09.531607+0000","last_unstale":"2024-05-08T03:04:53.513004+0000","last_undegraded":"2024-05-08T03:04:53.513004+0000","last_fullsized":"2024-05-08T03:04:53.513004+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.540669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.540669+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.043706+0000","last_change":"2024-05-08T03:04:52.074783+0000","last_active":"2024-05-08T03:04:52.043706+0000","last_peered":"2024-05-08T03:04:52.043706+0000","last_clean":"2024-05-08T03:04:52.043706+0000","last_became_active":"2024-05-08T02:51:09.469507+0000","last_became_peered":"2024-05-08T02:51:09.469507+0000","last_unstale":"2024-05-08T03:04:52.043706+0000","last_undegraded":"2024-05-08T03:04:52.043706+0000","last_fullsized":"2024-05-08T03:04:52.043706+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.074608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.074608+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1267,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.510329+0000","last_change":"2024-05-08T03:04:53.545360+0000","last_active":"2024-05-08T03:04:53.510329+0000","last_peered":"2024-05-08T03:04:53.510329+0000","last_clean":"2024-05-08T03:04:53.510329+0000","last_became_active":"2024-05-08T02:51:09.455287+0000","last_became_peered":"2024-05-08T02:51:09.455287+0000","last_unstale":"2024-05-08T03:04:53.510329+0000","last_undegraded":"2024-05-08T03:04:53.510329+0000","last_fullsized":"2024-05-08T03:04:53.510329+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.545190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.545190+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1267,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.508205+0000","last_change":"2024-05-08T03:04:53.534618+0000","last_active":"2024-05-08T03:04:53.508205+0000","last_peered":"2024-05-08T03:04:53.508205+0000","last_clean":"2024-05-08T03:04:53.508205+0000","last_became_active":"2024-05-08T02:51:09.492168+0000","last_became_peered":"2024-05-08T02:51:09.492168+0000","last_unstale":"2024-05-08T03:04:53.508205+0000","last_undegraded":"2024-05-08T03:04:53.508205+0000","last_fullsized":"2024-05-08T03:04:53.508205+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.534446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.534446+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.038686+0000","last_change":"2024-05-08T03:04:52.070831+0000","last_active":"2024-05-08T03:04:52.038686+0000","last_peered":"2024-05-08T03:04:52.038686+0000","last_clean":"2024-05-08T03:04:52.038686+0000","last_became_active":"2024-05-08T02:51:09.545524+0000","last_became_peered":"2024-05-08T02:51:09.545524+0000","last_unstale":"2024-05-08T03:04:52.038686+0000","last_undegraded":"2024-05-08T03:04:52.038686+0000","last_fullsized":"2024-05-08T03:04:52.038686+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.070652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.070652+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.036606+0000","last_change":"2024-05-08T03:04:52.068944+0000","last_active":"2024-05-08T03:04:52.036606+0000","last_peered":"2024-05-08T03:04:52.036606+0000","last_clean":"2024-05-08T03:04:52.036606+0000","last_became_active":"2024-05-08T02:51:09.498798+0000","last_became_peered":"2024-05-08T02:51:09.498798+0000","last_unstale":"2024-05-08T03:04:52.036606+0000","last_undegraded":"2024-05-08T03:04:52.036606+0000","last_fullsized":"2024-05-08T03:04:52.036606+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.068766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.068766+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.035606+0000","last_change":"2024-05-08T03:04:52.056913+0000","last_active":"2024-05-08T03:04:52.035606+0000","last_peered":"2024-05-08T03:04:52.035606+0000","last_clean":"2024-05-08T03:04:52.035606+0000","last_became_active":"2024-05-08T02:51:09.440822+0000","last_became_peered":"2024-05-08T02:51:09.440822+0000","last_unstale":"2024-05-08T03:04:52.035606+0000","last_undegraded":"2024-05-08T03:04:52.035606+0000","last_fullsized":"2024-05-08T03:04:52.035606+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.056731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.056731+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1267,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.502355+0000","last_change":"2024-05-08T03:04:53.538676+0000","last_active":"2024-05-08T03:04:53.502355+0000","last_peered":"2024-05-08T03:04:53.502355+0000","last_clean":"2024-05-08T03:04:53.502355+0000","last_became_active":"2024-05-08T02:51:09.449604+0000","last_became_peered":"2024-05-08T02:51:09.449604+0000","last_unstale":"2024-05-08T03:04:53.502355+0000","last_undegraded":"2024-05-08T03:04:53.502355+0000","last_fullsized":"2024-05-08T03:04:53.502355+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.538504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.538504+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.017547+0000","last_change":"2024-05-08T03:04:53.036619+0000","last_active":"2024-05-08T03:04:53.017547+0000","last_peered":"2024-05-08T03:04:53.017547+0000","last_clean":"2024-05-08T03:04:53.017547+0000","last_became_active":"2024-05-08T02:51:09.408878+0000","last_became_peered":"2024-05-08T02:51:09.408878+0000","last_unstale":"2024-05-08T03:04:53.017547+0000","last_undegraded":"2024-05-08T03:04:53.017547+0000","last_fullsized":"2024-05-08T03:04:53.017547+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.036428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.036428+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.525773+0000","last_change":"2024-05-08T03:04:52.551874+0000","last_active":"2024-05-08T03:04:52.525773+0000","last_peered":"2024-05-08T03:04:52.525773+0000","last_clean":"2024-05-08T03:04:52.525773+0000","last_became_active":"2024-05-08T02:51:09.493372+0000","last_became_peered":"2024-05-08T02:51:09.493372+0000","last_unstale":"2024-05-08T03:04:52.525773+0000","last_undegraded":"2024-05-08T03:04:52.525773+0000","last_fullsized":"2024-05-08T03:04:52.525773+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.551699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.551699+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.523268+0000","last_change":"2024-05-08T03:04:52.550356+0000","last_active":"2024-05-08T03:04:52.523268+0000","last_peered":"2024-05-08T03:04:52.523268+0000","last_clean":"2024-05-08T03:04:52.523268+0000","last_became_active":"2024-05-08T02:51:09.466931+0000","last_became_peered":"2024-05-08T02:51:09.466931+0000","last_unstale":"2024-05-08T03:04:52.523268+0000","last_undegraded":"2024-05-08T03:04:52.523268+0000","last_fullsized":"2024-05-08T03:04:52.523268+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.550180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.550180+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.521419+0000","last_change":"2024-05-08T03:04:52.548621+0000","last_active":"2024-05-08T03:04:52.521419+0000","last_peered":"2024-05-08T03:04:52.521419+0000","last_clean":"2024-05-08T03:04:52.521419+0000","last_became_active":"2024-05-08T02:51:09.475586+0000","last_became_peered":"2024-05-08T02:51:09.475586+0000","last_unstale":"2024-05-08T03:04:52.521419+0000","last_undegraded":"2024-05-08T03:04:52.521419+0000","last_fullsized":"2024-05-08T03:04:52.521419+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.548435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.548435+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.016416+0000","last_change":"2024-05-08T03:04:53.034893+0000","last_active":"2024-05-08T03:04:53.016416+0000","last_peered":"2024-05-08T03:04:53.016416+0000","last_clean":"2024-05-08T03:04:53.016416+0000","last_became_active":"2024-05-08T02:51:09.448780+0000","last_became_peered":"2024-05-08T02:51:09.448780+0000","last_unstale":"2024-05-08T03:04:53.016416+0000","last_undegraded":"2024-05-08T03:04:53.016416+0000","last_fullsized":"2024-05-08T03:04:53.016416+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.034696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.034696+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1267,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.500306+0000","last_change":"2024-05-08T03:04:53.533416+0000","last_active":"2024-05-08T03:04:53.500306+0000","last_peered":"2024-05-08T03:04:53.500306+0000","last_clean":"2024-05-08T03:04:53.500306+0000","last_became_active":"2024-05-08T02:51:09.440069+0000","last_became_peered":"2024-05-08T02:51:09.440069+0000","last_unstale":"2024-05-08T03:04:53.500306+0000","last_undegraded":"2024-05-08T03:04:53.500306+0000","last_fullsized":"2024-05-08T03:04:53.500306+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.533225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.533225+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1267,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.498395+0000","last_change":"2024-05-08T03:04:53.530755+0000","last_active":"2024-05-08T03:04:53.498395+0000","last_peered":"2024-05-08T03:04:53.498395+0000","last_clean":"2024-05-08T03:04:53.498395+0000","last_became_active":"2024-05-08T02:51:09.472343+0000","last_became_peered":"2024-05-08T02:51:09.472343+0000","last_unstale":"2024-05-08T03:04:53.498395+0000","last_undegraded":"2024-05-08T03:04:53.498395+0000","last_fullsized":"2024-05-08T03:04:53.498395+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.530573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.530573+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.031866+0000","last_change":"2024-05-08T03:04:52.053541+0000","last_active":"2024-05-08T03:04:52.031866+0000","last_peered":"2024-05-08T03:04:52.031866+0000","last_clean":"2024-05-08T03:04:52.031866+0000","last_became_active":"2024-05-08T02:51:09.532094+0000","last_became_peered":"2024-05-08T02:51:09.532094+0000","last_unstale":"2024-05-08T03:04:52.031866+0000","last_undegraded":"2024-05-08T03:04:52.031866+0000","last_fullsized":"2024-05-08T03:04:52.031866+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.053352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.053352+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1267,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.496642+0000","last_change":"2024-05-08T03:04:53.528561+0000","last_active":"2024-05-08T03:04:53.496642+0000","last_peered":"2024-05-08T03:04:53.496642+0000","last_clean":"2024-05-08T03:04:53.496642+0000","last_became_active":"2024-05-08T02:51:09.443431+0000","last_became_peered":"2024-05-08T02:51:09.443431+0000","last_unstale":"2024-05-08T03:04:53.496642+0000","last_undegraded":"2024-05-08T03:04:53.496642+0000","last_fullsized":"2024-05-08T03:04:53.496642+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.528366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.528366+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.030675+0000","last_change":"2024-05-08T03:04:52.064644+0000","last_active":"2024-05-08T03:04:52.030675+0000","last_peered":"2024-05-08T03:04:52.030675+0000","last_clean":"2024-05-08T03:04:52.030675+0000","last_became_active":"2024-05-08T02:51:09.515226+0000","last_became_peered":"2024-05-08T02:51:09.515226+0000","last_unstale":"2024-05-08T03:04:52.030675+0000","last_undegraded":"2024-05-08T03:04:52.030675+0000","last_fullsized":"2024-05-08T03:04:52.030675+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.064455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.064455+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.028355+0000","last_change":"2024-05-08T03:04:52.048125+0000","last_active":"2024-05-08T03:04:52.028355+0000","last_peered":"2024-05-08T03:04:52.028355+0000","last_clean":"2024-05-08T03:04:52.028355+0000","last_became_active":"2024-05-08T02:51:09.433946+0000","last_became_peered":"2024-05-08T02:51:09.433946+0000","last_unstale":"2024-05-08T03:04:52.028355+0000","last_undegraded":"2024-05-08T03:04:52.028355+0000","last_fullsized":"2024-05-08T03:04:52.028355+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.047925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.047925+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.029512+0000","last_change":"2024-05-08T03:04:52.067272+0000","last_active":"2024-05-08T03:04:52.029512+0000","last_peered":"2024-05-08T03:04:52.029512+0000","last_clean":"2024-05-08T03:04:52.029512+0000","last_became_active":"2024-05-08T02:51:09.570979+0000","last_became_peered":"2024-05-08T02:51:09.570979+0000","last_unstale":"2024-05-08T03:04:52.029512+0000","last_undegraded":"2024-05-08T03:04:52.029512+0000","last_fullsized":"2024-05-08T03:04:52.029512+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.067097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.067097+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1308,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.520154+0000","last_change":"2024-05-08T03:04:52.544865+0000","last_active":"2024-05-08T03:04:52.520154+0000","last_peered":"2024-05-08T03:04:52.520154+0000","last_clean":"2024-05-08T03:04:52.520154+0000","last_became_active":"2024-05-08T02:51:09.419747+0000","last_became_peered":"2024-05-08T02:51:09.419747+0000","last_unstale":"2024-05-08T03:04:52.520154+0000","last_undegraded":"2024-05-08T03:04:52.520154+0000","last_fullsized":"2024-05-08T03:04:52.520154+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-05-08T03:04:52.544662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.544662+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.014803+0000","last_change":"2024-05-08T03:04:53.033048+0000","last_active":"2024-05-08T03:04:53.014803+0000","last_peered":"2024-05-08T03:04:53.014803+0000","last_clean":"2024-05-08T03:04:53.014803+0000","last_became_active":"2024-05-08T02:51:09.454882+0000","last_became_peered":"2024-05-08T02:51:09.454882+0000","last_unstale":"2024-05-08T03:04:53.014803+0000","last_undegraded":"2024-05-08T03:04:53.014803+0000","last_fullsized":"2024-05-08T03:04:53.014803+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.032820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.032820+0000","last_clean_scrub_stamp":"2024-05-08T02:51:08.203784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1893,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.520148+0000","last_change":"2024-05-08T03:04:52.544552+0000","last_active":"2024-05-08T03:04:52.520148+0000","last_peered":"2024-05-08T03:04:52.520148+0000","last_clean":"2024-05-08T03:04:52.520148+0000","last_became_active":"2024-05-08T02:45:31.647316+0000","last_became_peered":"2024-05-08T02:45:31.647316+0000","last_unstale":"2024-05-08T03:04:52.520148+0000","last_undegraded":"2024-05-08T03:04:52.520148+0000","last_fullsized":"2024-05-08T03:04:52.520148+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.544361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.544361+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1899,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.015177+0000","last_change":"2024-05-08T03:04:53.028127+0000","last_active":"2024-05-08T03:04:53.015177+0000","last_peered":"2024-05-08T03:04:53.015177+0000","last_clean":"2024-05-08T03:04:53.015177+0000","last_became_active":"2024-05-08T02:45:31.636059+0000","last_became_peered":"2024-05-08T02:45:31.636059+0000","last_unstale":"2024-05-08T03:04:53.015177+0000","last_undegraded":"2024-05-08T03:04:53.015177+0000","last_fullsized":"2024-05-08T03:04:53.015177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.027897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.027897+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1875,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.495131+0000","last_change":"2024-05-08T03:04:53.527095+0000","last_active":"2024-05-08T03:04:53.495131+0000","last_peered":"2024-05-08T03:04:53.495131+0000","last_clean":"2024-05-08T03:04:53.495131+0000","last_became_active":"2024-05-08T02:45:31.611005+0000","last_became_peered":"2024-05-08T02:45:31.611005+0000","last_unstale":"2024-05-08T03:04:53.495131+0000","last_undegraded":"2024-05-08T03:04:53.495131+0000","last_fullsized":"2024-05-08T03:04:53.495131+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.526762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.526762+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1899,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.013080+0000","last_change":"2024-05-08T03:04:53.030920+0000","last_active":"2024-05-08T03:04:53.013080+0000","last_peered":"2024-05-08T03:04:53.013080+0000","last_clean":"2024-05-08T03:04:53.013080+0000","last_became_active":"2024-05-08T02:45:31.617883+0000","last_became_peered":"2024-05-08T02:45:31.617883+0000","last_unstale":"2024-05-08T03:04:53.013080+0000","last_undegraded":"2024-05-08T03:04:53.013080+0000","last_fullsized":"2024-05-08T03:04:53.013080+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:53.030683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.030683+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1887,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.027912+0000","last_change":"2024-05-08T03:04:52.062718+0000","last_active":"2024-05-08T03:04:52.027912+0000","last_peered":"2024-05-08T03:04:52.027912+0000","last_clean":"2024-05-08T03:04:52.027912+0000","last_became_active":"2024-05-08T02:45:31.628702+0000","last_became_peered":"2024-05-08T02:45:31.628702+0000","last_unstale":"2024-05-08T03:04:52.027912+0000","last_undegraded":"2024-05-08T03:04:52.027912+0000","last_fullsized":"2024-05-08T03:04:52.027912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.062528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.062528+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1893,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.518412+0000","last_change":"2024-05-08T03:04:52.540661+0000","last_active":"2024-05-08T03:04:52.518412+0000","last_peered":"2024-05-08T03:04:52.518412+0000","last_clean":"2024-05-08T03:04:52.518412+0000","last_became_active":"2024-05-08T02:45:31.615285+0000","last_became_peered":"2024-05-08T02:45:31.615285+0000","last_unstale":"2024-05-08T03:04:52.518412+0000","last_undegraded":"2024-05-08T03:04:52.518412+0000","last_fullsized":"2024-05-08T03:04:52.518412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.540477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.540477+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1887,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.027909+0000","last_change":"2024-05-08T03:04:52.041388+0000","last_active":"2024-05-08T03:04:52.027909+0000","last_peered":"2024-05-08T03:04:52.027909+0000","last_clean":"2024-05-08T03:04:52.027909+0000","last_became_active":"2024-05-08T02:45:31.629721+0000","last_became_peered":"2024-05-08T02:45:31.629721+0000","last_unstale":"2024-05-08T03:04:52.027909+0000","last_undegraded":"2024-05-08T03:04:52.027909+0000","last_fullsized":"2024-05-08T03:04:52.027909+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.041194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.041194+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1893,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:52.520454+0000","last_change":"2024-05-08T03:04:52.547344+0000","last_active":"2024-05-08T03:04:52.520454+0000","last_peered":"2024-05-08T03:04:52.520454+0000","last_clean":"2024-05-08T03:04:52.520454+0000","last_became_active":"2024-05-08T02:45:31.642977+0000","last_became_peered":"2024-05-08T02:45:31.642977+0000","last_unstale":"2024-05-08T03:04:52.520454+0000","last_undegraded":"2024-05-08T03:04:52.520454+0000","last_fullsized":"2024-05-08T03:04:52.520454+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T03:04:52.547156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:52.547156+0000","last_clean_scrub_stamp":"2024-05-08T02:45:30.560655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2008,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-05-08T03:04:53.494885+0000","last_change":"2024-05-08T03:04:53.542708+0000","last_active":"2024-05-08T03:04:53.494885+0000","last_peered":"2024-05-08T03:04:53.494885+0000","last_clean":"2024-05-08T03:04:53.494885+0000","last_became_active":"2024-05-08T02:45:29.595527+0000","last_became_peered":"2024-05-08T02:45:29.595527+0000","last_unstale":"2024-05-08T03:04:53.494885+0000","last_undegraded":"2024-05-08T03:04:53.494885+0000","last_fullsized":"2024-05-08T03:04:53.494885+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'97","last_scrub_stamp":"2024-05-08T03:04:53.542505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T03:04:53.542505+0000","last_clean_scrub_stamp":"2024-05-08T02:45:28.553006+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706847,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77808,"kb_used_data":2280,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779792,"statfs":{"total":107374182400,"available":107294507008,"internally_reserved":0,"allocated":2334720,"data_stored":1107601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706847,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64816,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792784,"statfs":{"total":107374182400,"available":107307810816,"internally_reserved":0,"allocated":1810432,"data_stored":508412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706847,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64744,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792856,"statfs":{"total":107374182400,"available":107307884544,"internally_reserved":0,"allocated":1736704,"data_stored":505253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706847,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":65336,"kb_used_data":2288,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792264,"statfs":{"total":107374182400,"available":107307278336,"internally_reserved":0,"allocated":2342912,"data_stored":1100233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T03:05:14.205 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T03:05:14.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.308+0000 7ffbdf9e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:05:14.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.316+0000 7ffbdf9e7640 1 Processor -- start 2024-05-08T03:05:14.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.317+0000 7ffbdf9e7640 1 -- start start 2024-05-08T03:05:14.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.318+0000 7ffbdf9e7640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffbd806bca0 0x7ffbd806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:05:14.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.318+0000 7ffbdf9e7640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd8073b10 con 0x7ffbd806c5f0 2024-05-08T03:05:14.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.318+0000 7ffbdf9e7640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd80755c0 con 0x7ffbd806bca0 2024-05-08T03:05:14.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.318+0000 7ffbdd783640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffbd806bca0 0x7ffbd806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:05:14.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.318+0000 7ffbdcf82640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffbd806c5f0 0x7ffbd812f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:51690/0 (socket says 172.21.15.46:51690) 2024-05-08T03:05:14.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.318+0000 7ffbdcf82640 1 -- 172.21.15.46:0/3941562371 learned_addr learned my addr 172.21.15.46:0/3941562371 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-05-08T03:05:14.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.319+0000 7ffbdd783640 1 -- 172.21.15.46:0/3941562371 >> v1:172.21.15.46:6789/0 conn(0x7ffbd806c5f0 legacy=0x7ffbd812f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:05:14.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.319+0000 7ffbdd783640 1 -- 172.21.15.46:0/3941562371 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd809dbf0 con 0x7ffbd806bca0 2024-05-08T03:05:14.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.319+0000 7ffbdd783640 1 --2- 172.21.15.46:0/3941562371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 0x7ffbd806c0b0 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bf0630496669bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:05:14.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.319+0000 7ffbcffff640 1 -- 172.21.15.46:0/3941562371 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffbd4009d90 con 0x7ffbd806bca0 2024-05-08T03:05:14.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.319+0000 7ffbcffff640 1 -- 172.21.15.46:0/3941562371 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffbd400e230 con 0x7ffbd806bca0 2024-05-08T03:05:14.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.319+0000 7ffbcffff640 1 -- 172.21.15.46:0/3941562371 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffbd400e4d0 con 0x7ffbd806bca0 2024-05-08T03:05:14.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.320+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/3941562371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 msgr2=0x7ffbd806c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:05:14.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.320+0000 7ffbdf9e7640 1 --2- 172.21.15.46:0/3941562371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 0x7ffbd806c0b0 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.320+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/3941562371 shutdown_connections 2024-05-08T03:05:14.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.320+0000 7ffbdf9e7640 1 --2- 172.21.15.46:0/3941562371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 0x7ffbd806c0b0 unknown :-1 s=CLOSED pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.320+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/3941562371 >> 172.21.15.46:0/3941562371 conn(0x7ffbd80a1a80 msgr2=0x7ffbd80a1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:05:14.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.320+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/3941562371 shutdown_connections 2024-05-08T03:05:14.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.320+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/3941562371 wait complete. 2024-05-08T03:05:14.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.320+0000 7ffbdf9e7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-05-08T03:05:14.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.322+0000 7ffbdf9e7640 1 Processor -- start 2024-05-08T03:05:14.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.322+0000 7ffbdf9e7640 1 -- start start 2024-05-08T03:05:14.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.323+0000 7ffbdf9e7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 0x7ffbd811be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:05:14.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.323+0000 7ffbdf9e7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd809cea0 con 0x7ffbd806bca0 2024-05-08T03:05:14.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.323+0000 7ffbdd783640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 0x7ffbd811be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:05:14.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.323+0000 7ffbdd783640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 0x7ffbd811be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37310/0 (socket says 172.21.15.46:37310) 2024-05-08T03:05:14.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.323+0000 7ffbdd783640 1 -- 172.21.15.46:0/529207659 learned_addr learned my addr 172.21.15.46:0/529207659 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-05-08T03:05:14.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.324+0000 7ffbdd783640 1 -- 172.21.15.46:0/529207659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd811fef0 con 0x7ffbd806bca0 2024-05-08T03:05:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.324+0000 7ffbdd783640 1 --2- 172.21.15.46:0/529207659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 0x7ffbd811be90 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:05:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.324+0000 7ffbcdffb640 1 -- 172.21.15.46:0/529207659 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffbd4014750 con 0x7ffbd806bca0 2024-05-08T03:05:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.324+0000 7ffbcdffb640 1 -- 172.21.15.46:0/529207659 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffbd40148b0 con 0x7ffbd806bca0 2024-05-08T03:05:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.324+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd8130010 con 0x7ffbd806bca0 2024-05-08T03:05:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.324+0000 7ffbcdffb640 1 -- 172.21.15.46:0/529207659 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffbd4014b50 con 0x7ffbd806bca0 2024-05-08T03:05:14.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.324+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd811f480 con 0x7ffbd806bca0 2024-05-08T03:05:14.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.325+0000 7ffbcdffb640 1 -- 172.21.15.46:0/529207659 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ffbd4014d00 con 0x7ffbd806bca0 2024-05-08T03:05:14.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.325+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd811e440 con 0x7ffbd806bca0 2024-05-08T03:05:14.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.326+0000 7ffbcdffb640 1 --2- 172.21.15.46:0/529207659 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffbbc038980 0x7ffbbc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T03:05:14.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.326+0000 7ffbcdffb640 1 -- 172.21.15.46:0/529207659 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(714..714 src has 611..714) ==== 3403+0+0 (crc 0 0 0) 0x7ffbd4019040 con 0x7ffbd806bca0 2024-05-08T03:05:14.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.326+0000 7ffbdcf82640 1 --2- 172.21.15.46:0/529207659 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffbbc038980 0x7ffbbc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T03:05:14.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.327+0000 7ffbdcf82640 1 --2- 172.21.15.46:0/529207659 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffbbc038980 0x7ffbbc03ae90 crc :-1 s=READY pgs=3888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T03:05:14.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.331+0000 7ffbcdffb640 1 -- 172.21.15.46:0/529207659 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ffbd4013e40 con 0x7ffbd806bca0 2024-05-08T03:05:14.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.516+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ffbd8063900 con 0x7ffbd806bca0 2024-05-08T03:05:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.519+0000 7ffbcdffb640 1 -- 172.21.15.46:0/529207659 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7ffbd4010310 con 0x7ffbd806bca0 2024-05-08T03:05:14.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.519+0000 7ffbcdffb640 1 -- 172.21.15.46:0/529207659 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7ffbd4013e40 con 0x7ffbd806bca0 2024-05-08T03:05:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffbbc038980 msgr2=0x7ffbbc03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:05:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 --2- 172.21.15.46:0/529207659 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffbbc038980 0x7ffbbc03ae90 crc :-1 s=READY pgs=3888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 msgr2=0x7ffbd811be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T03:05:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 --2- 172.21.15.46:0/529207659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 0x7ffbd811be90 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 shutdown_connections 2024-05-08T03:05:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 --2- 172.21.15.46:0/529207659 >> [v2:172.21.15.80:6800/280569916,v1:172.21.15.80:6801/280569916] conn(0x7ffbbc038980 0x7ffbbc03ae90 unknown :-1 s=CLOSED pgs=3888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 --2- 172.21.15.46:0/529207659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffbd806bca0 0x7ffbd811be90 unknown :-1 s=CLOSED pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T03:05:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 >> 172.21.15.46:0/529207659 conn(0x7ffbd80a1a80 msgr2=0x7ffbd8071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T03:05:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 shutdown_connections 2024-05-08T03:05:14.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-05-08T03:05:14.522+0000 7ffbdf9e7640 1 -- 172.21.15.46:0/529207659 wait complete. 2024-05-08T03:05:14.539 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T03:05:14.539 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T03:05:14.540 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T03:05:14.540 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T03:05:14.610 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T03:05:14.610 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T03:05:14.610 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T03:05:14.689 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T03:05:14.689 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T03:05:14.689 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T03:05:14.772 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T03:05:14.773 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T03:05:14.773 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T03:05:14.857 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T03:05:14.857 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T03:05:14.857 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T03:05:14.857 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T03:05:14.885 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T03:05:14.885 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T03:05:14.885 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T03:05:14.885 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T03:05:14.903 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T03:05:14.903 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T03:05:14.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-05-08T03:05:14.974 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-08T03:05:14.975 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T03:05:15.146 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-05-08T03:05:15.146 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T03:05:15.337 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T03:05:15.337 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T03:05:15.438 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T03:05:15.438 DEBUG:teuthology.orchestra.run.smithi080:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T03:05:15.519 INFO:tasks.ceph:Archiving mon data... 2024-05-08T03:05:15.519 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180/data/mon.a.tgz 2024-05-08T03:05:15.520 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-05-08T03:05:15.537 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.izyl20dkDm 2024-05-08T03:05:15.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.izyl20dkDm 2024-05-08T03:05:15.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.izyl20dkDm 2024-05-08T03:05:15.797 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.izyl20dkDm is 284KB 2024-05-08T03:05:15.893 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.izyl20dkDm 2024-05-08T03:05:15.908 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T03:05:15.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T03:05:15.950 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T03:05:16.029 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T03:05:16.045 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T03:05:16.045 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T03:05:16.047 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180/remote/smithi046/crash 2024-05-08T03:05:16.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T03:05:16.094 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/crash to /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180/remote/smithi080/crash 2024-05-08T03:05:16.095 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T03:05:16.131 INFO:tasks.ceph:Compressing logs... 2024-05-08T03:05:16.132 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T03:05:16.139 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T03:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95217.log 2024-05-08T03:05:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29133.log 2024-05-08T03:05:16.206 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28434.log 2024-05-08T03:05:16.206 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-08T03:05:16.206 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T03:05:16.206 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.28434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28394.log 84.7% 2024-05-08T03:05:16.207 INFO:teuthology.orchestra.run.smithi080.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28434.log.gz 2024-05-08T03:05:16.207 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-08T03:05:16.207 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.28394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28474.log 2024-05-08T03:05:16.207 INFO:teuthology.orchestra.run.smithi080.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28394.log.gz 2024-05-08T03:05:16.207 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28354.log 2024-05-08T03:05:16.207 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/ceph-client.admin.28474.log: /var/log/ceph/ceph-client.admin.28354.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28474.log.gz 2024-05-08T03:05:16.207 INFO:teuthology.orchestra.run.smithi080.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28354.log.gz 2024-05-08T03:05:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95529.log 2024-05-08T03:05:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95217.log: gzip/var/log/ceph/ceph-client.admin.29133.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.97988.log 2024-05-08T03:05:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95529.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.95217.log.gz 84.8% 2024-05-08T03:05:16.224 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29133.log.gz 2024-05-08T03:05:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97571.log 2024-05-08T03:05:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95420.log 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97988.log.gz 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95529.log.gz 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30281.log 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94898.log 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97571.log.gz 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96973.log 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30281.log.gz 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94898.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95420.log.gz 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98030.log 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97402.log 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98030.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96973.log.gz 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97641.log 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94898.log.gz 2024-05-08T03:05:16.225 INFO:teuthology.orchestra.run.smithi046.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.98030.log.gz 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32237.log 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97641.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97402.log.gz 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30282.log 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97641.log.gz 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97237.log 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94445.log 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32237.log.gz 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30282.log.gz 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30283.log 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.97237.log.gz 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97036.log 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97665.log 2024-05-08T03:05:16.226 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30283.log.gz 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97036.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97036.log.gz 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98156.log 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97665.log.gz 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97862.log 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30181.log 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.94445.log.gz 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.98156.log.gz 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30450.log 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.97862.log.gz 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94387.log 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30450.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30181.log.gz 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95582.log 2024-05-08T03:05:16.227 INFO:teuthology.orchestra.run.smithi046.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30450.log.gz 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32199.log 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96226.log 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94387.log.gz 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97423.log 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95582.log.gz 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95130.log 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.97423.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30451.log 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95130.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97423.log.gz 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98072.log 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97360.log 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.95130.log.gz 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30451.log: /var/log/ceph/ceph-client.admin.98072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95494.log 2024-05-08T03:05:16.228 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30451.log.gz 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.98072.log.gz 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30448.log 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95165.log 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4%/var/log/ceph/ceph-client.admin.95494.log: -- replaced with /var/log/ceph/ceph-client.admin.97360.log.gz 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30448.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.95494.log.gz 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97507.log 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30448.log.gz 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30097.log 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95165.log: /var/log/ceph/ceph-client.admin.97507.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.96226.log.gz 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97616.log 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97507.log.gz 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30097.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95165.log.gz 2024-05-08T03:05:16.229 INFO:teuthology.orchestra.run.smithi046.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30097.log.gz 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97101.log 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.97616.log.gz 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32107.log 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97778.log 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32107.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97101.log.gz 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97334.log 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30449.log 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97778.log: /var/log/ceph/ceph-client.admin.97334.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.32107.log.gz 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95352.log 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.97778.log.gz 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.97334.log.gz 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98324.log 2024-05-08T03:05:16.230 INFO:teuthology.orchestra.run.smithi046.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30449.log.gz 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95270.log 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95352.log: /var/log/ceph/ceph-client.admin.98324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96119.log 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.98324.log.gz 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5/var/log/ceph/ceph-client.admin.95270.log: --verbose -- /var/log/ceph/ceph-client.admin.95218.log 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.95352.log.gz 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95353.log 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96119.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95270.log.gz 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97946.log 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.32199.log.gz 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32256.log 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95353.log: /var/log/ceph/ceph-client.admin.97946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96910.log 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95218.log.gz 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.96119.log.gz 2024-05-08T03:05:16.231 INFO:teuthology.orchestra.run.smithi046.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97946.log.gz 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32256.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.95353.log.gz 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97310.log 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97444.log 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32256.log.gz 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97310.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.96910.log.gz --verbose 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.96889.log 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.97310.log.gz 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95216.log 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97444.log.gz 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32141.log 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95216.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96889.log.gz 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30005.log 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96840.log 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95216.log.gz 2024-05-08T03:05:16.232 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96438.log 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30005.log.gz 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96636.log 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96438.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96840.log.gz 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30559.log 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96636.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93921.log 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96636.log.gz 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30559.log.gz 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.32141.log.gz 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98240.log 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97486.log 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.98240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95531.log 2024-05-08T03:05:16.233 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.98240.log.gz 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97486.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.96438.log.gz 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93995.log 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94214.log 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97486.log.gz 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95531.log: /var/log/ceph/ceph-client.admin.93995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96814.log 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.95531.log.gz 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97057.log 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93995.log.gz 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97146.log 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96814.log.gz 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96952.log 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97146.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.94214.log.gz 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97057.log.gz 2024-05-08T03:05:16.234 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94251.log 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97146.log.gz 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30601.log 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96952.log.gz 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95271.log 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32160.log 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30601.log.gz 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97381.log 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95457.log 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.95271.log.gz/var/log/ceph/ceph-client.admin.97381.log: 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32160.log.gz 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95166.log 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.94251.log.gz 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97381.log.gz 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95937.log 2024-05-08T03:05:16.235 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.95457.log.gz 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95166.log: /var/log/ceph/ceph-client.admin.95937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30280.log 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.95166.log.gz 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97592.log 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97528.log 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr: 86.6%/var/log/ceph/ceph-client.admin.97592.log: -- replaced with /var/log/ceph/ceph-client.admin.30280.log.gz 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose 86.5% -- replaced with /var/log/ceph/ceph-client.admin.97592.log.gz 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.98282.log 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97078.log 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97528.log.gz 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95493.log 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.98282.log.gz 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97078.log: gzip -5 92.4% -- replaced with /var/log/ceph/ceph-client.admin.95937.log.gz 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.95128.log 2024-05-08T03:05:16.236 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97078.log.gz 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96931.log 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94977.log 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95493.log.gz 83.8% -- replaced with /var/log/ceph/ceph-client.admin.95128.log.gz 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95267.log 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96931.log.gz 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97102.log 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96668.log 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97192.log 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr: 86.4% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95267.log.gz 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96668.log: -- replaced with /var/log/ceph/ceph-client.admin.97102.log.gz 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94425.log 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.93921.log.gz/var/log/ceph/ceph-client.admin.97192.log: 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98114.log 2024-05-08T03:05:16.237 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97192.log.gz 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95167.log 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94425.log: /var/log/ceph/ceph-client.admin.98114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94368.log 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95167.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.98114.log.gz 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.95167.log.gz 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.94425.log.gz 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97284.log 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96864.log 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97284.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26550.log 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94368.log.gz 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.97284.log.gz 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96864.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96864.log.gz 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95678.log 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.26550.log: gzip -5 --verbose 68.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26550.log.gz 2024-05-08T03:05:16.238 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.97262.log 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31333.log 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95354.log 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97262.log.gz 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.31333.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95678.log.gz 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.94977.log.gz 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94033.log 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96994.log 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.96668.log.gz 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97820.log 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95354.log.gz 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95530.log 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96994.log.gz 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95268.log 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97820.log: /var/log/ceph/ceph-client.admin.95530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97465.log 2024-05-08T03:05:16.239 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6%/var/log/ceph/ceph-client.admin.95268.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97820.log.gz 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95530.log.gz 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.94033.log.gz 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30139.log 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.95268.log.gz 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30643.log 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94563.log 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97465.log.gz 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28870.log 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30139.log.gz 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94563.log: 86.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.30643.log.gz 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97904.log 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29949.log/var/log/ceph/ceph-client.admin.28870.log: 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97904.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.28870.log.gz 2024-05-08T03:05:16.240 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97193.log 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.97904.log.gz 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.29949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98364.log 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95129.log 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29949.log.gz 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98364.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.97193.log.gz 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97015.log 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.98364.log.gz 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5/var/log/ceph/ceph-client.admin.95129.log: --verbose -- /var/log/ceph/ceph-client.admin.94512.log 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98198.log 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95129.log.gz 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97015.log.gz 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29105.log 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98198.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.94563.log.gz 2024-05-08T03:05:16.241 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95105.log 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.98198.log.gz 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.29105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30863.log 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.29105.log.gz 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30055.log 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95614.log 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.30055.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.94512.log.gz 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30055.log.gz 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95661.log 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.95105.log.gz 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28949.log 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95614.log: /var/log/ceph/ceph-client.admin.95661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95421.log 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.28949.log: 85.8% 93.2% -- replaced with /var/log/ceph/ceph-client.admin.31333.log.gz 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95661.log.gz 2024-05-08T03:05:16.242 INFO:teuthology.orchestra.run.smithi046.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28949.log.gz 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95890.log 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95124.log 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95890.log: gzip -5 --verbose 85.9% -- /var/log/ceph/ceph-client.admin.97549.log -- replaced with /var/log/ceph/ceph-client.admin.95421.log.gz 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8%/var/log/ceph/ceph-client.admin.95124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97167.log 67.7% -- replaced with /var/log/ceph/ceph-client.admin.95124.log.gz 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95614.log.gz/var/log/ceph/ceph-client.admin.97549.log: 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32275.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97549.log.gz 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95456.log 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97167.log.gz 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.32275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95269.log 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94406.log 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95456.log: /var/log/ceph/ceph-client.admin.95269.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.30863.log.gz 2024-05-08T03:05:16.243 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95456.log.gz 2024-05-08T03:05:16.244 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95269.log.gz 2024-05-08T03:05:16.244 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94406.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.94406.log.gz 2024-05-08T03:05:16.244 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95890.log.gz 2024-05-08T03:05:16.411 INFO:teuthology.orchestra.run.smithi080.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T03:05:16.638 INFO:teuthology.orchestra.run.smithi046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.32275.log.gz 2024-05-08T03:05:17.728 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T03:05:20.987 INFO:teuthology.orchestra.run.smithi080.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T03:05:21.193 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T03:05:21.242 INFO:teuthology.orchestra.run.smithi080.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T03:05:21.243 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-05-08T03:05:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m5.055s 2024-05-08T03:05:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m9.622s 2024-05-08T03:05:21.243 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.427s 2024-05-08T03:05:21.687 INFO:teuthology.orchestra.run.smithi046.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T03:05:21.689 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-05-08T03:05:21.689 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m5.537s 2024-05-08T03:05:21.689 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m12.136s 2024-05-08T03:05:21.689 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m0.581s 2024-05-08T03:05:21.689 INFO:tasks.ceph:Archiving logs... 2024-05-08T03:05:21.689 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180/remote/smithi046/log 2024-05-08T03:05:21.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T03:05:23.654 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180/remote/smithi080/log 2024-05-08T03:05:23.655 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T03:05:25.203 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T03:05:25.218 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T03:05:25.219 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T03:05:25.222 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T03:05:25.302 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T03:05:25.311 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T03:05:25.312 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T03:05:25.315 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T03:05:25.330 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-05-08T03:05:25.332 INFO:teuthology.orchestra.run.smithi080.stderr:bash: line 1: ntpq: command not found 2024-05-08T03:05:25.335 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T03:05:25.335 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-05-08T03:05:25.335 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv01.front.sepia.ceph.com 3 7 377 70 +833us[ +827us] +/- 68ms 2024-05-08T03:05:25.335 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -864us[ -864us] +/- 64ms 2024-05-08T03:05:25.335 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +8215ns[+8215ns] +/- 78ms 2024-05-08T03:05:25.335 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T03:05:25.337 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T03:05:25.337 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-05-08T03:05:25.337 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +876us[ +885us] +/- 68ms 2024-05-08T03:05:25.337 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -821us[ -821us] +/- 64ms 2024-05-08T03:05:25.337 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +44us[ +44us] +/- 78ms 2024-05-08T03:05:25.337 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T03:05:25.338 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T03:05:25.348 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T03:05:25.349 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T03:05:25.401 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T03:05:25.471 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T03:05:25.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T03:05:25.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T03:05:25.569 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T03:05:25.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T03:05:25.602 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T03:05:25.618 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T03:05:25.648 INFO:teuthology.task.internal:Duration was 1683.320937 seconds 2024-05-08T03:05:25.648 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T03:05:25.693 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T03:05:25.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T03:05:25.696 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T03:05:25.738 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T03:05:25.741 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T03:05:26.137 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T03:05:26.138 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-05-08T03:05:26.138 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T03:05:26.162 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-05-08T03:05:26.162 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T03:05:26.284 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T03:05:26.284 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T03:05:26.287 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T03:05:26.318 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T03:05:26.318 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T03:05:26.359 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T03:05:26.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T03:05:26.471 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T03:05:26.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T03:05:26.497 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T03:05:26.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T03:05:26.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T03:05:26.540 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T03:05:26.562 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-05-08T03:05:26.588 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-05-08T03:05:26.606 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T03:05:26.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T03:05:26.631 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T03:05:26.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T03:05:26.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T03:05:26.673 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T03:05:26.674 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180/remote/smithi046 2024-05-08T03:05:26.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T03:05:26.708 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2024-05-08_02:24:47-crimson-rados-ci-yingxin-crimson-load-obc-new-2-distro-default-smithi/7697180/remote/smithi080 2024-05-08T03:05:26.709 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T03:05:26.743 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T03:05:26.744 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T03:05:26.746 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T03:05:26.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T03:05:26.806 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T03:05:26.807 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T03:05:26.845 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T03:05:26.846 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T03:05:26.848 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T03:05:26.861 INFO:teuthology.orchestra.run.smithi046.stdout: 265573 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 03:05 /home/ubuntu/cephtest 2024-05-08T03:05:26.863 INFO:teuthology.orchestra.run.smithi080.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 03:05 /home/ubuntu/cephtest 2024-05-08T03:05:26.864 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T03:05:26.891 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T03:05:26.923 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 1683.32093667984 flavor: crimson owner: scheduled_yingxin@teuthology success: true 2024-05-08T03:05:26.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T03:05:27.005 INFO:teuthology.run:pass