2024-04-25T09:04:35.588 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T09:04:35.588 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} --name matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi --archive /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969 --owner scheduled_matan@teuthology -- /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969/orig.config.yaml 2024-04-25T09:04:35.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:04:35.699 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969 branch: wip-matanb-crimson-testing-april-22 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: null first_in_suite: false job_id: '7672969' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-april-22 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: a126334d8733673d119ffdf40d6ae4b541a0a1cd ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: a126334d8733673d119ffdf40d6ae4b541a0a1cd selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 472cc2b524a88306ef4535053d26658c5fd6e9db owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1211 sha1: a126334d8733673d119ffdf40d6ae4b541a0a1cd sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_472cc2b524a88306ef4535053d26658c5fd6e9db/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 472cc2b524a88306ef4535053d26658c5fd6e9db targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFozbiU1KxeXG1tKBNToDVDbteMjIXEJbyfl6zNrZra5ieVLOyl/M9mT8Nrtnkq9gLeVFbxhZDKnzR2ykBOj/nw= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPFOmQ8iFPt/sJMeIGkFgQmfZzKLG3ifv1uUUmyVFlp92UpeIfFL8k3NEdSSqM+zl17y55rSCQu8PsZfoKYXQA= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_08:07:11 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T09:04:35.699 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_472cc2b524a88306ef4535053d26658c5fd6e9db/qa; will attempt to use it 2024-04-25T09:04:35.700 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_472cc2b524a88306ef4535053d26658c5fd6e9db/qa/tasks 2024-04-25T09:04:35.700 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T09:04:35.702 INFO:teuthology.task.internal:Checking packages... 2024-04-25T09:04:35.729 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash 'a126334d8733673d119ffdf40d6ae4b541a0a1cd' 2024-04-25T09:04:35.729 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T09:04:35.729 INFO:teuthology.packaging:ref: None 2024-04-25T09:04:35.729 INFO:teuthology.packaging:tag: None 2024-04-25T09:04:35.729 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-april-22 2024-04-25T09:04:35.729 INFO:teuthology.packaging:sha1: a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:04:35.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-april-22 2024-04-25T09:04:35.866 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3194.ga126334d 2024-04-25T09:04:35.867 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T09:04:35.873 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T09:04:35.873 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T09:04:35.881 INFO:teuthology.task.internal:Saving configuration 2024-04-25T09:04:35.893 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T09:04:35.899 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T09:04:35.921 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:59:27.678984', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFozbiU1KxeXG1tKBNToDVDbteMjIXEJbyfl6zNrZra5ieVLOyl/M9mT8Nrtnkq9gLeVFbxhZDKnzR2ykBOj/nw='} 2024-04-25T09:04:35.941 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:59:27.680670', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPFOmQ8iFPt/sJMeIGkFgQmfZzKLG3ifv1uUUmyVFlp92UpeIfFL8k3NEdSSqM+zl17y55rSCQu8PsZfoKYXQA='} 2024-04-25T09:04:35.941 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T09:04:35.947 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-04-25T09:04:35.948 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-25T09:04:35.948 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T09:04:36.020 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4e4374ae50>, signals=[15]) 2024-04-25T09:04:36.020 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T09:04:36.026 INFO:teuthology.task.internal:Opening connections... 2024-04-25T09:04:36.026 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-04-25T09:04:36.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:04:36.103 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T09:04:36.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:04:36.178 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T09:04:36.184 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-04-25T09:04:36.203 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-04-25T09:04:36.203 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-04-25T09:04:36.261 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T09:04:36.262 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T09:04:36.263 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T09:04:36.263 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-04-25T09:04:36.285 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-04-25T09:04:36.304 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-04-25T09:04:36.304 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-04-25T09:04:36.361 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-04-25T09:04:36.361 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-04-25T09:04:36.361 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-04-25T09:04:36.361 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-04-25T09:04:36.361 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-04-25T09:04:36.361 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-04-25T09:04:36.361 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T09:04:36.361 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-04-25T09:04:36.361 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-04-25T09:04:36.362 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T09:04:36.362 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-04-25T09:04:36.362 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T09:04:36.362 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T09:04:36.362 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T09:04:36.362 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-04-25T09:04:36.386 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T09:04:36.394 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T09:04:36.398 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T09:04:36.399 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-04-25T09:04:36.401 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-04-25T09:04:36.417 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T09:04:36.423 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T09:04:36.423 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-04-25T09:04:36.458 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-04-25T09:04:36.486 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T09:04:36.548 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T09:04:36.561 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T09:04:36.561 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T09:04:36.561 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T09:04:36.562 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T09:04:36.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:36.578 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-04-25T09:04:36.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:36.579 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-04-25T09:04:36.636 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-437.el9.x86_64 2024-04-25T09:04:36.636 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.14.0-437.el9.x86_64 2024-04-25T09:04:36.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum install -y kernel 2024-04-25T09:04:36.637 INFO:teuthology.orchestra.run.smithi053.stdout:5.14.0-437.el9.x86_64 2024-04-25T09:04:36.637 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.14.0-437.el9.x86_64 2024-04-25T09:04:36.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum install -y kernel 2024-04-25T09:04:39.101 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 9.2 MB/s | 8.0 MB 00:00 2024-04-25T09:04:39.336 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 6.9 MB/s | 8.0 MB 00:01 2024-04-25T09:04:41.727 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-25T09:04:42.512 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 19 MB 00:02 2024-04-25T09:04:45.994 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-25T09:04:47.063 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.2 MB 00:00 2024-04-25T09:04:48.413 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 16 kB 00:00 2024-04-25T09:04:48.603 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-04-25T09:04:49.776 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-25T09:04:50.174 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-25T09:04:54.864 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-25T09:04:55.371 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-25T09:04:56.763 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T09:04:56.763 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T09:04:56.849 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:04:56.850 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:04:56.850 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:04:56.973 DEBUG:teuthology.orchestra.run.smithi151:> echo no | sudo yum reinstall kernel || true 2024-04-25T09:04:57.277 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T09:04:57.278 INFO:teuthology.orchestra.run.smithi053.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T09:04:57.366 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:04:57.367 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:04:57.367 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:04:57.460 DEBUG:teuthology.orchestra.run.smithi053:> echo no | sudo yum reinstall kernel || true 2024-04-25T09:04:57.473 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 09:04:54 AM UTC. 2024-04-25T09:04:57.598 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:04:57.607 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout:Reinstalling: 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 255 k 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 0 2024-04-25T09:04:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:Operation aborted. 2024-04-25T09:04:57.659 INFO:teuthology.orchestra.run.smithi151.stdout:Is this ok [y/N]: 2024-04-25T09:04:57.660 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum reinstall -y kernel || true 2024-04-25T09:04:57.984 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 09:04:55 AM UTC. 2024-04-25T09:04:58.108 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout:Reinstalling: 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 255 k 2024-04-25T09:04:58.133 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 0 2024-04-25T09:04:58.134 INFO:teuthology.orchestra.run.smithi053.stderr:Operation aborted. 2024-04-25T09:04:58.154 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 09:04:54 AM UTC. 2024-04-25T09:04:58.191 INFO:teuthology.orchestra.run.smithi053.stdout:Is this ok [y/N]: 2024-04-25T09:04:58.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum reinstall -y kernel || true 2024-04-25T09:04:58.270 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:04:58.271 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:04:58.271 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2024-04-25T09:04:58.271 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:04:58.271 INFO:teuthology.orchestra.run.smithi151.stdout:Reinstalling: 2024-04-25T09:04:58.271 INFO:teuthology.orchestra.run.smithi151.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:04:58.271 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:04:58.271 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:04:58.271 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:04:58.272 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:04:58.272 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 255 k 2024-04-25T09:04:58.272 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 0 2024-04-25T09:04:58.272 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:04:58.706 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 09:04:55 AM UTC. 2024-04-25T09:04:58.827 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout:Reinstalling: 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 255 k 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 0 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:04:58.992 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-5.14.0-437.el9.x86_64.rpm 562 kB/s | 255 kB 00:00 2024-04-25T09:04:58.992 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:04:58.992 INFO:teuthology.orchestra.run.smithi151.stdout:Total 354 kB/s | 255 kB 00:00 2024-04-25T09:04:59.011 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:04:59.180 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:04:59.180 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:04:59.185 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:04:59.185 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:04:59.299 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:04:59.331 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-437.el9.x86_64.rpm 663 kB/s | 255 kB 00:00 2024-04-25T09:04:59.331 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:04:59.331 INFO:teuthology.orchestra.run.smithi053.stdout:Total 506 kB/s | 255 kB 00:00 2024-04-25T09:04:59.350 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:04:59.376 INFO:teuthology.orchestra.run.smithi151.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:04:59.376 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:04:59.553 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:04:59.553 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:04:59.559 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:04:59.559 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:04:59.723 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:04:59.799 INFO:teuthology.orchestra.run.smithi053.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:04:59.799 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:05:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:05:00.074 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:05:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:05:00.483 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:05:00.724 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:05:00.724 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:05:00.724 INFO:teuthology.orchestra.run.smithi151.stdout:Reinstalled: 2024-04-25T09:05:00.724 INFO:teuthology.orchestra.run.smithi151.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T09:05:00.724 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:05:00.724 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:05:00.898 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T09:05:00.945 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T09:05:00.945 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T09:05:00.945 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T09:05:00.945 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-25T09:05:00.946 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T09:05:00.978 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-04-25T09:05:00.997 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:01.181 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:05:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:05:01.182 INFO:teuthology.orchestra.run.smithi053.stdout:Reinstalled: 2024-04-25T09:05:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T09:05:01.182 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:05:01.182 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:05:01.362 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T09:05:01.410 INFO:teuthology.orchestra.run.smithi053.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T09:05:01.411 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T09:05:01.411 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T09:05:01.411 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T09:05:01.411 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T09:05:01.443 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-04-25T09:05:01.463 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:01.464 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T09:05:01.472 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T09:05:01.472 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T09:05:01.507 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T09:05:01.522 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T09:05:01.532 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T09:05:01.539 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T09:05:01.539 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T09:05:01.561 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T09:05:01.592 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T09:05:01.599 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T09:05:01.599 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T09:05:01.619 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T09:05:01.647 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:05:01.657 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:05:01.662 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:05:01.672 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:05:01.673 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T09:05:01.680 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T09:05:01.680 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T09:05:01.701 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T09:05:01.737 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T09:05:01.751 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T09:05:01.752 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T09:05:01.767 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T09:05:01.792 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:05:01.862 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:05:01.917 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:05:02.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:05:02.039 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:05:02.039 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T09:05:02.103 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:05:02.143 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:05:02.195 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:05:02.276 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:05:02.316 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:05:02.316 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T09:05:02.380 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-04-25T09:05:02.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-04-25T09:05:02.413 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:05:02.467 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:05:02.816 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T09:05:02.825 INFO:teuthology.task.internal:Starting timer... 2024-04-25T09:05:02.825 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T09:05:02.835 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T09:05:02.843 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T09:05:02.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2024-04-25T09:05:02.899 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2024-04-25T09:05:02.900 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2024-04-25T09:05:02.958 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2024-04-25T09:05:02.960 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T09:05:02.960 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2024-04-25T09:05:02.978 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2024-04-25T09:05:02.978 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2024-04-25T09:05:03.006 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2024-04-25T09:05:03.006 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2024-04-25T09:05:03.006 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T09:05:03.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:05:03.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T09:05:03.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:05:03.070 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T09:05:03.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2024-04-25T09:05:03.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2024-04-25T09:05:03.134 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T09:05:03.145 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T09:05:03.151 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T09:05:03.273 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T09:05:03.288 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T09:05:03.289 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T09:08:31.714 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-04-25T09:08:31.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-04-25T09:08:31.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:08:31.794 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-04-25T09:08:31.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-04-25T09:08:31.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-04-25T09:08:31.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:08:31.949 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-04-25T09:08:32.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-04-25T09:08:32.025 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T09:08:32.042 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T09:08:32.043 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:08:32.043 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:08:32.046 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:08:32.046 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:08:32.072 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T09:08:32.087 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T09:08:32.092 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T09:08:32.105 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T09:08:32.111 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2024-04-25T09:08:32.122 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2024-04-25T09:08:32.128 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2024-04-25T09:08:32.135 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T09:08:32.138 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2024-04-25T09:08:32.149 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T09:08:32.151 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T09:08:32.164 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T09:08:32.210 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:08:32.213 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:08:32.214 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-04-25T09:08:32.214 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:08:32.214 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:08:32.214 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:08:32.214 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:08:32.217 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:08:32.221 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:08:32.221 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-04-25T09:08:32.221 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:08:32.221 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:08:32.221 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:08:32.221 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:08:32.222 INFO:teuthology.run_tasks:Running task install... 2024-04-25T09:08:32.230 DEBUG:teuthology.task.install:project ceph 2024-04-25T09:08:32.230 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'}} 2024-04-25T09:08:32.230 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'} 2024-04-25T09:08:32.230 INFO:teuthology.task.install:Using flavor: crimson 2024-04-25T09:08:32.236 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T09:08:32.236 INFO:teuthology.task.install:extra packages: [] 2024-04-25T09:08:32.237 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd', 'tag': None, 'wait_for_package': False} 2024-04-25T09:08:32.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:08:32.239 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd', 'tag': None, 'wait_for_package': False} 2024-04-25T09:08:32.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:08:32.393 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/ 2024-04-25T09:08:32.394 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3194.ga126334d 2024-04-25T09:08:32.405 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/ 2024-04-25T09:08:32.406 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3194.ga126334d 2024-04-25T09:08:32.516 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T09:08:32.516 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:08:32.516 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T09:08:32.542 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-25T09:08:32.542 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a126334d8733673d119ffdf40d6ae4b541a0a1cd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T09:08:32.607 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T09:08:32.681 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T09:08:32.745 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T09:08:32.745 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:08:32.746 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T09:08:32.747 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2024-04-25T09:08:32.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2024-04-25T09:08:32.772 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-25T09:08:32.772 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a126334d8733673d119ffdf40d6ae4b541a0a1cd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T09:08:32.837 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T09:08:32.910 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T09:08:32.974 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2024-04-25T09:08:32.975 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2024-04-25T09:08:32.979 INFO:teuthology.orchestra.run.smithi053.stdout:48 files removed 2024-04-25T09:08:33.007 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw 2024-04-25T09:08:33.198 INFO:teuthology.orchestra.run.smithi151.stdout:48 files removed 2024-04-25T09:08:33.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw 2024-04-25T09:08:33.624 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 254 kB/s | 87 kB 00:00 2024-04-25T09:08:33.818 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 263 kB/s | 87 kB 00:00 2024-04-25T09:08:34.202 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-04-25T09:08:34.241 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 20 kB/s | 12 kB 00:00 2024-04-25T09:08:34.528 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 7.0 kB/s | 2.0 kB 00:00 2024-04-25T09:08:34.584 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 6.7 kB/s | 2.0 kB 00:00 2024-04-25T09:08:35.175 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-25T09:08:38.254 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 19 MB 00:01 2024-04-25T09:08:43.269 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 6.2 MB 00:01 2024-04-25T09:08:44.728 INFO:teuthology.orchestra.run.smithi053.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-04-25T09:08:52.518 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 459 kB/s | 8.0 MB 00:17 2024-04-25T09:08:55.885 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 8.2 MB/s | 19 MB 00:02 2024-04-25T09:09:00.528 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.2 MB 00:01 2024-04-25T09:09:02.137 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-25T09:09:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-25T09:09:05.098 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 21 MB 00:20 2024-04-25T09:09:08.938 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-25T09:09:10.353 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:09:11.088 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:09:11.088 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:09:11.088 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:09:11.088 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:09:11.088 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:19.0.0-3194.ga126334d.el9 ceph 10 M 2024-04-25T09:09:11.088 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2024-04-25T09:09:11.088 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.4 M 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.7 M 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.9 M 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:19.0.0-3194.ga126334d.el9 ceph 19 M 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:19.0.0-3194.ga126334d.el9 ceph 25 k 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T09:09:11.089 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 796 k 2024-04-25T09:09:11.090 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T09:09:11.090 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T09:09:11.090 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T09:09:11.090 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 548 k 2024-04-25T09:09:11.090 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T09:09:11.090 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.3 M 2024-04-25T09:09:11.090 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T09:09:11.090 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T09:09:11.090 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 45 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:19.0.0-3194.ga126334d.el9 ceph 135 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:19.0.0-3194.ga126334d.el9 ceph 160 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:19.0.0-3194.ga126334d.el9 ceph 315 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 293 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:19.0.0-3194.ga126334d.el9 ceph 99 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T09:09:11.091 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T09:09:11.092 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2024-04-25T09:09:11.092 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T09:09:11.092 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:09:11.092 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:09:11.092 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:09:11.092 INFO:teuthology.orchestra.run.smithi151.stdout:Install 30 Packages 2024-04-25T09:09:11.092 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 2 Packages 2024-04-25T09:09:11.092 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:09:11.093 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 59 M 2024-04-25T09:09:11.093 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:09:12.595 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:09:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:09:12.598 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:09:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:09:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:09:12.598 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:19.0.0-3194.ga126334d.el9 ceph 10 M 2024-04-25T09:09:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2024-04-25T09:09:12.598 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.4 M 2024-04-25T09:09:12.598 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.7 M 2024-04-25T09:09:12.598 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.9 M 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:19.0.0-3194.ga126334d.el9 ceph 19 M 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:19.0.0-3194.ga126334d.el9 ceph 25 k 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 796 k 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T09:09:12.599 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 548 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.3 M 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 45 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:19.0.0-3194.ga126334d.el9 ceph 135 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:19.0.0-3194.ga126334d.el9 ceph 160 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:19.0.0-3194.ga126334d.el9 ceph 315 k 2024-04-25T09:09:12.600 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 293 k 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:19.0.0-3194.ga126334d.el9 ceph 99 k 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:Installing weak dependencies: 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:Install 30 Packages 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 2 Packages 2024-04-25T09:09:12.601 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:09:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 59 M 2024-04-25T09:09:12.602 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:09:13.639 INFO:teuthology.orchestra.run.smithi151.stdout:(1/32): ceph-base-19.0.0-3194.ga126334d.el9.x86 5.7 MB/s | 5.9 MB 00:01 2024-04-25T09:09:13.747 INFO:teuthology.orchestra.run.smithi151.stdout:(2/32): ceph-selinux-19.0.0-3194.ga126334d.el9. 232 kB/s | 25 kB 00:00 2024-04-25T09:09:14.081 INFO:teuthology.orchestra.run.smithi151.stdout:(3/32): ceph-radosgw-19.0.0-3194.ga126334d.el9. 6.8 MB/s | 10 MB 00:01 2024-04-25T09:09:14.123 INFO:teuthology.orchestra.run.smithi151.stdout:(4/32): libcephfs2-19.0.0-3194.ga126334d.el9.x8 2.1 MB/s | 796 kB 00:00 2024-04-25T09:09:14.423 INFO:teuthology.orchestra.run.smithi151.stdout:(5/32): libradosstriper1-19.0.0-3194.ga126334d. 1.6 MB/s | 548 kB 00:00 2024-04-25T09:09:14.515 INFO:teuthology.orchestra.run.smithi151.stdout:(6/32): python3-ceph-argparse-19.0.0-3194.ga126 492 kB/s | 45 kB 00:00 2024-04-25T09:09:14.640 INFO:teuthology.orchestra.run.smithi151.stdout:(7/32): python3-ceph-common-19.0.0-3194.ga12633 1.1 MB/s | 135 kB 00:00 2024-04-25T09:09:14.948 INFO:teuthology.orchestra.run.smithi151.stdout:(8/32): python3-cephfs-19.0.0-3194.ga126334d.el 518 kB/s | 160 kB 00:00 2024-04-25T09:09:15.132 INFO:teuthology.orchestra.run.smithi151.stdout:(9/32): ceph-common-19.0.0-3194.ga126334d.el9.x 7.6 MB/s | 19 MB 00:02 2024-04-25T09:09:15.145 INFO:teuthology.orchestra.run.smithi053.stdout:(1/32): ceph-radosgw-19.0.0-3194.ga126334d.el9. 5.6 MB/s | 10 MB 00:01 2024-04-25T09:09:15.191 INFO:teuthology.orchestra.run.smithi151.stdout:(10/32): python3-rados-19.0.0-3194.ga126334d.el 1.3 MB/s | 315 kB 00:00 2024-04-25T09:09:15.195 INFO:teuthology.orchestra.run.smithi053.stdout:(2/32): ceph-selinux-19.0.0-3194.ga126334d.el9. 507 kB/s | 25 kB 00:00 2024-04-25T09:09:15.216 INFO:teuthology.orchestra.run.smithi151.stdout:(11/32): python3-rbd-19.0.0-3194.ga126334d.el9. 3.4 MB/s | 293 kB 00:00 2024-04-25T09:09:15.258 INFO:teuthology.orchestra.run.smithi151.stdout:(12/32): python3-rgw-19.0.0-3194.ga126334d.el9. 1.4 MB/s | 99 kB 00:00 2024-04-25T09:09:15.312 INFO:teuthology.orchestra.run.smithi053.stdout:(3/32): libcephfs2-19.0.0-3194.ga126334d.el9.x8 6.7 MB/s | 796 kB 00:00 2024-04-25T09:09:15.413 INFO:teuthology.orchestra.run.smithi053.stdout:(4/32): libradosstriper1-19.0.0-3194.ga126334d. 5.3 MB/s | 548 kB 00:00 2024-04-25T09:09:15.475 INFO:teuthology.orchestra.run.smithi151.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 413 kB/s | 107 kB 00:00 2024-04-25T09:09:15.517 INFO:teuthology.orchestra.run.smithi151.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 619 kB/s | 160 kB 00:00 2024-04-25T09:09:15.634 INFO:teuthology.orchestra.run.smithi151.stdout:(15/32): librgw2-19.0.0-3194.ga126334d.el9.x86_ 3.5 MB/s | 5.3 MB 00:01 2024-04-25T09:09:15.668 INFO:teuthology.orchestra.run.smithi151.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 235 kB/s | 45 kB 00:00 2024-04-25T09:09:15.901 INFO:teuthology.orchestra.run.smithi151.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 181 kB/s | 42 kB 00:00 2024-04-25T09:09:15.913 INFO:teuthology.orchestra.run.smithi053.stdout:(5/32): ceph-base-19.0.0-3194.ga126334d.el9.x86 2.3 MB/s | 5.9 MB 00:02 2024-04-25T09:09:15.976 INFO:teuthology.orchestra.run.smithi151.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 855 kB/s | 292 kB 00:00 2024-04-25T09:09:15.980 INFO:teuthology.orchestra.run.smithi053.stdout:(6/32): librgw2-19.0.0-3194.ga126334d.el9.x86_6 9.3 MB/s | 5.3 MB 00:00 2024-04-25T09:09:16.005 INFO:teuthology.orchestra.run.smithi053.stdout:(7/32): python3-ceph-argparse-19.0.0-3194.ga126 491 kB/s | 45 kB 00:00 2024-04-25T09:09:16.010 INFO:teuthology.orchestra.run.smithi151.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-04-25T09:09:16.030 INFO:teuthology.orchestra.run.smithi053.stdout:(8/32): python3-ceph-common-19.0.0-3194.ga12633 2.6 MB/s | 135 kB 00:00 2024-04-25T09:09:16.135 INFO:teuthology.orchestra.run.smithi151.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 226 kB/s | 36 kB 00:00 2024-04-25T09:09:16.202 INFO:teuthology.orchestra.run.smithi151.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 247 kB/s | 47 kB 00:00 2024-04-25T09:09:16.223 INFO:teuthology.orchestra.run.smithi053.stdout:(9/32): ceph-common-19.0.0-3194.ga126334d.el9.x 6.7 MB/s | 19 MB 00:02 2024-04-25T09:09:16.248 INFO:teuthology.orchestra.run.smithi053.stdout:(10/32): python3-cephfs-19.0.0-3194.ga126334d.e 659 kB/s | 160 kB 00:00 2024-04-25T09:09:16.252 INFO:teuthology.orchestra.run.smithi151.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 629 kB/s | 221 kB 00:00 2024-04-25T09:09:16.281 INFO:teuthology.orchestra.run.smithi053.stdout:(11/32): python3-rados-19.0.0-3194.ga126334d.el 1.2 MB/s | 315 kB 00:00 2024-04-25T09:09:16.306 INFO:teuthology.orchestra.run.smithi053.stdout:(12/32): python3-rgw-19.0.0-3194.ga126334d.el9. 1.7 MB/s | 99 kB 00:00 2024-04-25T09:09:16.332 INFO:teuthology.orchestra.run.smithi053.stdout:(13/32): python3-rbd-19.0.0-3194.ga126334d.el9. 2.6 MB/s | 293 kB 00:00 2024-04-25T09:09:16.553 INFO:teuthology.orchestra.run.smithi151.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 86 kB/s | 26 kB 00:00 2024-04-25T09:09:16.557 INFO:teuthology.orchestra.run.smithi053.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 201 kB/s | 45 kB 00:00 2024-04-25T09:09:16.582 INFO:teuthology.orchestra.run.smithi053.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 356 kB/s | 107 kB 00:00 2024-04-25T09:09:16.607 INFO:teuthology.orchestra.run.smithi053.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 533 kB/s | 160 kB 00:00 2024-04-25T09:09:16.686 INFO:teuthology.orchestra.run.smithi151.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 561 kB/s | 309 kB 00:00 2024-04-25T09:09:16.711 INFO:teuthology.orchestra.run.smithi151.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 307 kB/s | 49 kB 00:00 2024-04-25T09:09:16.795 INFO:teuthology.orchestra.run.smithi151.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2024-04-25T09:09:16.841 INFO:teuthology.orchestra.run.smithi053.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 181 kB/s | 42 kB 00:00 2024-04-25T09:09:16.904 INFO:teuthology.orchestra.run.smithi151.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-25T09:09:16.933 INFO:teuthology.orchestra.run.smithi053.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 834 kB/s | 292 kB 00:00 2024-04-25T09:09:17.029 INFO:teuthology.orchestra.run.smithi151.stdout:(28/32): libarrow-9.0.0-10.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-04-25T09:09:17.063 INFO:teuthology.orchestra.run.smithi151.stdout:(29/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 838 kB 00:00 2024-04-25T09:09:17.083 INFO:teuthology.orchestra.run.smithi053.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 239 kB/s | 36 kB 00:00 2024-04-25T09:09:17.108 INFO:teuthology.orchestra.run.smithi053.stdout:(20/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.2 MB/s | 662 kB 00:00 2024-04-25T09:09:17.134 INFO:teuthology.orchestra.run.smithi053.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 754 kB/s | 221 kB 00:00 2024-04-25T09:09:17.180 INFO:teuthology.orchestra.run.smithi151.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2024-04-25T09:09:17.310 INFO:teuthology.orchestra.run.smithi053.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 210 kB/s | 47 kB 00:00 2024-04-25T09:09:17.426 INFO:teuthology.orchestra.run.smithi053.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 972 kB/s | 309 kB 00:00 2024-04-25T09:09:17.452 INFO:teuthology.orchestra.run.smithi053.stdout:(24/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 183 kB/s | 26 kB 00:00 2024-04-25T09:09:17.535 INFO:teuthology.orchestra.run.smithi053.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 587 kB/s | 49 kB 00:00 2024-04-25T09:09:17.561 INFO:teuthology.orchestra.run.smithi053.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 625 kB/s | 67 kB 00:00 2024-04-25T09:09:17.580 INFO:teuthology.orchestra.run.smithi151.stdout:(31/32): librbd1-19.0.0-3194.ga126334d.el9.x86_ 7.1 MB/s | 3.7 MB 00:00 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi053.stdout:(27/32): libarrow-9.0.0-10.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2024-04-25T09:09:17.744 INFO:teuthology.orchestra.run.smithi053.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.0 MB/s | 838 kB 00:00 2024-04-25T09:09:17.770 INFO:teuthology.orchestra.run.smithi053.stdout:(29/32): re2-20211101-3.el9.x86_64.rpm 930 kB/s | 192 kB 00:00 2024-04-25T09:09:17.830 INFO:teuthology.orchestra.run.smithi151.stdout:(32/32): librados2-19.0.0-3194.ga126334d.el9.x8 4.2 MB/s | 3.4 MB 00:00 2024-04-25T09:09:17.836 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:09:17.837 INFO:teuthology.orchestra.run.smithi151.stdout:Total 8.8 MB/s | 59 MB 00:06 2024-04-25T09:09:17.887 INFO:teuthology.orchestra.run.smithi053.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-04-25T09:09:17.934 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:09:17.971 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:09:17.971 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:09:18.162 INFO:teuthology.orchestra.run.smithi053.stdout:(31/32): librbd1-19.0.0-3194.ga126334d.el9.x86_ 9.4 MB/s | 3.7 MB 00:00 2024-04-25T09:09:18.433 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:09:18.433 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:09:18.545 INFO:teuthology.orchestra.run.smithi053.stdout:(32/32): librados2-19.0.0-3194.ga126334d.el9.x8 4.2 MB/s | 3.4 MB 00:00 2024-04-25T09:09:18.550 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:09:18.550 INFO:teuthology.orchestra.run.smithi053.stdout:Total 9.9 MB/s | 59 MB 00:05 2024-04-25T09:09:18.657 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:09:18.699 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:09:18.699 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:09:19.187 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:09:19.187 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:09:19.897 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:09:20.398 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-25T09:09:20.441 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:09:20.524 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:09:20.613 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 3/34 2024-04-25T09:09:20.642 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:09:20.668 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:09:20.688 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:09:20.726 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-04-25T09:09:20.755 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-04-25T09:09:20.780 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-04-25T09:09:20.803 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-25T09:09:20.829 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-25T09:09:20.995 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-25T09:09:21.041 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-25T09:09:21.191 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-25T09:09:21.248 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:09:21.341 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:09:21.412 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-04-25T09:09:21.431 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 3/34 2024-04-25T09:09:21.458 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:09:21.466 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:09:21.516 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:09:21.528 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:09:21.559 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9. 12/34 2024-04-25T09:09:21.575 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-04-25T09:09:21.604 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-04-25T09:09:21.614 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 13/34 2024-04-25T09:09:21.629 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-04-25T09:09:21.647 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 14/34 2024-04-25T09:09:21.651 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-25T09:09:21.676 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-25T09:09:21.726 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-04-25T09:09:21.752 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 16/34 2024-04-25T09:09:21.840 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 16/34 2024-04-25T09:09:21.875 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-04-25T09:09:21.880 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-25T09:09:21.910 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-25T09:09:21.987 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-04-25T09:09:22.018 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/34 2024-04-25T09:09:22.058 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-04-25T09:09:22.083 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-04-25T09:09:22.112 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 22/34 2024-04-25T09:09:22.143 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-04-25T09:09:22.180 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-25T09:09:22.279 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-04-25T09:09:22.332 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:09:22.391 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:09:22.434 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9. 12/34 2024-04-25T09:09:22.489 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 13/34 2024-04-25T09:09:22.513 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 14/34 2024-04-25T09:09:22.593 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-04-25T09:09:22.627 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 16/34 2024-04-25T09:09:22.714 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 16/34 2024-04-25T09:09:22.754 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-25T09:09:22.761 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-04-25T09:09:22.783 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 26/34 2024-04-25T09:09:22.846 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 26/34 2024-04-25T09:09:22.869 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-04-25T09:09:22.901 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/34 2024-04-25T09:09:22.924 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 27/34 2024-04-25T09:09:22.941 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-04-25T09:09:22.952 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x8 28/34 2024-04-25T09:09:22.966 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-04-25T09:09:22.996 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 22/34 2024-04-25T09:09:23.026 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-04-25T09:09:23.063 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-25T09:09:23.665 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-25T09:09:23.700 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 26/34 2024-04-25T09:09:23.755 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 26/34 2024-04-25T09:09:23.835 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 27/34 2024-04-25T09:09:23.869 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x8 28/34 2024-04-25T09:09:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:09:25.574 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:09:26.241 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:09:26.278 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 30/34 2024-04-25T09:09:26.366 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 30/34 2024-04-25T09:09:26.366 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T09:09:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T09:09:26.367 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:09:26.395 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:09:26.469 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:09:26.507 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:09:27.208 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:09:27.252 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 30/34 2024-04-25T09:09:27.345 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 30/34 2024-04-25T09:09:27.346 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T09:09:27.346 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T09:09:27.346 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:09:27.396 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:09:36.585 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:09:36.586 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2024-04-25T09:09:36.586 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2024-04-25T09:09:36.586 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2024-04-25T09:09:36.586 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2024-04-25T09:09:36.586 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2024-04-25T09:09:36.586 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2024-04-25T09:09:36.586 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2024-04-25T09:09:36.586 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:09:37.654 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 32/34 2024-04-25T09:09:37.679 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 32/34 2024-04-25T09:09:37.679 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:09:37.679 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T09:09:37.679 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:09:37.679 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:09:37.679 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:09:37.681 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-25T09:09:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:09:37.750 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2024-04-25T09:09:37.750 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2024-04-25T09:09:37.750 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2024-04-25T09:09:37.750 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2024-04-25T09:09:37.750 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2024-04-25T09:09:37.750 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /root 2024-04-25T09:09:37.750 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2024-04-25T09:09:37.750 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:09:37.765 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-25T09:09:37.765 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:09:38.843 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 32/34 2024-04-25T09:09:38.869 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 32/34 2024-04-25T09:09:38.869 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:09:38.869 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T09:09:38.869 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:09:38.869 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:09:38.869 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:09:38.871 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-25T09:09:38.962 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-25T09:09:38.962 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:09:39.067 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:09:39.067 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 1/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 3/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 5/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 6/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 7/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9. 8/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x8 9/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 10/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 12/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 13/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-25T09:09:39.068 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-25T09:09:39.069 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-25T09:09:39.070 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-25T09:09:39.070 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-25T09:09:39.070 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-25T09:09:39.070 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:09:39.071 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-25T09:09:39.071 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 33/34 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.815 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T09:09:39.816 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:09:39.817 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:09:40.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-test 2024-04-25T09:09:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:09:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 1/34 2024-04-25T09:09:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:09:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 3/34 2024-04-25T09:09:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:09:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 5/34 2024-04-25T09:09:40.223 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 6/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 7/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9. 8/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x8 9/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 10/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 12/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 13/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-25T09:09:40.224 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-25T09:09:40.225 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 33/34 2024-04-25T09:09:40.716 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:32 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:09:40.843 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:09:40.844 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:09:40.844 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:19.0.0-3194.ga126334d.el9 ceph 84 M 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:19.0.0-3194.ga126334d.el9 ceph 173 k 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-04-25T09:09:40.845 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:09:40.846 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:09:40.846 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:09:40.846 INFO:teuthology.orchestra.run.smithi151.stdout:Install 9 Packages 2024-04-25T09:09:40.846 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:09:40.846 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 87 M 2024-04-25T09:09:40.846 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 813 M 2024-04-25T09:09:40.846 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:09:40.971 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:09:40.971 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:09:40.971 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2024-04-25T09:09:40.971 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T09:09:40.972 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T09:09:40.973 INFO:teuthology.orchestra.run.smithi053.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T09:09:40.974 INFO:teuthology.orchestra.run.smithi053.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T09:09:40.974 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T09:09:40.974 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:09:40.974 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:09:41.225 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-test 2024-04-25T09:09:41.527 INFO:teuthology.orchestra.run.smithi151.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 396 kB/s | 94 kB 00:00 2024-04-25T09:09:41.578 INFO:teuthology.orchestra.run.smithi151.stdout:(2/9): libcephsqlite-19.0.0-3194.ga126334d.el9. 601 kB/s | 173 kB 00:00 2024-04-25T09:09:41.834 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:31 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:09:41.855 INFO:teuthology.orchestra.run.smithi151.stdout:(3/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 1.4 MB/s | 469 kB 00:00 2024-04-25T09:09:41.906 INFO:teuthology.orchestra.run.smithi151.stdout:(4/9): libubsan-11.4.1-3.el9.x86_64.rpm 570 kB/s | 187 kB 00:00 2024-04-25T09:09:41.959 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:09:41.960 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:19.0.0-3194.ga126334d.el9 ceph 84 M 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:19.0.0-3194.ga126334d.el9 ceph 173 k 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T09:09:41.961 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T09:09:41.962 INFO:teuthology.orchestra.run.smithi053.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-04-25T09:09:41.962 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:09:41.962 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:09:41.962 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:09:41.962 INFO:teuthology.orchestra.run.smithi053.stdout:Install 9 Packages 2024-04-25T09:09:41.962 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:09:41.962 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 87 M 2024-04-25T09:09:41.963 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 813 M 2024-04-25T09:09:41.963 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:09:42.020 INFO:teuthology.orchestra.run.smithi151.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-04-25T09:09:42.091 INFO:teuthology.orchestra.run.smithi151.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 901 kB/s | 64 kB 00:00 2024-04-25T09:09:42.175 INFO:teuthology.orchestra.run.smithi151.stdout:(7/9): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 305 kB 00:00 2024-04-25T09:09:42.298 INFO:teuthology.orchestra.run.smithi151.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 590 kB/s | 122 kB 00:00 2024-04-25T09:09:42.945 INFO:teuthology.orchestra.run.smithi053.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 490 kB/s | 94 kB 00:00 2024-04-25T09:09:43.239 INFO:teuthology.orchestra.run.smithi053.stdout:(2/9): libcephsqlite-19.0.0-3194.ga126334d.el9. 356 kB/s | 173 kB 00:00 2024-04-25T09:09:43.289 INFO:teuthology.orchestra.run.smithi053.stdout:(3/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 1.3 MB/s | 469 kB 00:00 2024-04-25T09:09:43.525 INFO:teuthology.orchestra.run.smithi053.stdout:(4/9): libubsan-11.4.1-3.el9.x86_64.rpm 655 kB/s | 187 kB 00:00 2024-04-25T09:09:43.668 INFO:teuthology.orchestra.run.smithi053.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-04-25T09:09:43.860 INFO:teuthology.orchestra.run.smithi053.stdout:(6/9): socat-1.7.4.1-5.el9.x86_64.rpm 910 kB/s | 305 kB 00:00 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi053.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 295 kB/s | 64 kB 00:00 2024-04-25T09:09:44.094 INFO:teuthology.orchestra.run.smithi053.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 522 kB/s | 122 kB 00:00 2024-04-25T09:09:45.445 INFO:teuthology.orchestra.run.smithi151.stdout:(9/9): ceph-test-19.0.0-3194.ga126334d.el9.x86_ 20 MB/s | 84 MB 00:04 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi151.stdout:Total 19 MB/s | 87 MB 00:04 2024-04-25T09:09:45.526 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:09:45.549 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:09:45.549 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:09:46.143 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:09:46.144 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:09:47.019 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:09:47.085 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-04-25T09:09:47.129 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-04-25T09:09:47.181 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-04-25T09:09:47.217 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-04-25T09:09:47.247 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-25T09:09:47.273 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-25T09:09:47.341 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-25T09:09:47.381 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-04-25T09:09:47.408 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 8/9 2024-04-25T09:09:48.194 INFO:teuthology.orchestra.run.smithi053.stdout:(9/9): ceph-test-19.0.0-3194.ga126334d.el9.x86_ 16 MB/s | 84 MB 00:05 2024-04-25T09:09:48.196 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:09:48.196 INFO:teuthology.orchestra.run.smithi053.stdout:Total 14 MB/s | 87 MB 00:06 2024-04-25T09:09:48.280 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:09:48.305 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:09:48.305 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:09:48.932 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:09:48.932 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:09:50.093 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-04-25T09:09:50.137 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-04-25T09:09:50.182 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-04-25T09:09:50.208 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-04-25T09:09:50.247 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-25T09:09:50.272 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-25T09:09:50.341 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-25T09:09:50.381 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-04-25T09:09:50.407 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 8/9 2024-04-25T09:09:58.689 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 8/9 2024-04-25T09:09:58.763 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 9/9 2024-04-25T09:10:02.343 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 8/9 2024-04-25T09:10:02.441 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 9/9 2024-04-25T09:10:05.156 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 9/9 2024-04-25T09:10:05.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 1/9 2024-04-25T09:10:05.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 2/9 2024-04-25T09:10:05.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-04-25T09:10:05.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-04-25T09:10:05.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-25T09:10:05.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-04-25T09:10:05.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-04-25T09:10:05.156 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-04-25T09:10:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: libubsan-11.4.1-3.el9.x86_64 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:05.555 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:10:05.862 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph 2024-04-25T09:10:06.374 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:58 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:10:06.495 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:10:06.497 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:06.497 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:10:06.497 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:19.0.0-3194.ga126334d.el9 ceph 6.5 k 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:19.0.0-3194.ga126334d.el9 ceph 2.2 M 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:19.0.0-3194.ga126334d.el9 ceph 1.6 M 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 249 k 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.0 M 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 71 M 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T09:10:06.498 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T09:10:06.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:06.500 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:10:06.501 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:06.501 INFO:teuthology.orchestra.run.smithi151.stdout:Install 36 Packages 2024-04-25T09:10:06.501 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:06.501 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 85 M 2024-04-25T09:10:06.501 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 923 M 2024-04-25T09:10:06.501 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:10:07.525 INFO:teuthology.orchestra.run.smithi151.stdout:(1/36): ceph-19.0.0-3194.ga126334d.el9.x86_64.r 36 kB/s | 6.5 kB 00:00 2024-04-25T09:10:07.767 INFO:teuthology.orchestra.run.smithi151.stdout:(2/36): ceph-mds-19.0.0-3194.ga126334d.el9.x86_ 5.1 MB/s | 2.2 MB 00:00 2024-04-25T09:10:07.901 INFO:teuthology.orchestra.run.smithi151.stdout:(3/36): ceph-mgr-19.0.0-3194.ga126334d.el9.x86_ 2.8 MB/s | 1.6 MB 00:00 2024-04-25T09:10:08.001 INFO:teuthology.orchestra.run.smithi151.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3194.ga126 2.4 MB/s | 249 kB 00:00 2024-04-25T09:10:08.326 INFO:teuthology.orchestra.run.smithi151.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 780 kB/s | 253 kB 00:00 2024-04-25T09:10:08.393 INFO:teuthology.orchestra.run.smithi151.stdout:(6/36): ceph-mon-19.0.0-3194.ga126334d.el9.x86_ 5.8 MB/s | 5.0 MB 00:00 2024-04-25T09:10:08.625 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 9/9 2024-04-25T09:10:08.625 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 1/9 2024-04-25T09:10:08.625 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 2/9 2024-04-25T09:10:08.625 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-04-25T09:10:08.625 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-04-25T09:10:08.625 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-25T09:10:08.625 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-04-25T09:10:08.625 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-04-25T09:10:08.625 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-04-25T09:10:08.685 INFO:teuthology.orchestra.run.smithi151.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 365 kB/s | 106 kB 00:00 2024-04-25T09:10:08.902 INFO:teuthology.orchestra.run.smithi151.stdout:(8/36): python3-cryptography-36.0.1-4.el9.x86_6 2.1 MB/s | 1.2 MB 00:00 2024-04-25T09:10:08.956 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: libubsan-11.4.1-3.el9.x86_64 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-04-25T09:10:08.957 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:08.958 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:10:08.960 INFO:teuthology.orchestra.run.smithi151.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 491 kB/s | 135 kB 00:00 2024-04-25T09:10:09.211 INFO:teuthology.orchestra.run.smithi151.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 404 kB/s | 125 kB 00:00 2024-04-25T09:10:09.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph 2024-04-25T09:10:09.278 INFO:teuthology.orchestra.run.smithi151.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 677 kB/s | 215 kB 00:00 2024-04-25T09:10:09.412 INFO:teuthology.orchestra.run.smithi151.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 941 kB/s | 188 kB 00:00 2024-04-25T09:10:09.462 INFO:teuthology.orchestra.run.smithi151.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 695 kB/s | 35 kB 00:00 2024-04-25T09:10:09.487 INFO:teuthology.orchestra.run.smithi151.stdout:(14/36): python3-mako-1.1.4-6.el9.noarch.rpm 824 kB/s | 172 kB 00:00 2024-04-25T09:10:09.512 INFO:teuthology.orchestra.run.smithi151.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T09:10:09.538 INFO:teuthology.orchestra.run.smithi151.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-04-25T09:10:09.596 INFO:teuthology.orchestra.run.smithi151.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-04-25T09:10:09.777 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:00:59 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:10:09.888 INFO:teuthology.orchestra.run.smithi151.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 162 kB/s | 43 kB 00:00 2024-04-25T09:10:09.904 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:19.0.0-3194.ga126334d.el9 ceph 6.5 k 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:19.0.0-3194.ga126334d.el9 ceph 2.2 M 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:19.0.0-3194.ga126334d.el9 ceph 1.6 M 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 249 k 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.0 M 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 71 M 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T09:10:09.907 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T09:10:09.908 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T09:10:09.909 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T09:10:09.910 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T09:10:09.910 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T09:10:09.910 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T09:10:09.910 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T09:10:09.910 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:09.910 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:10:09.910 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:09.910 INFO:teuthology.orchestra.run.smithi053.stdout:Install 36 Packages 2024-04-25T09:10:09.910 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:09.915 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 85 M 2024-04-25T09:10:09.915 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 923 M 2024-04-25T09:10:09.915 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:10:09.930 INFO:teuthology.orchestra.run.smithi151.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 385 kB/s | 151 kB 00:00 2024-04-25T09:10:10.064 INFO:teuthology.orchestra.run.smithi151.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 980 kB/s | 172 kB 00:00 2024-04-25T09:10:10.089 INFO:teuthology.orchestra.run.smithi151.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-04-25T09:10:10.123 INFO:teuthology.orchestra.run.smithi151.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2024-04-25T09:10:10.148 INFO:teuthology.orchestra.run.smithi151.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 300 kB/s | 18 kB 00:00 2024-04-25T09:10:10.190 INFO:teuthology.orchestra.run.smithi151.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 346 kB/s | 23 kB 00:00 2024-04-25T09:10:10.224 INFO:teuthology.orchestra.run.smithi151.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 257 kB/s | 19 kB 00:00 2024-04-25T09:10:10.257 INFO:teuthology.orchestra.run.smithi151.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 294 kB/s | 20 kB 00:00 2024-04-25T09:10:10.299 INFO:teuthology.orchestra.run.smithi151.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 620 kB/s | 46 kB 00:00 2024-04-25T09:10:10.341 INFO:teuthology.orchestra.run.smithi151.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 942 kB/s | 79 kB 00:00 2024-04-25T09:10:10.392 INFO:teuthology.orchestra.run.smithi151.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-25T09:10:10.417 INFO:teuthology.orchestra.run.smithi151.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 217 kB/s | 16 kB 00:00 2024-04-25T09:10:10.557 INFO:teuthology.orchestra.run.smithi053.stdout:(1/36): ceph-19.0.0-3194.ga126334d.el9.x86_64.r 31 kB/s | 6.5 kB 00:00 2024-04-25T09:10:10.757 INFO:teuthology.orchestra.run.smithi053.stdout:(2/36): ceph-mgr-19.0.0-3194.ga126334d.el9.x86_ 3.8 MB/s | 1.6 MB 00:00 2024-04-25T09:10:11.101 INFO:teuthology.orchestra.run.smithi151.stdout:(31/36): ceph-osd-19.0.0-3194.ga126334d.el9.x86 21 MB/s | 71 MB 00:03 2024-04-25T09:10:11.126 INFO:teuthology.orchestra.run.smithi151.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 50 kB/s | 36 kB 00:00 2024-04-25T09:10:11.151 INFO:teuthology.orchestra.run.smithi151.stdout:(33/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 118 kB/s | 90 kB 00:00 2024-04-25T09:10:11.166 INFO:teuthology.orchestra.run.smithi053.stdout:(3/36): ceph-mds-19.0.0-3194.ga126334d.el9.x86_ 2.7 MB/s | 2.2 MB 00:00 2024-04-25T09:10:11.251 INFO:teuthology.orchestra.run.smithi151.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 272 kB/s | 20 kB 00:00 2024-04-25T09:10:11.276 INFO:teuthology.orchestra.run.smithi151.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.8 MB/s | 427 kB 00:00 2024-04-25T09:10:11.535 INFO:teuthology.orchestra.run.smithi151.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 529 kB/s | 230 kB 00:00 2024-04-25T09:10:11.541 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:11.541 INFO:teuthology.orchestra.run.smithi151.stdout:Total 17 MB/s | 85 MB 00:05 2024-04-25T09:10:11.641 INFO:teuthology.orchestra.run.smithi053.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3194.ga126 524 kB/s | 249 kB 00:00 2024-04-25T09:10:11.676 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:10:11.716 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:10:11.716 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:10:11.808 INFO:teuthology.orchestra.run.smithi053.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-04-25T09:10:11.941 INFO:teuthology.orchestra.run.smithi053.stdout:(6/36): ceph-mon-19.0.0-3194.ga126334d.el9.x86_ 3.6 MB/s | 5.0 MB 00:01 2024-04-25T09:10:11.975 INFO:teuthology.orchestra.run.smithi053.stdout:(7/36): python3-cryptography-36.0.1-4.el9.x86_6 7.4 MB/s | 1.2 MB 00:00 2024-04-25T09:10:12.025 INFO:teuthology.orchestra.run.smithi053.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-04-25T09:10:12.076 INFO:teuthology.orchestra.run.smithi053.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.5 MB/s | 125 kB 00:00 2024-04-25T09:10:12.101 INFO:teuthology.orchestra.run.smithi053.stdout:(10/36): python3-ply-3.11-14.el9.noarch.rpm 670 kB/s | 106 kB 00:00 2024-04-25T09:10:12.126 INFO:teuthology.orchestra.run.smithi053.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-04-25T09:10:12.318 INFO:teuthology.orchestra.run.smithi053.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 869 kB/s | 188 kB 00:00 2024-04-25T09:10:12.324 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:10:12.325 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:10:12.377 INFO:teuthology.orchestra.run.smithi053.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 688 kB/s | 172 kB 00:00 2024-04-25T09:10:12.402 INFO:teuthology.orchestra.run.smithi053.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 418 kB/s | 35 kB 00:00 2024-04-25T09:10:12.461 INFO:teuthology.orchestra.run.smithi053.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 718 kB/s | 42 kB 00:00 2024-04-25T09:10:12.486 INFO:teuthology.orchestra.run.smithi053.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 611 kB/s | 51 kB 00:00 2024-04-25T09:10:12.511 INFO:teuthology.orchestra.run.smithi053.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-04-25T09:10:12.812 INFO:teuthology.orchestra.run.smithi053.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 145 kB/s | 43 kB 00:00 2024-04-25T09:10:12.904 INFO:teuthology.orchestra.run.smithi053.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 362 kB/s | 151 kB 00:00 2024-04-25T09:10:12.995 INFO:teuthology.orchestra.run.smithi053.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 936 kB/s | 172 kB 00:00 2024-04-25T09:10:13.062 INFO:teuthology.orchestra.run.smithi053.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-04-25T09:10:13.088 INFO:teuthology.orchestra.run.smithi053.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2024-04-25T09:10:13.138 INFO:teuthology.orchestra.run.smithi053.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2024-04-25T09:10:13.163 INFO:teuthology.orchestra.run.smithi053.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 308 kB/s | 23 kB 00:00 2024-04-25T09:10:13.213 INFO:teuthology.orchestra.run.smithi053.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 259 kB/s | 19 kB 00:00 2024-04-25T09:10:13.239 INFO:teuthology.orchestra.run.smithi053.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 262 kB/s | 20 kB 00:00 2024-04-25T09:10:13.289 INFO:teuthology.orchestra.run.smithi053.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 615 kB/s | 46 kB 00:00 2024-04-25T09:10:13.423 INFO:teuthology.orchestra.run.smithi053.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 429 kB/s | 79 kB 00:00 2024-04-25T09:10:13.448 INFO:teuthology.orchestra.run.smithi053.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-04-25T09:10:13.883 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:10:13.938 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-25T09:10:13.970 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-25T09:10:13.998 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-25T09:10:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-25T09:10:14.123 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-25T09:10:14.127 INFO:teuthology.orchestra.run.smithi053.stdout:(30/36): ceph-osd-19.0.0-3194.ga126334d.el9.x86 21 MB/s | 71 MB 00:03 2024-04-25T09:10:14.148 INFO:teuthology.orchestra.run.smithi053.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 23 kB/s | 16 kB 00:00 2024-04-25T09:10:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-25T09:10:14.182 INFO:teuthology.orchestra.run.smithi053.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 122 kB/s | 90 kB 00:00 2024-04-25T09:10:14.247 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-25T09:10:14.327 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-25T09:10:14.375 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-25T09:10:14.407 INFO:teuthology.orchestra.run.smithi053.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 888 kB/s | 230 kB 00:00 2024-04-25T09:10:14.409 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-25T09:10:14.433 INFO:teuthology.orchestra.run.smithi053.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.9 MB/s | 427 kB 00:00 2024-04-25T09:10:14.439 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-25T09:10:14.465 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-25T09:10:14.483 INFO:teuthology.orchestra.run.smithi053.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 269 kB/s | 20 kB 00:00 2024-04-25T09:10:14.490 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-25T09:10:14.530 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-25T09:10:14.550 INFO:teuthology.orchestra.run.smithi053.stdout:(36/36): python3-tempora-5.0.0-2.el9.noarch.rpm 85 kB/s | 36 kB 00:00 2024-04-25T09:10:14.554 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:14.554 INFO:teuthology.orchestra.run.smithi053.stdout:Total 18 MB/s | 85 MB 00:04 2024-04-25T09:10:14.565 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-25T09:10:14.639 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-25T09:10:14.699 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:10:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-25T09:10:14.744 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:10:14.744 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:10:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-25T09:10:14.930 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-25T09:10:14.982 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-25T09:10:15.078 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-25T09:10:15.133 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-25T09:10:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-25T09:10:15.390 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:10:15.390 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:10:15.609 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-25T09:10:15.678 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-25T09:10:15.768 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-25T09:10:15.808 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-25T09:10:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-25T09:10:16.108 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9. 31/36 2024-04-25T09:10:16.135 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 32/36 2024-04-25T09:10:16.160 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 32/36 2024-04-25T09:10:16.160 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:16.160 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T09:10:16.160 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:10:16.160 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:10:16.161 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:16.992 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:10:17.052 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-25T09:10:17.094 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-25T09:10:17.122 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-25T09:10:17.197 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-25T09:10:17.246 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-25T09:10:17.279 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-25T09:10:17.375 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-25T09:10:17.453 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-25T09:10:17.499 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-25T09:10:17.533 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-25T09:10:17.588 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-25T09:10:17.622 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-25T09:10:17.656 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-25T09:10:17.697 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-25T09:10:17.740 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-25T09:10:17.774 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-25T09:10:17.812 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-25T09:10:17.890 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-25T09:10:18.042 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-25T09:10:18.124 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-25T09:10:18.175 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-25T09:10:18.213 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-25T09:10:18.271 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-25T09:10:18.334 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-25T09:10:18.532 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-25T09:10:18.592 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-25T09:10:18.672 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-25T09:10:18.762 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-25T09:10:18.807 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-25T09:10:18.928 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-25T09:10:19.124 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9. 31/36 2024-04-25T09:10:19.150 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 32/36 2024-04-25T09:10:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 32/36 2024-04-25T09:10:19.177 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:19.177 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T09:10:19.177 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:10:19.177 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:10:19.177 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:26.976 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 33/36 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 33/36 2024-04-25T09:10:27.003 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:27.004 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T09:10:27.004 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:10:27.004 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:10:27.004 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:27.535 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 34/36 2024-04-25T09:10:27.558 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 34/36 2024-04-25T09:10:27.558 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:27.559 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T09:10:27.559 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:10:27.559 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:10:27.559 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:27.794 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 35/36 2024-04-25T09:10:27.816 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 35/36 2024-04-25T09:10:27.816 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:27.816 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T09:10:27.817 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:10:27.817 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:10:27.817 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:27.881 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:19.0.0-3194.ga126334d.el9.x86_64 36/36 2024-04-25T09:10:30.658 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 33/36 2024-04-25T09:10:30.686 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 33/36 2024-04-25T09:10:30.686 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:30.686 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T09:10:30.686 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:10:30.686 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:10:30.686 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:31.251 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 34/36 2024-04-25T09:10:31.275 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 34/36 2024-04-25T09:10:31.275 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:31.275 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T09:10:31.276 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:10:31.276 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:10:31.276 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:31.518 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 35/36 2024-04-25T09:10:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 35/36 2024-04-25T09:10:31.543 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:31.543 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T09:10:31.543 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:10:31.543 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:10:31.543 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:31.608 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:19.0.0-3194.ga126334d.el9.x86_64 36/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-2:19.0.0-3194.ga126334d.el9.x86_64 36/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:19.0.0-3194.ga126334d.el9.x86_64 1/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 2/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 3/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 4/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 5/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9. 6/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-25T09:10:34.779 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-25T09:10:34.780 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-25T09:10:34.782 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-25T09:10:35.712 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-25T09:10:35.712 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T09:10:35.713 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T09:10:35.714 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:35.715 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:10:36.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-base 2024-04-25T09:10:36.568 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:28 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:10:36.651 INFO:teuthology.orchestra.run.smithi151.stdout:Package ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:10:36.695 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:10:36.696 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:10:36.696 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:10:36.768 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install cephadm 2024-04-25T09:10:37.305 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:29 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:10:37.429 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:10:37.430 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:37.430 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:10:37.430 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:37.430 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:10:37.430 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 762 k 2024-04-25T09:10:37.430 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:37.430 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:10:37.430 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:37.431 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-04-25T09:10:37.431 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:37.431 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 762 k 2024-04-25T09:10:37.431 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 769 k 2024-04-25T09:10:37.431 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:10:38.327 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-2:19.0.0-3194.ga126334d.el9.x86_64 36/36 2024-04-25T09:10:38.327 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:19.0.0-3194.ga126334d.el9.x86_64 1/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 2/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 3/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 4/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 5/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9. 6/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-25T09:10:38.328 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-25T09:10:38.329 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-25T09:10:38.331 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-25T09:10:38.910 INFO:teuthology.orchestra.run.smithi151.stdout:cephadm-19.0.0-3194.ga126334d.el9.noarch.rpm 515 kB/s | 762 kB 00:01 2024-04-25T09:10:38.949 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:38.949 INFO:teuthology.orchestra.run.smithi151.stdout:Total 514 kB/s | 762 kB 00:01 2024-04-25T09:10:38.949 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:10:38.949 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:10:38.949 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:10:38.950 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:10:38.950 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:10:38.997 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T09:10:39.365 INFO:teuthology.orchestra.run.smithi053.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T09:10:39.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T09:10:39.367 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T09:10:39.368 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:39.368 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:10:39.389 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:10:39.488 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:10:39.734 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-base 2024-04-25T09:10:39.857 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:10:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:10:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:40.090 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:10:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:40.090 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:40.091 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:10:40.284 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:30 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:10:40.357 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T09:10:40.366 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:10:40.408 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:10:40.409 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:10:40.409 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:10:40.474 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install cephadm 2024-04-25T09:10:40.882 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:32 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:10:41.006 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:10:41.006 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:41.007 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2024-04-25T09:10:41.007 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:41.007 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:10:41.007 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3194.ga126334d.el9 ceph 157 k 2024-04-25T09:10:41.007 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:41.007 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:10:41.007 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:41.007 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-04-25T09:10:41.007 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:41.008 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 157 k 2024-04-25T09:10:41.008 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 640 k 2024-04-25T09:10:41.008 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:10:41.015 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:31 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:10:41.143 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:10:41.144 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:41.144 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:10:41.144 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:41.144 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:10:41.144 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 762 k 2024-04-25T09:10:41.145 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:41.145 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:10:41.145 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:41.145 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-04-25T09:10:41.145 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:41.145 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 762 k 2024-04-25T09:10:41.145 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 769 k 2024-04-25T09:10:41.145 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:10:41.242 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-immutable-object-cache-19.0.0-3194.ga12633 671 kB/s | 157 kB 00:00 2024-04-25T09:10:41.242 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:41.243 INFO:teuthology.orchestra.run.smithi151.stdout:Total 666 kB/s | 157 kB 00:00 2024-04-25T09:10:41.243 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:10:41.252 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:10:41.253 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:10:41.309 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:10:41.309 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:10:41.463 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:10:41.468 INFO:teuthology.orchestra.run.smithi053.stdout:cephadm-19.0.0-3194.ga126334d.el9.noarch.rpm 2.3 MB/s | 762 kB 00:00 2024-04-25T09:10:41.469 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:41.469 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.3 MB/s | 762 kB 00:00 2024-04-25T09:10:41.469 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:10:41.475 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:10:41.475 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:10:41.481 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:10:41.482 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:10:41.554 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:10:41.559 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:10:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:10:41.584 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:41.584 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T09:10:41.584 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:42.154 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:10:42.240 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:10:42.507 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:10:42.507 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:42.507 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:10:42.507 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:42.507 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:42.507 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:10:42.561 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:10:42.726 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr 2024-04-25T09:10:42.785 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:10:42.785 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:42.785 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:10:42.785 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:42.785 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:42.786 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:10:43.031 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T09:10:43.245 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:35 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:10:43.325 INFO:teuthology.orchestra.run.smithi151.stdout:Package ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:10:43.367 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:10:43.369 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:10:43.369 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:10:43.435 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-dashboard 2024-04-25T09:10:43.567 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:33 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:10:43.693 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:10:43.693 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:43.694 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-04-25T09:10:43.694 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:43.694 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:10:43.694 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3194.ga126334d.el9 ceph 157 k 2024-04-25T09:10:43.694 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:43.694 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:10:43.694 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:43.694 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-04-25T09:10:43.694 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:43.695 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 157 k 2024-04-25T09:10:43.695 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 640 k 2024-04-25T09:10:43.695 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:10:43.924 INFO:teuthology.orchestra.run.smithi053.stdout:ceph-immutable-object-cache-19.0.0-3194.ga12633 685 kB/s | 157 kB 00:00 2024-04-25T09:10:43.926 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:43.926 INFO:teuthology.orchestra.run.smithi053.stdout:Total 679 kB/s | 157 kB 00:00 2024-04-25T09:10:43.926 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:10:43.936 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:10:43.937 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:10:43.945 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:35 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:10:43.996 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:10:43.996 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:10:44.068 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:10:44.069 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:44.069 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:10:44.069 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 3.5 M 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 34 k 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 16 k 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T09:10:44.070 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T09:10:44.071 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:44.071 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:10:44.071 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:10:44.071 INFO:teuthology.orchestra.run.smithi151.stdout:Install 11 Packages 2024-04-25T09:10:44.071 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:44.071 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 7.6 M 2024-04-25T09:10:44.071 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 100 M 2024-04-25T09:10:44.071 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:10:44.153 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:10:44.301 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:10:44.328 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:10:44.328 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:10:44.328 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T09:10:44.328 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:45.012 INFO:teuthology.orchestra.run.smithi151.stdout:(1/11): ceph-grafana-dashboards-19.0.0-3194.ga1 125 kB/s | 34 kB 00:00 2024-04-25T09:10:45.038 INFO:teuthology.orchestra.run.smithi151.stdout:(2/11): ceph-prometheus-alerts-19.0.0-3194.ga12 55 kB/s | 16 kB 00:00 2024-04-25T09:10:45.217 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:10:45.217 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:45.217 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:10:45.217 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:10:45.217 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:45.217 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:10:45.246 INFO:teuthology.orchestra.run.smithi151.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 4.0 MB/s | 863 kB 00:00 2024-04-25T09:10:45.305 INFO:teuthology.orchestra.run.smithi151.stdout:(4/11): ceph-mgr-dashboard-19.0.0-3194.ga126334 6.2 MB/s | 3.5 MB 00:00 2024-04-25T09:10:45.330 INFO:teuthology.orchestra.run.smithi151.stdout:(5/11): python3-protobuf-3.14.0-13.el9.noarch.r 848 kB/s | 269 kB 00:00 2024-04-25T09:10:45.405 INFO:teuthology.orchestra.run.smithi151.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-25T09:10:45.440 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr 2024-04-25T09:10:45.531 INFO:teuthology.orchestra.run.smithi151.stdout:(7/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.9 MB/s | 548 kB 00:00 2024-04-25T09:10:45.556 INFO:teuthology.orchestra.run.smithi151.stdout:(8/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 962 kB/s | 144 kB 00:00 2024-04-25T09:10:45.581 INFO:teuthology.orchestra.run.smithi151.stdout:(9/11): python3-repoze-lru-0.7-16.el9.noarch.rp 611 kB/s | 31 kB 00:00 2024-04-25T09:10:45.623 INFO:teuthology.orchestra.run.smithi151.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-04-25T09:10:45.665 INFO:teuthology.orchestra.run.smithi151.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.1 MB/s | 2.0 MB 00:00 2024-04-25T09:10:45.667 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:45.667 INFO:teuthology.orchestra.run.smithi151.stdout:Total 4.8 MB/s | 7.6 MB 00:01 2024-04-25T09:10:45.696 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:10:45.713 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:10:45.713 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:10:45.858 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:10:45.859 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:10:45.971 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:35 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:10:46.052 INFO:teuthology.orchestra.run.smithi053.stdout:Package ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:10:46.096 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:10:46.097 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:10:46.097 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:10:46.164 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-dashboard 2024-04-25T09:10:46.344 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:10:46.438 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-04-25T09:10:46.469 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-04-25T09:10:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-04-25T09:10:46.671 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-04-25T09:10:46.694 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:36 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:10:46.722 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-04-25T09:10:46.805 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-04-25T09:10:46.820 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:10:46.821 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:46.821 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 3.5 M 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 34 k 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 16 k 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T09:10:46.822 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T09:10:46.823 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:46.823 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:10:46.823 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:10:46.823 INFO:teuthology.orchestra.run.smithi053.stdout:Install 11 Packages 2024-04-25T09:10:46.823 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:46.824 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 7.6 M 2024-04-25T09:10:46.824 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 100 M 2024-04-25T09:10:46.824 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:10:46.849 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-04-25T09:10:46.877 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-04-25T09:10:46.909 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9 9/11 2024-04-25T09:10:47.787 INFO:teuthology.orchestra.run.smithi053.stdout:(1/11): ceph-prometheus-alerts-19.0.0-3194.ga12 83 kB/s | 16 kB 00:00 2024-04-25T09:10:47.812 INFO:teuthology.orchestra.run.smithi053.stdout:(2/11): ceph-grafana-dashboards-19.0.0-3194.ga1 152 kB/s | 34 kB 00:00 2024-04-25T09:10:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el 10/11 2024-04-25T09:10:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 11/11 2024-04-25T09:10:48.029 INFO:teuthology.orchestra.run.smithi053.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-04-25T09:10:48.104 INFO:teuthology.orchestra.run.smithi053.stdout:(4/11): ceph-mgr-dashboard-19.0.0-3194.ga126334 6.9 MB/s | 3.5 MB 00:00 2024-04-25T09:10:48.130 INFO:teuthology.orchestra.run.smithi053.stdout:(5/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.7 MB/s | 863 kB 00:00 2024-04-25T09:10:48.330 INFO:teuthology.orchestra.run.smithi053.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 86 kB/s | 19 kB 00:00 2024-04-25T09:10:48.364 INFO:teuthology.orchestra.run.smithi053.stdout:(7/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.6 MB/s | 548 kB 00:00 2024-04-25T09:10:48.389 INFO:teuthology.orchestra.run.smithi053.stdout:(8/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-04-25T09:10:48.414 INFO:teuthology.orchestra.run.smithi053.stdout:(9/11): python3-repoze-lru-0.7-16.el9.noarch.rp 623 kB/s | 31 kB 00:00 2024-04-25T09:10:48.439 INFO:teuthology.orchestra.run.smithi053.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T09:10:48.506 INFO:teuthology.orchestra.run.smithi053.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.3 MB/s | 2.0 MB 00:00 2024-04-25T09:10:48.511 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:48.511 INFO:teuthology.orchestra.run.smithi053.stdout:Total 4.5 MB/s | 7.6 MB 00:01 2024-04-25T09:10:48.542 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:10:48.560 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:10:48.561 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:10:48.716 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:10:48.718 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:10:49.207 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:10:49.290 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-04-25T09:10:49.326 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-04-25T09:10:49.330 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 11/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el 1/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 2/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9 3/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-04-25T09:10:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-04-25T09:10:49.408 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-04-25T09:10:49.542 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-04-25T09:10:49.597 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-04-25T09:10:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-04-25T09:10:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:49.606 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:10:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T09:10:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T09:10:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T09:10:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T09:10:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T09:10:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T09:10:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T09:10:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T09:10:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:49.608 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:10:49.684 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-04-25T09:10:49.741 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-04-25T09:10:49.768 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-04-25T09:10:49.801 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9 9/11 2024-04-25T09:10:49.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-25T09:10:50.373 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:42 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:10:50.496 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 7.4 M 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T09:10:50.498 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout:Install 12 Packages 2024-04-25T09:10:50.499 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:10:50.500 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 38 M 2024-04-25T09:10:50.500 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 209 M 2024-04-25T09:10:50.500 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:10:50.908 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el 10/11 2024-04-25T09:10:50.924 INFO:teuthology.orchestra.run.smithi151.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-25T09:10:50.951 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 11/11 2024-04-25T09:10:51.074 INFO:teuthology.orchestra.run.smithi151.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-04-25T09:10:51.099 INFO:teuthology.orchestra.run.smithi151.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 187 kB/s | 33 kB 00:00 2024-04-25T09:10:51.241 INFO:teuthology.orchestra.run.smithi151.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 128 kB/s | 18 kB 00:00 2024-04-25T09:10:51.358 INFO:teuthology.orchestra.run.smithi151.stdout:(5/12): ceph-mgr-diskprediction-local-19.0.0-31 12 MB/s | 7.4 MB 00:00 2024-04-25T09:10:51.467 INFO:teuthology.orchestra.run.smithi151.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 156 kB/s | 35 kB 00:00 2024-04-25T09:10:51.742 INFO:teuthology.orchestra.run.smithi151.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.5 MB/s | 3.0 MB 00:00 2024-04-25T09:10:51.900 INFO:teuthology.orchestra.run.smithi151.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 563 kB/s | 244 kB 00:00 2024-04-25T09:10:52.276 INFO:teuthology.orchestra.run.smithi151.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 669 kB/s | 250 kB 00:00 2024-04-25T09:10:52.315 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 11/11 2024-04-25T09:10:52.315 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el 1/11 2024-04-25T09:10:52.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 2/11 2024-04-25T09:10:52.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9 3/11 2024-04-25T09:10:52.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-04-25T09:10:52.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-04-25T09:10:52.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-04-25T09:10:52.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-04-25T09:10:52.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-04-25T09:10:52.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-04-25T09:10:52.316 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi151.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.8 MB/s | 4.7 MB 00:00 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T09:10:52.608 INFO:teuthology.orchestra.run.smithi053.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T09:10:52.609 INFO:teuthology.orchestra.run.smithi053.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T09:10:52.609 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T09:10:52.609 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T09:10:52.609 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:52.609 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:10:52.618 INFO:teuthology.orchestra.run.smithi151.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.8 MB/s | 5.1 MB 00:00 2024-04-25T09:10:52.838 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-25T09:10:53.373 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:43 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:10:53.498 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:10:53.499 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-04-25T09:10:53.499 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:10:53.499 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 7.4 M 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T09:10:53.500 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T09:10:53.501 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:53.501 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:10:53.501 INFO:teuthology.orchestra.run.smithi053.stdout:======================================================================================= 2024-04-25T09:10:53.501 INFO:teuthology.orchestra.run.smithi053.stdout:Install 12 Packages 2024-04-25T09:10:53.501 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:10:53.501 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 38 M 2024-04-25T09:10:53.502 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 209 M 2024-04-25T09:10:53.502 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:10:54.072 INFO:teuthology.orchestra.run.smithi053.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-04-25T09:10:54.122 INFO:teuthology.orchestra.run.smithi053.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-04-25T09:10:54.172 INFO:teuthology.orchestra.run.smithi053.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-04-25T09:10:54.223 INFO:teuthology.orchestra.run.smithi053.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-04-25T09:10:54.273 INFO:teuthology.orchestra.run.smithi053.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 707 kB/s | 35 kB 00:00 2024-04-25T09:10:54.590 INFO:teuthology.orchestra.run.smithi053.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-31 11 MB/s | 7.4 MB 00:00 2024-04-25T09:10:54.649 INFO:teuthology.orchestra.run.smithi053.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.7 MB/s | 3.0 MB 00:00 2024-04-25T09:10:54.790 INFO:teuthology.orchestra.run.smithi053.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2024-04-25T09:10:54.841 INFO:teuthology.orchestra.run.smithi053.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-04-25T09:10:54.958 INFO:teuthology.orchestra.run.smithi053.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 6.9 MB/s | 4.7 MB 00:00 2024-04-25T09:10:54.968 INFO:teuthology.orchestra.run.smithi151.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.0 MB/s | 16 MB 00:02 2024-04-25T09:10:54.969 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:54.970 INFO:teuthology.orchestra.run.smithi151.stdout:Total 8.5 MB/s | 38 MB 00:04 2024-04-25T09:10:55.183 INFO:teuthology.orchestra.run.smithi053.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.5 MB/s | 5.1 MB 00:00 2024-04-25T09:10:55.324 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:10:55.350 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:10:55.350 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:10:55.475 INFO:teuthology.orchestra.run.smithi053.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-04-25T09:10:55.476 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:10:55.476 INFO:teuthology.orchestra.run.smithi053.stdout:Total 19 MB/s | 38 MB 00:01 2024-04-25T09:10:55.756 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:10:55.756 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:10:55.834 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:10:55.861 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:10:55.861 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:10:56.298 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:10:56.298 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:10:56.561 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:10:56.622 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-25T09:10:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-25T09:10:56.765 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-25T09:10:56.801 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-25T09:10:56.978 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-25T09:10:57.007 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-25T09:10:57.085 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-25T09:10:57.141 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:10:57.213 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-25T09:10:57.257 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-25T09:10:57.364 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-25T09:10:57.408 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-25T09:10:57.593 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-25T09:10:57.638 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-25T09:10:57.719 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-25T09:10:57.721 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-25T09:10:57.837 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-25T09:10:58.420 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-25T09:10:58.550 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-25T09:10:59.074 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T09:10:59.873 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T09:11:00.110 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-25T09:11:00.139 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 12/12 2024-04-25T09:11:00.951 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-25T09:11:00.972 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 12/12 2024-04-25T09:11:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 12/12 2024-04-25T09:11:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 1/12 2024-04-25T09:11:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-25T09:11:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-25T09:11:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-25T09:11:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-25T09:11:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-25T09:11:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-25T09:11:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-25T09:11:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-25T09:11:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T09:11:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-25T09:11:03.080 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-25T09:11:03.080 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:03.081 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:03.402 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 12/12 2024-04-25T09:11:03.402 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 1/12 2024-04-25T09:11:03.402 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-25T09:11:03.402 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-25T09:11:03.402 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-25T09:11:03.402 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-25T09:11:03.402 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-25T09:11:03.402 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-25T09:11:03.403 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-25T09:11:03.403 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-25T09:11:03.403 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T09:11:03.403 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-25T09:11:03.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-rook 2024-04-25T09:11:03.834 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T09:11:03.835 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T09:11:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T09:11:03.836 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:03.836 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:56 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:04.115 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 49 k 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T09:11:04.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout:Install 13 Packages 2024-04-25T09:11:04.117 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:04.118 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 2.2 M 2024-04-25T09:11:04.118 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 26 M 2024-04-25T09:11:04.118 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:11:04.207 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-rook 2024-04-25T09:11:04.738 INFO:teuthology.orchestra.run.smithi151.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 213 kB/s | 26 kB 00:00 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:54 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:04.755 INFO:teuthology.orchestra.run.smithi151.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 140 kB/s | 19 kB 00:00 2024-04-25T09:11:04.780 INFO:teuthology.orchestra.run.smithi151.stdout:(3/13): ceph-mgr-rook-19.0.0-3194.ga126334d.el9 303 kB/s | 49 kB 00:00 2024-04-25T09:11:04.847 INFO:teuthology.orchestra.run.smithi151.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.4 MB/s | 222 kB 00:00 2024-04-25T09:11:04.868 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 49 k 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T09:11:04.870 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout:Install 13 Packages 2024-04-25T09:11:04.871 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:04.872 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 2.2 M 2024-04-25T09:11:04.872 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 26 M 2024-04-25T09:11:04.872 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:11:04.872 INFO:teuthology.orchestra.run.smithi151.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-04-25T09:11:04.889 INFO:teuthology.orchestra.run.smithi151.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.2 MB/s | 54 kB 00:00 2024-04-25T09:11:05.006 INFO:teuthology.orchestra.run.smithi151.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-04-25T09:11:05.148 INFO:teuthology.orchestra.run.smithi151.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 58 kB/s | 15 kB 00:00 2024-04-25T09:11:05.173 INFO:teuthology.orchestra.run.smithi151.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 107 kB/s | 32 kB 00:00 2024-04-25T09:11:05.299 INFO:teuthology.orchestra.run.smithi151.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 474 kB/s | 59 kB 00:00 2024-04-25T09:11:05.399 INFO:teuthology.orchestra.run.smithi151.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 896 kB/s | 90 kB 00:00 2024-04-25T09:11:05.432 INFO:teuthology.orchestra.run.smithi151.stdout:(12/13): python3-google-auth-2.29.0-1.el9.noarc 483 kB/s | 206 kB 00:00 2024-04-25T09:11:05.439 INFO:teuthology.orchestra.run.smithi053.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 218 kB/s | 26 kB 00:00 2024-04-25T09:11:05.465 INFO:teuthology.orchestra.run.smithi053.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 134 kB/s | 19 kB 00:00 2024-04-25T09:11:05.498 INFO:teuthology.orchestra.run.smithi053.stdout:(3/13): ceph-mgr-rook-19.0.0-3194.ga126334d.el9 279 kB/s | 49 kB 00:00 2024-04-25T09:11:05.536 INFO:teuthology.orchestra.run.smithi151.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.6 MB/s | 1.0 MB 00:00 2024-04-25T09:11:05.538 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:05.538 INFO:teuthology.orchestra.run.smithi151.stdout:Total 1.5 MB/s | 2.2 MB 00:01 2024-04-25T09:11:05.549 INFO:teuthology.orchestra.run.smithi053.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-04-25T09:11:05.574 INFO:teuthology.orchestra.run.smithi053.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-04-25T09:11:05.599 INFO:teuthology.orchestra.run.smithi053.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-04-25T09:11:05.601 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:11:05.616 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:11:05.616 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:11:05.641 INFO:teuthology.orchestra.run.smithi053.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.9 MB/s | 279 kB 00:00 2024-04-25T09:11:05.698 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:11:05.700 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:11:05.709 INFO:teuthology.orchestra.run.smithi053.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 138 kB/s | 15 kB 00:00 2024-04-25T09:11:05.733 INFO:teuthology.orchestra.run.smithi053.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 202 kB/s | 32 kB 00:00 2024-04-25T09:11:05.809 INFO:teuthology.orchestra.run.smithi053.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 1.2 MB/s | 206 kB 00:00 2024-04-25T09:11:05.834 INFO:teuthology.orchestra.run.smithi053.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 590 kB/s | 59 kB 00:00 2024-04-25T09:11:05.876 INFO:teuthology.orchestra.run.smithi053.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-04-25T09:11:05.951 INFO:teuthology.orchestra.run.smithi053.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.2 MB/s | 1.0 MB 00:00 2024-04-25T09:11:05.951 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:05.952 INFO:teuthology.orchestra.run.smithi053.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-04-25T09:11:06.018 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:11:06.034 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:11:06.034 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:11:06.126 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:11:06.126 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:11:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:11:06.370 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-25T09:11:06.425 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-25T09:11:06.480 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-25T09:11:06.518 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-25T09:11:06.559 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-25T09:11:06.652 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-25T09:11:06.653 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:11:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-25T09:11:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-25T09:11:06.823 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-25T09:11:06.887 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-25T09:11:06.944 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-25T09:11:06.987 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-25T09:11:07.029 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-25T09:11:07.126 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-25T09:11:07.237 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-25T09:11:07.289 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-25T09:11:07.530 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-25T09:11:07.583 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-25T09:11:07.617 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-25T09:11:07.665 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-25T09:11:07.686 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 13/13 2024-04-25T09:11:08.056 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-25T09:11:08.104 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-25T09:11:08.138 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-25T09:11:08.187 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-25T09:11:08.216 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 13/13 2024-04-25T09:11:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 13/13 2024-04-25T09:11:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 1/13 2024-04-25T09:11:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-25T09:11:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-25T09:11:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-25T09:11:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-25T09:11:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-25T09:11:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-25T09:11:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-25T09:11:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-25T09:11:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-25T09:11:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-25T09:11:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T09:11:08.697 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T09:11:08.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T09:11:08.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T09:11:08.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T09:11:08.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T09:11:08.698 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:08.698 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:08.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-mgr-cephadm 2024-04-25T09:11:09.034 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 13/13 2024-04-25T09:11:09.034 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 1/13 2024-04-25T09:11:09.034 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-25T09:11:09.034 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-25T09:11:09.035 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-25T09:11:09.035 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-25T09:11:09.035 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-25T09:11:09.035 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-25T09:11:09.035 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-25T09:11:09.035 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-25T09:11:09.035 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-25T09:11:09.035 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-25T09:11:09.035 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T09:11:09.365 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T09:11:09.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T09:11:09.366 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T09:11:09.366 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:09.366 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:09.509 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:01 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:09.605 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-mgr-cephadm 2024-04-25T09:11:09.635 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:09.635 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 142 k 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:11:09.636 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:09.637 INFO:teuthology.orchestra.run.smithi151.stdout:Install 6 Packages 2024-04-25T09:11:09.637 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:09.637 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 7.0 M 2024-04-25T09:11:09.637 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 33 M 2024-04-25T09:11:09.637 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:11:10.043 INFO:teuthology.orchestra.run.smithi151.stdout:(1/6): ceph-mgr-cephadm-19.0.0-3194.ga126334d.e 678 kB/s | 142 kB 00:00 2024-04-25T09:11:10.093 INFO:teuthology.orchestra.run.smithi151.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 954 kB/s | 248 kB 00:00 2024-04-25T09:11:10.140 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:00 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:10.264 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:10.265 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:10.265 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:11:10.265 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:10.265 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:11:10.265 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 142 k 2024-04-25T09:11:10.265 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-04-25T09:11:10.265 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T09:11:10.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T09:11:10.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T09:11:10.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T09:11:10.266 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T09:11:10.266 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:10.266 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:11:10.266 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:10.266 INFO:teuthology.orchestra.run.smithi053.stdout:Install 6 Packages 2024-04-25T09:11:10.266 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:10.267 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 7.0 M 2024-04-25T09:11:10.267 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 33 M 2024-04-25T09:11:10.267 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:11:10.418 INFO:teuthology.orchestra.run.smithi151.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-04-25T09:11:10.502 INFO:teuthology.orchestra.run.smithi151.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 150 kB/s | 58 kB 00:00 2024-04-25T09:11:10.702 INFO:teuthology.orchestra.run.smithi151.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 832 kB/s | 548 kB 00:00 2024-04-25T09:11:10.861 INFO:teuthology.orchestra.run.smithi151.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 115 kB/s | 51 kB 00:00 2024-04-25T09:11:10.863 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:10.863 INFO:teuthology.orchestra.run.smithi151.stdout:Total 5.7 MB/s | 7.0 MB 00:01 2024-04-25T09:11:10.933 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:11:10.945 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:11:10.945 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:11:10.972 INFO:teuthology.orchestra.run.smithi053.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 657 kB/s | 248 kB 00:00 2024-04-25T09:11:10.997 INFO:teuthology.orchestra.run.smithi053.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3194.ga126334d.e 353 kB/s | 142 kB 00:00 2024-04-25T09:11:11.041 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:11:11.043 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:11:11.297 INFO:teuthology.orchestra.run.smithi053.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 192 kB/s | 58 kB 00:00 2024-04-25T09:11:11.355 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:11:11.456 INFO:teuthology.orchestra.run.smithi053.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 322 kB/s | 51 kB 00:00 2024-04-25T09:11:11.489 INFO:teuthology.orchestra.run.smithi053.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2024-04-25T09:11:11.523 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-25T09:11:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-25T09:11:11.931 INFO:teuthology.orchestra.run.smithi053.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.5 MB/s | 6.0 MB 00:01 2024-04-25T09:11:11.934 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:11.935 INFO:teuthology.orchestra.run.smithi053.stdout:Total 4.2 MB/s | 7.0 MB 00:01 2024-04-25T09:11:12.010 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:11:12.023 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:11:12.023 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:11:12.092 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-25T09:11:12.127 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:11:12.128 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:11:12.181 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-25T09:11:12.244 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-25T09:11:12.274 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 6/6 2024-04-25T09:11:12.437 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:11:12.623 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-25T09:11:12.676 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-25T09:11:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 6/6 2024-04-25T09:11:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/6 2024-04-25T09:11:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-25T09:11:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-25T09:11:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-25T09:11:13.041 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-25T09:11:13.234 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-25T09:11:13.294 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-25T09:11:13.294 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:13.294 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:13.294 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:11:13.294 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T09:11:13.295 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T09:11:13.295 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T09:11:13.295 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T09:11:13.295 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T09:11:13.295 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:13.295 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:13.322 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-25T09:11:13.393 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-25T09:11:13.420 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 6/6 2024-04-25T09:11:13.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-fuse 2024-04-25T09:11:14.072 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:06 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:14.192 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:14.192 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:11:14.192 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:14.193 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:11:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 870 k 2024-04-25T09:11:14.193 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-04-25T09:11:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T09:11:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:14.193 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:11:14.193 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:14.193 INFO:teuthology.orchestra.run.smithi151.stdout:Install 2 Packages 2024-04-25T09:11:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:14.194 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 950 k 2024-04-25T09:11:14.194 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 4.0 M 2024-04-25T09:11:14.194 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:11:14.205 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 6/6 2024-04-25T09:11:14.205 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/6 2024-04-25T09:11:14.205 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-25T09:11:14.206 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-25T09:11:14.206 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-25T09:11:14.206 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:14.464 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:14.470 INFO:teuthology.orchestra.run.smithi151.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 384 kB/s | 80 kB 00:00 2024-04-25T09:11:14.715 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-fuse 2024-04-25T09:11:14.770 INFO:teuthology.orchestra.run.smithi151.stdout:(2/2): ceph-fuse-19.0.0-3194.ga126334d.el9.x86_ 1.7 MB/s | 870 kB 00:00 2024-04-25T09:11:14.771 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:14.771 INFO:teuthology.orchestra.run.smithi151.stdout:Total 1.6 MB/s | 950 kB 00:00 2024-04-25T09:11:14.782 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:11:14.806 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:11:14.806 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:11:14.885 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:11:14.885 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:11:15.074 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:11:15.227 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-25T09:11:15.252 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:05 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:15.293 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2/2 2024-04-25T09:11:15.377 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:15.378 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:15.378 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:11:15.378 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:15.378 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:11:15.378 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 870 k 2024-04-25T09:11:15.379 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-04-25T09:11:15.379 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T09:11:15.379 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:15.379 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:11:15.379 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:15.379 INFO:teuthology.orchestra.run.smithi053.stdout:Install 2 Packages 2024-04-25T09:11:15.379 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:15.379 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 950 k 2024-04-25T09:11:15.380 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 4.0 M 2024-04-25T09:11:15.380 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:11:15.801 INFO:teuthology.orchestra.run.smithi053.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 622 kB/s | 80 kB 00:00 2024-04-25T09:11:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2/2 2024-04-25T09:11:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/2 2024-04-25T09:11:16.153 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-25T09:11:16.153 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:16.153 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:16.153 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-25T09:11:16.153 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:16.154 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:16.326 INFO:teuthology.orchestra.run.smithi053.stdout:(2/2): ceph-fuse-19.0.0-3194.ga126334d.el9.x86_ 1.3 MB/s | 870 kB 00:00 2024-04-25T09:11:16.327 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:16.327 INFO:teuthology.orchestra.run.smithi053.stdout:Total 1.0 MB/s | 950 kB 00:00 2024-04-25T09:11:16.339 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:11:16.366 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:11:16.366 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:11:16.422 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-volume 2024-04-25T09:11:16.451 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:11:16.452 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:11:16.645 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:11:16.800 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-25T09:11:16.869 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2/2 2024-04-25T09:11:16.943 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:08 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:17.065 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 273 k 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout:Install 2 Packages 2024-04-25T09:11:17.066 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:17.067 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 350 k 2024-04-25T09:11:17.067 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 1.5 M 2024-04-25T09:11:17.067 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:11:17.299 INFO:teuthology.orchestra.run.smithi151.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 509 kB/s | 77 kB 00:00 2024-04-25T09:11:17.408 INFO:teuthology.orchestra.run.smithi151.stdout:(2/2): ceph-volume-19.0.0-3194.ga126334d.el9.no 1.0 MB/s | 273 kB 00:00 2024-04-25T09:11:17.409 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:17.409 INFO:teuthology.orchestra.run.smithi151.stdout:Total 1.0 MB/s | 350 kB 00:00 2024-04-25T09:11:17.420 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:11:17.430 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:11:17.430 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:11:17.456 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:11:17.456 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:11:17.539 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2/2 2024-04-25T09:11:17.539 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/2 2024-04-25T09:11:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:11:17.765 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-25T09:11:17.794 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2/2 2024-04-25T09:11:17.809 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2/2 2024-04-25T09:11:17.809 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:11:17.809 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T09:11:17.810 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-25T09:11:17.822 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:17.822 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:17.822 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-25T09:11:17.822 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:17.822 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:18.072 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-volume 2024-04-25T09:11:18.471 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 1/2 2024-04-25T09:11:18.609 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:08 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:18.735 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:18.735 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2024-04-25T09:11:18.735 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:18.735 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:11:18.735 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 273 k 2024-04-25T09:11:18.736 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2024-04-25T09:11:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T09:11:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:18.736 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:11:18.736 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:18.736 INFO:teuthology.orchestra.run.smithi053.stdout:Install 2 Packages 2024-04-25T09:11:18.736 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:18.736 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 350 k 2024-04-25T09:11:18.737 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 1.5 M 2024-04-25T09:11:18.737 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:11:18.754 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-25T09:11:18.754 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:18.754 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:18.754 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:11:18.754 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T09:11:18.754 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:18.754 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:19.046 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install librados-devel 2024-04-25T09:11:19.232 INFO:teuthology.orchestra.run.smithi053.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 353 kB/s | 77 kB 00:00 2024-04-25T09:11:19.265 INFO:teuthology.orchestra.run.smithi053.stdout:(2/2): ceph-volume-19.0.0-3194.ga126334d.el9.no 1.1 MB/s | 273 kB 00:00 2024-04-25T09:11:19.266 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:19.266 INFO:teuthology.orchestra.run.smithi053.stdout:Total 661 kB/s | 350 kB 00:00 2024-04-25T09:11:19.278 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:11:19.289 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:11:19.289 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:11:19.316 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:11:19.317 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:11:19.461 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:11:19.575 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:11 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:19.646 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-25T09:11:19.676 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2/2 2024-04-25T09:11:19.692 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2/2 2024-04-25T09:11:19.692 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:11:19.692 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T09:11:19.692 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:19.702 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2024-04-25T09:11:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:11:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:19.0.0-3194.ga126334d.el9 ceph 125 k 2024-04-25T09:11:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:11:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:19.703 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-04-25T09:11:19.703 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 125 k 2024-04-25T09:11:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 445 k 2024-04-25T09:11:19.704 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:11:19.939 INFO:teuthology.orchestra.run.smithi151.stdout:librados-devel-19.0.0-3194.ga126334d.el9.x86_64 554 kB/s | 125 kB 00:00 2024-04-25T09:11:19.939 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:19.939 INFO:teuthology.orchestra.run.smithi151.stdout:Total 549 kB/s | 125 kB 00:00 2024-04-25T09:11:19.939 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:11:19.939 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:11:19.939 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:11:20.005 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:11:20.005 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:11:20.165 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:11:20.251 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:20.371 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 1/2 2024-04-25T09:11:20.621 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-25T09:11:20.621 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:20.621 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:20.621 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:11:20.622 INFO:teuthology.orchestra.run.smithi053.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T09:11:20.622 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:20.622 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:20.684 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:20.888 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados-devel 2024-04-25T09:11:20.945 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:20.945 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:20.945 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:20.945 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:20.945 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:20.945 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:21.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install libcephfs2 2024-04-25T09:11:21.438 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:11 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:21.562 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:21.563 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:21.563 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-04-25T09:11:21.563 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:21.563 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:11:21.563 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:19.0.0-3194.ga126334d.el9 ceph 125 k 2024-04-25T09:11:21.563 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:21.563 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:11:21.563 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:21.564 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-04-25T09:11:21.564 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:21.564 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 125 k 2024-04-25T09:11:21.564 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 445 k 2024-04-25T09:11:21.564 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:11:21.707 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:13 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:21.788 INFO:teuthology.orchestra.run.smithi151.stdout:Package libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:21.804 INFO:teuthology.orchestra.run.smithi053.stdout:librados-devel-19.0.0-3194.ga126334d.el9.x86_64 520 kB/s | 125 kB 00:00 2024-04-25T09:11:21.805 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:21.805 INFO:teuthology.orchestra.run.smithi053.stdout:Total 517 kB/s | 125 kB 00:00 2024-04-25T09:11:21.805 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:11:21.811 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:11:21.811 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:11:21.830 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:21.831 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:11:21.831 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:21.884 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:11:21.884 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:11:21.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install libcephfs-devel 2024-04-25T09:11:22.049 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:11:22.153 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:22.427 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:14 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:22.548 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:22.548 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:22.548 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2024-04-25T09:11:22.548 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:22.549 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:11:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:19.0.0-3194.ga126334d.el9 ceph 32 k 2024-04-25T09:11:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:22.549 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:11:22.549 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:22.549 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-04-25T09:11:22.549 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:22.549 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:22.550 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 32 k 2024-04-25T09:11:22.550 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 142 k 2024-04-25T09:11:22.550 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:11:22.741 INFO:teuthology.orchestra.run.smithi151.stdout:libcephfs-devel-19.0.0-3194.ga126334d.el9.x86_6 165 kB/s | 32 kB 00:00 2024-04-25T09:11:22.741 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:22.742 INFO:teuthology.orchestra.run.smithi151.stdout:Total 164 kB/s | 32 kB 00:00 2024-04-25T09:11:22.742 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:11:22.745 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:11:22.746 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:11:22.748 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:11:22.748 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:11:22.795 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:22.795 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:22.795 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:22.795 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:22.796 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:22.796 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:22.831 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:23.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs2 2024-04-25T09:11:23.275 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:23.483 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:23.483 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:23.483 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:23.484 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:23.484 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:23.484 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:23.564 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:13 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:23.646 INFO:teuthology.orchestra.run.smithi053.stdout:Package libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:23.664 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install librados2 2024-04-25T09:11:23.690 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:23.691 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:11:23.691 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:23.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install libcephfs-devel 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:16 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:24.257 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:24.298 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:24.299 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:11:24.299 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:24.310 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:14 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:24.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install librbd1 2024-04-25T09:11:24.435 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:24.436 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:24.436 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-04-25T09:11:24.436 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:24.436 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:11:24.437 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:19.0.0-3194.ga126334d.el9 ceph 32 k 2024-04-25T09:11:24.437 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:24.437 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:11:24.437 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:24.437 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-04-25T09:11:24.437 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:24.438 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 32 k 2024-04-25T09:11:24.438 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 142 k 2024-04-25T09:11:24.438 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:11:24.600 INFO:teuthology.orchestra.run.smithi053.stdout:libcephfs-devel-19.0.0-3194.ga126334d.el9.x86_6 193 kB/s | 32 kB 00:00 2024-04-25T09:11:24.601 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:24.601 INFO:teuthology.orchestra.run.smithi053.stdout:Total 192 kB/s | 32 kB 00:00 2024-04-25T09:11:24.601 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:11:24.604 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:11:24.604 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:11:24.607 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:11:24.607 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:11:24.696 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:11:24.798 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:24.874 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:16 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:24.952 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:24.994 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:24.996 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:11:24.996 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:25.060 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-rados 2024-04-25T09:11:25.142 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:25.344 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:25.345 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:25.345 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:25.345 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:25.345 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:25.345 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:25.507 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librados2 2024-04-25T09:11:25.572 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:17 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:25.650 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:25.693 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:11:25.693 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:25.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-rgw 2024-04-25T09:11:26.047 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:16 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:26.128 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:26.172 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:26.173 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:11:26.173 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:26.242 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install librbd1 2024-04-25T09:11:26.279 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:18 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:26.359 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:26.401 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:26.402 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:11:26.402 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:26.462 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-cephfs 2024-04-25T09:11:26.777 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:16 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:26.859 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:26.904 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:26.905 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:11:26.905 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:18 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:26.985 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rados 2024-04-25T09:11:27.053 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:27.094 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:27.095 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:11:27.096 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:27.159 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install python3-rbd 2024-04-25T09:11:27.526 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:17 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:27.607 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:27.651 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:27.652 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:11:27.652 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:27.676 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:19 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:27.716 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rgw 2024-04-25T09:11:27.754 INFO:teuthology.orchestra.run.smithi151.stdout:Package python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:27.796 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:27.797 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2024-04-25T09:11:27.797 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:27.863 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install rbd-fuse 2024-04-25T09:11:28.251 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:18 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:28.331 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:28.375 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:28.376 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:11:28.376 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:28.378 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:20 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:28.434 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-cephfs 2024-04-25T09:11:28.498 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 90 k 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-04-25T09:11:28.499 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:28.500 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 90 k 2024-04-25T09:11:28.500 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 313 k 2024-04-25T09:11:28.500 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:11:28.736 INFO:teuthology.orchestra.run.smithi151.stdout:rbd-fuse-19.0.0-3194.ga126334d.el9.x86_64.rpm 381 kB/s | 90 kB 00:00 2024-04-25T09:11:28.736 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:28.736 INFO:teuthology.orchestra.run.smithi151.stdout:Total 379 kB/s | 90 kB 00:00 2024-04-25T09:11:28.737 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:11:28.745 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:11:28.746 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:11:28.807 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:11:28.807 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:11:28.954 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:11:28.978 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:18 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:29.057 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:29.059 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:29.102 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:29.103 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:11:29.103 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:29.175 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install python3-rbd 2024-04-25T09:11:29.412 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:29.664 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:29.664 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:29.664 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:29.664 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:29.664 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:29.664 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:29.710 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:19 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:29.790 INFO:teuthology.orchestra.run.smithi053.stdout:Package python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:11:29.834 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:29.835 INFO:teuthology.orchestra.run.smithi053.stdout:Nothing to do. 2024-04-25T09:11:29.835 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:29.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-fuse 2024-04-25T09:11:29.903 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install rbd-mirror 2024-04-25T09:11:30.430 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:22 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:30.435 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:20 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:30.552 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:30.552 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:30.552 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repo Size 2024-04-25T09:11:30.552 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:30.552 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:11:30.553 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.4 M 2024-04-25T09:11:30.553 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:30.553 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:11:30.553 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:30.553 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-04-25T09:11:30.553 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:30.553 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 3.4 M 2024-04-25T09:11:30.553 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 29 M 2024-04-25T09:11:30.554 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:11:30.560 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:30.561 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:30.561 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-04-25T09:11:30.561 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:30.561 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:11:30.562 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 90 k 2024-04-25T09:11:30.562 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:30.562 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:11:30.562 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:30.562 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-04-25T09:11:30.562 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:30.562 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 90 k 2024-04-25T09:11:30.562 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 313 k 2024-04-25T09:11:30.562 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:11:30.770 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-fuse-19.0.0-3194.ga126334d.el9.x86_64.rpm 433 kB/s | 90 kB 00:00 2024-04-25T09:11:30.770 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:30.771 INFO:teuthology.orchestra.run.smithi053.stdout:Total 431 kB/s | 90 kB 00:00 2024-04-25T09:11:30.771 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:11:30.781 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:11:30.781 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:11:30.849 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:11:30.938 INFO:teuthology.orchestra.run.smithi151.stdout:rbd-mirror-19.0.0-3194.ga126334d.el9.x86_64.rpm 8.8 MB/s | 3.4 MB 00:00 2024-04-25T09:11:30.939 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:30.939 INFO:teuthology.orchestra.run.smithi151.stdout:Total 8.8 MB/s | 3.4 MB 00:00 2024-04-25T09:11:30.939 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:11:30.950 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:11:30.950 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:11:30.997 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:11:31.032 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:11:31.032 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:11:31.093 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:31.457 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:31.599 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:11:31.664 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:31.688 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:11:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T09:11:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:11:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:11:31.689 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:31.720 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:31.721 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:31.721 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:31.721 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:31.721 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:31.721 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:32.000 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-mirror 2024-04-25T09:11:32.544 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:22 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:32.671 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:32.671 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:32.671 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repo Size 2024-04-25T09:11:32.672 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:32.672 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:11:32.672 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.4 M 2024-04-25T09:11:32.672 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:32.672 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:11:32.672 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:32.672 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-04-25T09:11:32.672 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:32.673 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 3.4 M 2024-04-25T09:11:32.673 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 29 M 2024-04-25T09:11:32.673 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:11:32.808 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:32.808 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:32.809 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:32.809 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:32.809 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:32.809 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:33.049 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-mirror-19.0.0-3194.ga126334d.el9.x86_64.rpm 9.0 MB/s | 3.4 MB 00:00 2024-04-25T09:11:33.050 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:33.050 INFO:teuthology.orchestra.run.smithi053.stdout:Total 9.0 MB/s | 3.4 MB 00:00 2024-04-25T09:11:33.050 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:11:33.062 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:11:33.063 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:11:33.068 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install rbd-nbd 2024-04-25T09:11:33.149 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:11:33.150 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:11:33.586 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:25 ago on Thu 25 Apr 2024 09:09:08 AM UTC. 2024-04-25T09:11:33.708 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-04-25T09:11:33.708 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 175 k 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout:Install 1 Package 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 175 k 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 673 k 2024-04-25T09:11:33.709 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-04-25T09:11:33.740 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:11:33.808 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:33.834 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:33.834 INFO:teuthology.orchestra.run.smithi053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:11:33.834 INFO:teuthology.orchestra.run.smithi053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T09:11:33.834 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:11:33.834 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:11:33.835 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:34.158 INFO:teuthology.orchestra.run.smithi151.stdout:rbd-nbd-19.0.0-3194.ga126334d.el9.x86_64.rpm 391 kB/s | 175 kB 00:00 2024-04-25T09:11:34.159 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:34.159 INFO:teuthology.orchestra.run.smithi151.stdout:Total 389 kB/s | 175 kB 00:00 2024-04-25T09:11:34.159 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-04-25T09:11:34.169 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-04-25T09:11:34.169 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-04-25T09:11:34.233 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-04-25T09:11:34.234 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-04-25T09:11:34.395 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-04-25T09:11:34.530 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:34.923 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:34.944 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:34.944 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:34.944 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:34.944 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:34.944 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:34.944 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:35.173 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:35.173 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:35.173 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-04-25T09:11:35.173 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:35.173 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:35.173 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-04-25T09:11:35.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install rbd-nbd 2024-04-25T09:11:35.394 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:35.715 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:02:25 ago on Thu 25 Apr 2024 09:09:10 AM UTC. 2024-04-25T09:11:35.843 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 175 k 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout:Install 1 Package 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:35.844 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 175 k 2024-04-25T09:11:35.845 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 673 k 2024-04-25T09:11:35.845 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2024-04-25T09:11:36.236 INFO:teuthology.orchestra.run.smithi053.stdout:rbd-nbd-19.0.0-3194.ga126334d.el9.x86_64.rpm 449 kB/s | 175 kB 00:00 2024-04-25T09:11:36.236 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:11:36.237 INFO:teuthology.orchestra.run.smithi053.stdout:Total 446 kB/s | 175 kB 00:00 2024-04-25T09:11:36.237 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2024-04-25T09:11:36.248 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2024-04-25T09:11:36.248 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2024-04-25T09:11:36.315 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2024-04-25T09:11:36.316 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2024-04-25T09:11:36.475 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2024-04-25T09:11:36.586 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:37.003 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:37.243 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:11:37.243 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:37.243 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2024-04-25T09:11:37.243 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:11:37.243 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:37.243 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2024-04-25T09:11:37.483 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:37.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:11:37.645 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T09:11:37.668 INFO:teuthology.orchestra.run.smithi053.stdout:19.0.0-3194.ga126334d.el9 2024-04-25T09:11:37.669 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3194.ga126334d.el9 2024-04-25T09:11:37.669 INFO:teuthology.task.install:The correct ceph version 19.0.0-3194.ga126334d is installed. 2024-04-25T09:11:37.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:11:37.806 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T09:11:37.830 INFO:teuthology.orchestra.run.smithi151.stdout:19.0.0-3194.ga126334d.el9 2024-04-25T09:11:37.831 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3194.ga126334d.el9 2024-04-25T09:11:37.831 INFO:teuthology.task.install:The correct ceph version 19.0.0-3194.ga126334d is installed. 2024-04-25T09:11:37.832 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T09:11:37.833 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:37.833 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:11:37.860 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:11:37.860 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:11:37.900 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T09:11:37.900 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:37.900 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:11:37.926 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:11:37.991 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:11:37.991 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:11:38.019 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:11:38.086 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T09:11:38.086 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:38.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:11:38.112 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:11:38.176 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:11:38.176 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:11:38.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:11:38.269 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T09:11:38.270 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:38.270 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:11:38.294 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:11:38.359 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:11:38.359 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:11:38.383 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:11:38.447 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T09:11:38.529 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T09:11:38.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-04-25T09:11:38.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-04-25T09:11:38.555 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T09:11:38.556 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:11:38.597 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:11:38.620 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T09:11:38.621 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:11:38.661 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:11:38.696 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T09:11:38.696 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T09:11:38.696 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969', 'branch': 'wip-matanb-crimson-testing-april-22', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7672969', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-april-22'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '472cc2b524a88306ef4535053d26658c5fd6e9db'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1211, 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_472cc2b524a88306ef4535053d26658c5fd6e9db/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '472cc2b524a88306ef4535053d26658c5fd6e9db', 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFozbiU1KxeXG1tKBNToDVDbteMjIXEJbyfl6zNrZra5ieVLOyl/M9mT8Nrtnkq9gLeVFbxhZDKnzR2ykBOj/nw=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPFOmQ8iFPt/sJMeIGkFgQmfZzKLG3ifv1uUUmyVFlp92UpeIfFL8k3NEdSSqM+zl17y55rSCQu8PsZfoKYXQA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_08:07:11', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T09:11:38.696 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:11:38.726 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:11:38.741 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:11:38.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:11:38.804 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:38.805 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:11:38.858 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:11:38.858 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-04-25T09:11:38.913 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:11:38.914 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:11:38.914 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T09:11:38.914 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:11:38.914 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:11:38.914 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-04-25 09:11:34.105497053 +0000 2024-04-25T09:11:38.914 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-04-25 09:08:13.925102020 +0000 2024-04-25T09:11:38.914 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-04-25 09:08:13.925102020 +0000 2024-04-25T09:11:38.914 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-04-25 09:08:13.925102020 +0000 2024-04-25T09:11:38.914 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:11:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-04-25T09:11:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-04-25T09:11:38.977 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 9.475e-05 s, 5.4 MB/s 2024-04-25T09:11:38.979 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:11:39.035 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-04-25T09:11:39.090 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:11:39.090 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:11:39.090 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T09:11:39.090 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:11:39.090 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:11:39.090 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-04-25 09:11:34.105497053 +0000 2024-04-25T09:11:39.090 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-04-25 09:08:14.250095528 +0000 2024-04-25T09:11:39.090 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-04-25 09:08:14.250095528 +0000 2024-04-25T09:11:39.091 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-04-25 09:08:14.250095528 +0000 2024-04-25T09:11:39.091 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:11:39.152 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-04-25T09:11:39.152 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-04-25T09:11:39.152 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000100698 s, 5.1 MB/s 2024-04-25T09:11:39.153 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:11:39.210 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-04-25T09:11:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:11:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:11:39.265 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T09:11:39.265 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:11:39.265 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:11:39.265 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-04-25 09:11:34.106497034 +0000 2024-04-25T09:11:39.265 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-04-25 09:08:14.581088915 +0000 2024-04-25T09:11:39.265 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-04-25 09:08:14.581088915 +0000 2024-04-25T09:11:39.265 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-04-25 09:08:14.581088915 +0000 2024-04-25T09:11:39.266 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:11:39.327 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-04-25T09:11:39.327 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-04-25T09:11:39.327 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000103025 s, 5.0 MB/s 2024-04-25T09:11:39.328 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:11:39.384 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-04-25T09:11:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:11:39.439 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:11:39.440 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-25T09:11:39.440 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:11:39.440 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:11:39.440 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-04-25 09:11:34.106497034 +0000 2024-04-25T09:11:39.440 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-04-25 09:08:14.932081903 +0000 2024-04-25T09:11:39.440 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-04-25 09:08:14.932081903 +0000 2024-04-25T09:11:39.440 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: 2024-04-25 09:08:14.932081903 +0000 2024-04-25T09:11:39.440 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:11:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-04-25T09:11:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-04-25T09:11:39.502 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 8.2339e-05 s, 6.2 MB/s 2024-04-25T09:11:39.503 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:11:39.559 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-25T09:11:39.559 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:11:39.559 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:11:39.575 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:11:39.575 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-04-25T09:11:39.630 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:11:39.631 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:11:39.631 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T09:11:39.631 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:11:39.631 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:11:39.631 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-04-25 09:11:31.943653829 +0000 2024-04-25T09:11:39.631 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-04-25 09:08:10.644707997 +0000 2024-04-25T09:11:39.631 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-04-25 09:08:10.644707997 +0000 2024-04-25T09:11:39.631 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-04-25 09:08:10.644707997 +0000 2024-04-25T09:11:39.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:11:39.692 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-04-25T09:11:39.693 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-04-25T09:11:39.693 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000205869 s, 2.5 MB/s 2024-04-25T09:11:39.694 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:11:39.749 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-04-25T09:11:39.803 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:11:39.803 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:11:39.804 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T09:11:39.804 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:11:39.804 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:11:39.804 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-04-25 09:11:31.943653829 +0000 2024-04-25T09:11:39.804 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-04-25 09:08:10.987703884 +0000 2024-04-25T09:11:39.804 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-04-25 09:08:10.987703884 +0000 2024-04-25T09:11:39.804 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-04-25 09:08:10.987703884 +0000 2024-04-25T09:11:39.804 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:11:39.865 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-04-25T09:11:39.865 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-04-25T09:11:39.866 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000182295 s, 2.8 MB/s 2024-04-25T09:11:39.867 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:11:39.922 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-04-25T09:11:39.976 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:11:39.977 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:11:39.977 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-25T09:11:39.977 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:11:39.977 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:11:39.977 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-04-25 09:11:31.943653829 +0000 2024-04-25T09:11:39.977 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-04-25 09:08:11.330699772 +0000 2024-04-25T09:11:39.977 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-04-25 09:08:11.330699772 +0000 2024-04-25T09:11:39.977 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-04-25 09:08:11.330699772 +0000 2024-04-25T09:11:39.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:11:40.039 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-04-25T09:11:40.039 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-04-25T09:11:40.039 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000183915 s, 2.8 MB/s 2024-04-25T09:11:40.040 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:11:40.095 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-04-25T09:11:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:11:40.149 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:11:40.149 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T09:11:40.150 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:11:40.150 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:11:40.150 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-04-25 09:11:31.944653816 +0000 2024-04-25T09:11:40.150 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-04-25 09:08:11.671695684 +0000 2024-04-25T09:11:40.150 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-04-25 09:08:11.671695684 +0000 2024-04-25T09:11:40.150 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-04-25 09:08:11.671695684 +0000 2024-04-25T09:11:40.150 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:11:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-04-25T09:11:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-04-25T09:11:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000170562 s, 3.0 MB/s 2024-04-25T09:11:40.213 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:11:40.269 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-25T09:11:40.269 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-04-25T09:11:40.269 INFO:tasks.ceph:Generating config... 2024-04-25T09:11:40.270 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-04-25T09:11:40.270 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-04-25T09:11:40.270 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-04-25T09:11:40.271 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-04-25T09:11:40.271 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-04-25T09:11:40.271 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T09:11:40.271 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T09:11:40.271 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T09:11:40.271 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-04-25T09:11:40.271 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-04-25T09:11:40.271 INFO:tasks.ceph:[osd] debug monc = 20 2024-04-25T09:11:40.271 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-04-25T09:11:40.271 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-04-25T09:11:40.271 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T09:11:40.271 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T09:11:40.271 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T09:11:40.271 INFO:tasks.ceph:[osd] osd class default list = * 2024-04-25T09:11:40.271 INFO:tasks.ceph:[osd] osd class load list = * 2024-04-25T09:11:40.272 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-25T09:11:40.272 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T09:11:40.272 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-04-25T09:11:40.272 INFO:tasks.ceph:[global] ms client mode = crc 2024-04-25T09:11:40.272 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-04-25T09:11:40.272 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-04-25T09:11:40.272 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-04-25T09:11:40.272 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-04-25T09:11:40.272 INFO:tasks.ceph:[global] ms service mode = crc 2024-04-25T09:11:40.272 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T09:11:40.272 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T09:11:40.272 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-04-25T09:11:40.272 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-04-25T09:11:40.272 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-04-25T09:11:40.272 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-04-25T09:11:40.273 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T09:11:40.273 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T09:11:40.348 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T09:11:40.351 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T09:11:40.404 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:11:40.429 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53')] 2024-04-25T09:11:40.429 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-04-25T09:11:40.430 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:40.430 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:11:40.485 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:11:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:11:40.590+0000 7f6e2102cf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:11:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:11:40.590+0000 7f6e2102cf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:11:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:11:40.590+0000 7f6e2102cf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = quincy 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:fsid 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2024-04-25T09:11:40.591656+0000 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-04-25T09:11:40.591656+0000 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 17 (quincy) 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-25T09:11:40.580 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:11:40.594 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 12417946-fe70-462a-890a-9259fe1aeb83... 2024-04-25T09:11:40.595 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:40.637 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:40.676 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-04-25T09:11:40.676 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-04-25T09:11:40.676 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:40.677 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:40.678 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = 172.21.15.53 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: ms client mode = crc 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: ms cluster mode = crc 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: ms mon client mode = crc 2024-04-25T09:11:40.679 INFO:teuthology.orchestra.run.smithi053.stdout: ms mon cluster mode = crc 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: ms mon service mode = crc 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: ms service mode = crc 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-04-25T09:11:40.680 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:40.681 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: debug monc = 20 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: crimson alien thread cpu cores = 6-7 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: crimson osd obc lru size = 10 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: osd blocked scrub grace period = 3600 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: osd class default list = * 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: osd class load list = * 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: osd shutdown pgref assert = True 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-04-25T09:11:40.682 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:40.683 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:40.684 INFO:teuthology.orchestra.run.smithi053.stdout: mon min osdmap epochs = 50 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: mon osdmap full prune interval = 2 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: mon osdmap full prune min = 15 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: mon osdmap full prune txsize = 2 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: paxos service trim min = 10 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on pool no app = False 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default crimson = True 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-04-25T09:11:40.685 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi053.stdout: crimson seastar cpu cores = 0-2 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi053.stdout: crimson seastar cpu cores = 3-5 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi053.stdout: crimson seastar cpu cores = 0-2 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi053.stdout: crimson seastar cpu cores = 3-5 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-04-25T09:11:40.686 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:40.687 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:40.688 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = 172.21.15.53 2024-04-25T09:11:40.689 INFO:teuthology.orchestra.run.smithi151.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: ms client mode = crc 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: ms cluster mode = crc 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: ms mon client mode = crc 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: ms mon cluster mode = crc 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: ms mon service mode = crc 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: ms service mode = crc 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.690 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-04-25T09:11:40.691 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: debug monc = 20 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: crimson alien thread cpu cores = 6-7 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: crimson osd obc lru size = 10 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: osd blocked scrub grace period = 3600 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: osd class default list = * 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: osd class load list = * 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: osd shutdown pgref assert = True 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.692 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:40.693 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.694 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: mon min osdmap epochs = 50 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: mon osdmap full prune interval = 2 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: mon osdmap full prune min = 15 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: mon osdmap full prune txsize = 2 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: paxos service trim min = 10 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on pool no app = False 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default crimson = True 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2024-04-25T09:11:40.695 INFO:teuthology.orchestra.run.smithi151.stdout: crimson seastar cpu cores = 0-2 2024-04-25T09:11:40.696 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2024-04-25T09:11:40.696 INFO:teuthology.orchestra.run.smithi151.stdout: crimson seastar cpu cores = 3-5 2024-04-25T09:11:40.696 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2024-04-25T09:11:40.696 INFO:teuthology.orchestra.run.smithi151.stdout: crimson seastar cpu cores = 0-2 2024-04-25T09:11:40.696 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2024-04-25T09:11:40.696 INFO:teuthology.orchestra.run.smithi151.stdout: crimson seastar cpu cores = 3-5 2024-04-25T09:11:40.697 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T09:11:40.697 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T09:11:40.801 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T09:11:40.802 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:40.802 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T09:11:40.817 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:40.817 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T09:11:40.871 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-04-25T09:11:40.871 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:40.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:11:40.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:11:40.945 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:11:40.945 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:11:41.000 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T09:11:41.000 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:11:41.000 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:11:41.000 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:11:41.034 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:11:41.034 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:11:41.089 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T09:11:41.089 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T09:11:41.089 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:11:41.214 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:11:41.217 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T09:11:41.217 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T09:11:41.217 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T09:11:41.267 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T09:11:41.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T09:11:41.327 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T09:11:41.339 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T09:11:41.339 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-04-25T09:11:41.339 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T09:11:41.364 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-25T09:11:41.364 INFO:tasks.ceph:role: osd.0 2024-04-25T09:11:41.364 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-25T09:11:41.364 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:11:41.428 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:11:41.460 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-04-25T09:11:41.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-04-25T09:11:41.462 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T09:11:41.531 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T09:11:41.600 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T09:11:41.665 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-25T09:11:41.665 INFO:tasks.ceph:role: osd.1 2024-04-25T09:11:41.665 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-25T09:11:41.665 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:11:41.730 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:11:41.730 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:11:41.730 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:11:41.730 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:11:41.730 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:11:41.730 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:11:41.730 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:11:41.730 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:11:41.731 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:11:41.731 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:11:41.762 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-04-25T09:11:41.764 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-04-25T09:11:41.764 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T09:11:41.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T09:11:41.901 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:11:42.226 INFO:teuthology.orchestra.run.smithi053.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:11:42.227 INFO:teuthology.orchestra.run.smithi053.stderr:INFO 2024-04-25 09:11:42,241 seastar - Reactor backend: linux-aio 2024-04-25T09:11:42.240 INFO:teuthology.orchestra.run.smithi053.stderr:==26210==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:11:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:INFO 2024-04-25 09:11:42,373 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-25T09:11:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:INFO 2024-04-25 09:11:42,373 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-04-25T09:11:42.360 INFO:teuthology.orchestra.run.smithi053.stderr:DEBUG 2024-04-25 09:11:42,374 [shard 0:main] seastar - reactor::drain 2024-04-25T09:11:42.930 INFO:teuthology.orchestra.run.smithi053.stderr:----------------------------------------------------- 2024-04-25T09:11:42.931 INFO:teuthology.orchestra.run.smithi053.stderr:Suppressions used: 2024-04-25T09:11:42.931 INFO:teuthology.orchestra.run.smithi053.stderr: count bytes template 2024-04-25T09:11:42.931 INFO:teuthology.orchestra.run.smithi053.stderr: 1 8 MallocExtension::Register 2024-04-25T09:11:42.931 INFO:teuthology.orchestra.run.smithi053.stderr:----------------------------------------------------- 2024-04-25T09:11:42.931 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi053.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:11:43.002 INFO:teuthology.orchestra.run.smithi053.stderr:INFO 2024-04-25 09:11:43,016 seastar - Reactor backend: linux-aio 2024-04-25T09:11:43.012 INFO:teuthology.orchestra.run.smithi053.stderr:==26208==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:11:43.077 INFO:teuthology.orchestra.run.smithi053.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9f08b9 0xb8c3380 0xb8c48fc 0xb8c4b12 0xb8c4c68 0xb8c5131 0x3e6ef 0x8b531 0xef7ec 0x4a0a5 0x35b7c 0x3629e 0x5df5a44 0x5df5c26 0x5df5e3d 0x5df6113 0x5e44953 0x5e44b59 0x5dc3640 0x5dc381a 0x5dc3da6 0x5c088dd 0x5c239a1 0x6efc314 0x6f0dae7 0x6f0ef84 0x6f0f009 0x6f0f10b 0x6f0f203 0x6f0f410 0x6f0f5f6 0x6f0f945 0x6f0fce9 0x6f0ff19 0x6f10183 0x6f10450 0x6f1066e 0x6f10726 0x6f107ec 0x6f108cd 0x5a711d6 0x5a712e0 0x5a7139c 0x5a71458 0x5a71514 0x5a71661 0x5a717ec 0x5a71bad 0x5a8daee 0xb8d6005 0xb8f029f 0xb99129d 0xb9928eb 0xb66f0d1 0xb66fa4d 0x368758a 0x2958f 0x2963f 0x3473444 2024-04-25T09:11:43.077 INFO:teuthology.orchestra.run.smithi053.stderr:kernel callstack: 2024-04-25T09:11:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:----------------------------------------------------- 2024-04-25T09:11:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:Suppressions used: 2024-04-25T09:11:46.512 INFO:teuthology.orchestra.run.smithi053.stderr: count bytes template 2024-04-25T09:11:46.512 INFO:teuthology.orchestra.run.smithi053.stderr: 1 8 MallocExtension::Register 2024-04-25T09:11:46.512 INFO:teuthology.orchestra.run.smithi053.stderr:----------------------------------------------------- 2024-04-25T09:11:46.513 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-25T09:11:46.513 INFO:teuthology.orchestra.run.smithi053.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:11:46.539 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T09:11:46.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:11:46.868 INFO:teuthology.orchestra.run.smithi053.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:11:46.869 INFO:teuthology.orchestra.run.smithi053.stderr:INFO 2024-04-25 09:11:46,883 seastar - Reactor backend: linux-aio 2024-04-25T09:11:46.874 INFO:teuthology.orchestra.run.smithi053.stderr:==27029==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:11:46.978 INFO:teuthology.orchestra.run.smithi053.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9f08b9 0xb8c3380 0xb8c48fc 0xb8c4b12 0xb8c4c68 0xb8c5131 0x3e6ef 0x8b50f 0xef7ec 0x4a0a5 0x35b7c 0x3629e 0x5df5a44 0x5df5c40 0x5df5e3d 0x5df6113 0x5e44953 0x5e44b59 0x5dc3640 0x5dc381a 0x5dc3da6 0x5c088dd 0x5c239a1 0x6efc314 0x6f0dae7 0x6f0ef84 0x6f0f009 0x6f0f10b 0x6f0f203 0x6f0f410 0x6f0f5f6 0x6f0f945 0x6f0fce9 0x6f0ff19 0x6f10183 0x6f10450 0x6f1066e 0x6f10726 0x6f107ec 0x6f108cd 0x5a711d6 0x5a712e0 0x5a7139c 0x5a71458 0x5a71514 0x5a71661 0x5a717ec 0x5a71bad 0x5a8daee 0xb8d6005 0xb8f029f 0xb99129d 0xb9928eb 0xb66f0d1 0xb66fa4d 0x37e691a 0x37e7473 0x3686d7a 0x2958f 0x2963f 0x3473444 2024-04-25T09:11:46.979 INFO:teuthology.orchestra.run.smithi053.stderr:kernel callstack: 2024-04-25T09:11:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:INFO 2024-04-25 09:11:47,005 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-25T09:11:46.991 INFO:teuthology.orchestra.run.smithi053.stderr:INFO 2024-04-25 09:11:47,005 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-04-25T09:11:46.992 INFO:teuthology.orchestra.run.smithi053.stderr:DEBUG 2024-04-25 09:11:47,006 [shard 0:main] seastar - reactor::drain 2024-04-25T09:11:47.546 INFO:teuthology.orchestra.run.smithi053.stderr:----------------------------------------------------- 2024-04-25T09:11:47.547 INFO:teuthology.orchestra.run.smithi053.stderr:Suppressions used: 2024-04-25T09:11:47.547 INFO:teuthology.orchestra.run.smithi053.stderr: count bytes template 2024-04-25T09:11:47.547 INFO:teuthology.orchestra.run.smithi053.stderr: 1 8 MallocExtension::Register 2024-04-25T09:11:47.547 INFO:teuthology.orchestra.run.smithi053.stderr:----------------------------------------------------- 2024-04-25T09:11:47.547 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-25T09:11:47.607 INFO:teuthology.orchestra.run.smithi053.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:11:47.611 INFO:teuthology.orchestra.run.smithi053.stderr:INFO 2024-04-25 09:11:47,625 seastar - Reactor backend: linux-aio 2024-04-25T09:11:47.621 INFO:teuthology.orchestra.run.smithi053.stderr:==27027==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:11:47.686 INFO:teuthology.orchestra.run.smithi053.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9f08b9 0xb8c3380 0xb8c48fc 0xb8c4b12 0xb8c4c68 0xb8c5131 0x3e6ef 0x5df5209 0x5df586b 0x5e44afb 0x5dc3640 0x5dc3b74 0x5c088dd 0x5c239a1 0x6efc314 0x6f0dae7 0x6f0ef84 0x6f0f009 0x6f0f10b 0x6f0f203 0x6f0f410 0x6f0f5f6 0x6f0f945 0x6f0fce9 0x6f0ff19 0x6f10183 0x6f10450 0x6f1066e 0x6f10726 0x6f107ec 0x6f108cd 0x5a711d6 0x5a712e0 0x5a7139c 0x5a71458 0x5a71514 0x5a71661 0x5a717ec 0x5a71bad 0x5a8daee 0xb8d6005 0xb8f029f 0xb99129d 0xb9928eb 0xb66f0d1 0xb66fa4d 0x368758a 0x2958f 0x2963f 0x3473444 2024-04-25T09:11:47.686 INFO:teuthology.orchestra.run.smithi053.stderr:kernel callstack: 2024-04-25T09:11:51.117 INFO:teuthology.orchestra.run.smithi053.stderr:----------------------------------------------------- 2024-04-25T09:11:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:Suppressions used: 2024-04-25T09:11:51.118 INFO:teuthology.orchestra.run.smithi053.stderr: count bytes template 2024-04-25T09:11:51.118 INFO:teuthology.orchestra.run.smithi053.stderr: 1 8 MallocExtension::Register 2024-04-25T09:11:51.118 INFO:teuthology.orchestra.run.smithi053.stderr:----------------------------------------------------- 2024-04-25T09:11:51.118 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-25T09:11:51.118 INFO:teuthology.orchestra.run.smithi053.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:11:51.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T09:11:51.168 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T09:11:51.197 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-25T09:11:51.197 INFO:tasks.ceph:role: osd.2 2024-04-25T09:11:51.197 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T09:11:51.197 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:11:51.271 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:11:51.271 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:11:51.271 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:11:51.271 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:11:51.272 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:11:51.272 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:11:51.272 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:11:51.272 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:11:51.272 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:11:51.272 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:11:51.779 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-04-25T09:11:51.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-04-25T09:11:51.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-25T09:11:51.902 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T09:11:51.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T09:11:52.000 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-25T09:11:52.000 INFO:tasks.ceph:role: osd.3 2024-04-25T09:11:52.000 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T09:11:52.000 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:11:52.073 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:11:52.073 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:11:52.073 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:11:52.073 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:11:52.073 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:11:52.073 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:11:52.073 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:11:52.073 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:11:52.073 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:11:52.074 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:11:52.539 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-04-25T09:11:52.541 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-04-25T09:11:52.541 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-04-25T09:11:52.639 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T09:11:52.669 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:11:52.955 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:11:52.956 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-04-25 09:11:52,970 seastar - Reactor backend: linux-aio 2024-04-25T09:11:52.967 INFO:teuthology.orchestra.run.smithi151.stderr:==26169==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:11:53.070 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9f08b9 0xb8c3380 0xb8c48fc 0xb8c4b12 0xb8c4c68 0xb8c5131 0x3e6ef 0x3838d 0x5c14e66 0x5c19fb9 0x5c1f226 0x5c1f828 0x6efc383 0x6f0dae7 0x6f0ef84 0x6f0f009 0x6f0f10b 0x6f0f203 0x6f0f410 0x6f0f5f6 0x6f0f945 0x6f0fce9 0x6f0ff19 0x6f10183 0x6f10450 0x6f1066e 0x6f10726 0x6f107ec 0x6f108cd 0x5a711d6 0x5a712e0 0x5a7139c 0x5a71458 0x5a71514 0x5a71661 0x5a717ec 0x5a71bad 0x5a8daee 0xb8d6005 0xb8f029f 0xb99129d 0xb9928eb 0xb66f0d1 0xb66fa4d 0x37e691a 0x37e7473 0x3686d7a 0x2958f 0x2963f 0x3473444 2024-04-25T09:11:53.070 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffb1e8b6c4 0xffffffffb2a88d52 0xffffffffb2c00b52 2024-04-25T09:11:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-04-25 09:11:53,089 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-25T09:11:53.075 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-04-25 09:11:53,089 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-04-25T09:11:53.076 INFO:teuthology.orchestra.run.smithi151.stderr:DEBUG 2024-04-25 09:11:53,090 [shard 0:main] seastar - reactor::drain 2024-04-25T09:11:53.609 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-04-25T09:11:53.609 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-04-25T09:11:53.609 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-04-25T09:11:53.610 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-04-25T09:11:53.610 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-04-25T09:11:53.610 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T09:11:53.668 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:11:53.672 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-04-25 09:11:53,686 seastar - Reactor backend: linux-aio 2024-04-25T09:11:53.681 INFO:teuthology.orchestra.run.smithi151.stderr:==26167==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:11:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-04-25T09:11:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-04-25T09:11:57.126 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-04-25T09:11:57.126 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-04-25T09:11:57.126 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-04-25T09:11:57.126 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T09:11:57.126 INFO:teuthology.orchestra.run.smithi151.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:11:57.153 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T09:11:57.176 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:11:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:11:57.469 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-04-25 09:11:57,483 seastar - Reactor backend: linux-aio 2024-04-25T09:11:57.474 INFO:teuthology.orchestra.run.smithi151.stderr:==26977==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:11:57.583 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-04-25 09:11:57,597 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-25T09:11:57.583 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-04-25 09:11:57,597 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-04-25T09:11:57.584 INFO:teuthology.orchestra.run.smithi151.stderr:DEBUG 2024-04-25 09:11:57,598 [shard 0:main] seastar - reactor::drain 2024-04-25T09:11:58.118 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-04-25T09:11:58.119 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-04-25T09:11:58.119 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-04-25T09:11:58.119 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-04-25T09:11:58.119 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-04-25T09:11:58.119 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T09:11:58.174 INFO:teuthology.orchestra.run.smithi151.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:11:58.177 INFO:teuthology.orchestra.run.smithi151.stderr:INFO 2024-04-25 09:11:58,191 seastar - Reactor backend: linux-aio 2024-04-25T09:11:58.191 INFO:teuthology.orchestra.run.smithi151.stderr:==26975==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:11:58.285 INFO:teuthology.orchestra.run.smithi151.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9f08b9 0xb8c3380 0xb8c48fc 0xb8c4b12 0xb8c4c68 0xb8c5131 0x3e6ef 0x35b6f 0x3629e 0x37f0396 0x5a18d8f 0x5a1bdfd 0x5c74977 0x5c75fa3 0x5c76164 0x5c1f909 0x6efc383 0x6f0dae7 0x6f0ef84 0x6f0f009 0x6f0f10b 0x6f0f203 0x6f0f410 0x6f0f5f6 0x6f0f945 0x6f0fce9 0x6f0ff19 0x6f10183 0x6f10450 0x6f1066e 0x6f10726 0x6f107ec 0x6f108cd 0x5a711d6 0x5a712e0 0x5a7139c 0x5a71458 0x5a71514 0x5a71661 0x5a717ec 0x5a71bad 0x5a8daee 0xb8d6005 0xb8f029f 0xb99129d 0xb9928eb 0xb66f0d1 0xb66fa4d 0x368758a 0x2958f 0x2963f 0x3473444 2024-04-25T09:11:58.285 INFO:teuthology.orchestra.run.smithi151.stderr:kernel callstack: 2024-04-25T09:12:01.648 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-04-25T09:12:01.648 INFO:teuthology.orchestra.run.smithi151.stderr:Suppressions used: 2024-04-25T09:12:01.648 INFO:teuthology.orchestra.run.smithi151.stderr: count bytes template 2024-04-25T09:12:01.649 INFO:teuthology.orchestra.run.smithi151.stderr: 1 8 MallocExtension::Register 2024-04-25T09:12:01.649 INFO:teuthology.orchestra.run.smithi151.stderr:----------------------------------------------------- 2024-04-25T09:12:01.649 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T09:12:01.649 INFO:teuthology.orchestra.run.smithi151.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:12:01.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T09:12:01.698 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T09:12:01.698 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:12:01.698 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T09:12:01.728 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:12:01.728 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T09:12:01.798 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:12:01.798 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T09:12:01.821 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:12:01.821 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T09:12:01.885 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:12:01.885 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T09:12:01.948 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:12:01.948 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T09:12:01.967 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:12:01.967 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T09:12:02.002 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T09:12:02.002 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:12:02.033 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-04-25T09:12:02.033 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBPHipm6voJCxAAXqwINwSat2oWheri63GxgQ== 2024-04-25T09:12:02.033 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-04-25T09:12:02.033 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBTHipmXZydLhAA06RHUxnJ8xSnOADem+TFoA== 2024-04-25T09:12:02.033 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-04-25T09:12:02.033 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBNHipmGjqZDRAAEfg6QFRGiuu8P6jbsm+tPQ== 2024-04-25T09:12:02.033 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-04-25T09:12:02.034 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBZHipmWQCKMRAAFh7DhGLwQRjzQzXOyxtvIw== 2024-04-25T09:12:02.034 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-04-25T09:12:02.034 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBeHipmyG+zFBAAdzFmQ/cVg9T2zyYQdePreA== 2024-04-25T09:12:02.034 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-04-25T09:12:02.034 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBNHipm5s/GEBAAko1sDU2/vbPL9eNLOE0jig== 2024-04-25T09:12:02.034 INFO:teuthology.orchestra.run.smithi053.stdout:[client.1] 2024-04-25T09:12:02.034 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQBNHipmF2lWFBAA8JO7iB9vkaiMiARsc/tvUw== 2024-04-25T09:12:02.035 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:12:02.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:12:02.207 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:12:02.267 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:12:02.327 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:12:02.386 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:12:02.449 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:12:02.512 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T09:12:02.512 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T09:12:02.536 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:12:02.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.659+0000 7f24290a3a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.659+0000 7f24290a3a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.661 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T09:12:02.684 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:12:02.740 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T09:12:02.740 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T09:12:02.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T09:12:02.782 INFO:tasks.ceph.mon.a:Started 2024-04-25T09:12:02.782 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T09:12:02.782 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T09:12:02.783 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T09:12:02.785 INFO:tasks.ceph.mgr.x:Started 2024-04-25T09:12:02.785 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T09:12:02.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T09:12:02.863 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-04-25T09:12:02.875+0000 7f68b0e57a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.863 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-04-25T09:12:02.875+0000 7f68b0e57a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.863 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-04-25T09:12:02.875+0000 7f68b0e57a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.879 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:02.892+0000 7f9e11e33000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.906+0000 7f0ab866d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.902 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:02.914+0000 7f9e11e33000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.902 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:02.915+0000 7f9e11e33000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.914+0000 7f0ab866d640 1 Processor -- start 2024-04-25T09:12:02.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.914+0000 7f0ab866d640 1 -- start start 2024-04-25T09:12:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab866d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0ab00a1100 0x7f0ab0131dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab866d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab0132720 con 0x7f0ab0132310 2024-04-25T09:12:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab866d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f0ab00a0440 con 0x7f0ab00a1100 2024-04-25T09:12:02.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab6409640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0ab00a1100 0x7f0ab0131dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab5c08640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0ab0132310 0x7f0ab0134d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45000/0 (socket says 172.21.15.53:45000) 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab5c08640 1 -- 172.21.15.53:0/2059702127 learned_addr learned my addr 172.21.15.53:0/2059702127 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab6409640 1 -- 172.21.15.53:0/2059702127 >> v1:172.21.15.53:6789/0 conn(0x7f0ab0132310 legacy=0x7f0ab0134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab6409640 1 -- 172.21.15.53:0/2059702127 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab0131820 con 0x7f0ab00a1100 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab6409640 1 --2- 172.21.15.53:0/2059702127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 0x7f0ab0131dd0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586dd2de42a8311f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab5407640 1 -- 172.21.15.53:0/2059702127 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aac009d90 con 0x7f0ab00a1100 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab5407640 1 -- 172.21.15.53:0/2059702127 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0aac00e230 con 0x7f0ab00a1100 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.916+0000 7f0ab5407640 1 -- 172.21.15.53:0/2059702127 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aac00e4d0 con 0x7f0ab00a1100 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.917+0000 7f0ab866d640 1 -- 172.21.15.53:0/2059702127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 msgr2=0x7f0ab0131dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:02.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.917+0000 7f0ab866d640 1 --2- 172.21.15.53:0/2059702127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 0x7f0ab0131dd0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:02.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.917+0000 7f0ab866d640 1 -- 172.21.15.53:0/2059702127 shutdown_connections 2024-04-25T09:12:02.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.917+0000 7f0ab866d640 1 --2- 172.21.15.53:0/2059702127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 0x7f0ab0131dd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:02.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.917+0000 7f0ab866d640 1 -- 172.21.15.53:0/2059702127 >> 172.21.15.53:0/2059702127 conn(0x7f0ab00a4eb0 msgr2=0x7f0ab00a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:02.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.917+0000 7f0ab866d640 1 -- 172.21.15.53:0/2059702127 shutdown_connections 2024-04-25T09:12:02.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.917+0000 7f0ab866d640 1 -- 172.21.15.53:0/2059702127 wait complete. 2024-04-25T09:12:02.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.918+0000 7f0ab866d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:02.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.919+0000 7f0ab866d640 1 Processor -- start 2024-04-25T09:12:02.907 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.919+0000 7f0ab866d640 1 -- start start 2024-04-25T09:12:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.921+0000 7f0ab866d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 0x7f0ab011d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.921+0000 7f0ab866d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab011ef30 con 0x7f0ab00a1100 2024-04-25T09:12:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.921+0000 7f0ab6409640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 0x7f0ab011d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.921+0000 7f0ab6409640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 0x7f0ab011d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52766/0 (socket says 172.21.15.53:52766) 2024-04-25T09:12:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.921+0000 7f0ab6409640 1 -- 172.21.15.53:0/1688823247 learned_addr learned my addr 172.21.15.53:0/1688823247 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.921+0000 7f0ab6409640 1 -- 172.21.15.53:0/1688823247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab0121390 con 0x7f0ab00a1100 2024-04-25T09:12:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.921+0000 7f0ab6409640 1 --2- 172.21.15.53:0/1688823247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 0x7f0ab011d600 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:02.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.922+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/1688823247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aac014620 con 0x7f0ab00a1100 2024-04-25T09:12:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.922+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/1688823247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0aac014780 con 0x7f0ab00a1100 2024-04-25T09:12:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.922+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/1688823247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0aac014a20 con 0x7f0ab00a1100 2024-04-25T09:12:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.922+0000 7f0ab866d640 1 -- 172.21.15.53:0/1688823247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab011fc10 con 0x7f0ab00a1100 2024-04-25T09:12:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.922+0000 7f0ab866d640 1 -- 172.21.15.53:0/1688823247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab01312c0 con 0x7f0ab00a1100 2024-04-25T09:12:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.922+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/1688823247 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f0aac013400 con 0x7f0ab00a1100 2024-04-25T09:12:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.922+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/1688823247 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7f0aac019040 con 0x7f0ab00a1100 2024-04-25T09:12:02.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.923+0000 7f0ab866d640 1 -- 172.21.15.53:0/1688823247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab0063880 con 0x7f0ab00a1100 2024-04-25T09:12:02.913 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.925+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/1688823247 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f0aac013890 con 0x7f0ab00a1100 2024-04-25T09:12:02.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.991+0000 7f0ab866d640 1 -- 172.21.15.53:0/1688823247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0ab0132090 con 0x7f0ab00a1100 2024-04-25T09:12:02.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.992+0000 7f0aa6ffd640 1 -- 172.21.15.53:0/1688823247 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7f0aac0059f0 con 0x7f0ab00a1100 2024-04-25T09:12:02.980 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-04-25T09:12:02.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.993+0000 7f0ab866d640 1 -- 172.21.15.53:0/1688823247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 msgr2=0x7f0ab011d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:02.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.993+0000 7f0ab866d640 1 --2- 172.21.15.53:0/1688823247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 0x7f0ab011d600 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:02.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.993+0000 7f0ab866d640 1 -- 172.21.15.53:0/1688823247 shutdown_connections 2024-04-25T09:12:02.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.993+0000 7f0ab866d640 1 --2- 172.21.15.53:0/1688823247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ab00a1100 0x7f0ab011d600 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:02.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.993+0000 7f0ab866d640 1 -- 172.21.15.53:0/1688823247 >> 172.21.15.53:0/1688823247 conn(0x7f0ab00a4eb0 msgr2=0x7f0ab01bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:02.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.993+0000 7f0ab866d640 1 -- 172.21.15.53:0/1688823247 shutdown_connections 2024-04-25T09:12:02.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:02.993+0000 7f0ab866d640 1 -- 172.21.15.53:0/1688823247 wait complete. 2024-04-25T09:12:02.992 INFO:tasks.ceph:check_enable_crimson: True 2024-04-25T09:12:02.992 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-04-25T09:12:02.992 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-04-25T09:12:02.999 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:03.012+0000 7f9e11e33000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:12:03.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.108+0000 7fd8e3a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:03.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.114+0000 7fd8e3a6d640 1 Processor -- start 2024-04-25T09:12:03.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.114+0000 7fd8e3a6d640 1 -- start start 2024-04-25T09:12:03.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e3a6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8dc09f960 0x7fd8dc13a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e3a6d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8dc06f0b0 con 0x7fd8dc09ee40 2024-04-25T09:12:03.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e3a6d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd8dc073c50 con 0x7fd8dc09f960 2024-04-25T09:12:03.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e1008640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd8dc09f960 0x7fd8dc13a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e1809640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd8dc09ee40 0x7fd8dc09f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45010/0 (socket says 172.21.15.53:45010) 2024-04-25T09:12:03.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e1809640 1 -- 172.21.15.53:0/3855928124 learned_addr learned my addr 172.21.15.53:0/3855928124 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:03.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e1008640 1 -- 172.21.15.53:0/3855928124 >> v1:172.21.15.53:6789/0 conn(0x7fd8dc09ee40 legacy=0x7fd8dc09f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e1008640 1 -- 172.21.15.53:0/3855928124 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc0a1120 con 0x7fd8dc09f960 2024-04-25T09:12:03.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e1008640 1 --2- 172.21.15.53:0/3855928124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09f960 0x7fd8dc13a090 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d123151b6a9e73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e0807640 1 -- 172.21.15.53:0/3855928124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd8cc009d90 con 0x7fd8dc09f960 2024-04-25T09:12:03.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e0807640 1 -- 172.21.15.53:0/3855928124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd8cc00e230 con 0x7fd8dc09f960 2024-04-25T09:12:03.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.116+0000 7fd8e0807640 1 -- 172.21.15.53:0/3855928124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd8cc00e4d0 con 0x7fd8dc09f960 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.117+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/3855928124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09f960 msgr2=0x7fd8dc13a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.117+0000 7fd8e3a6d640 1 --2- 172.21.15.53:0/3855928124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09f960 0x7fd8dc13a090 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.117+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/3855928124 shutdown_connections 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.117+0000 7fd8e3a6d640 1 --2- 172.21.15.53:0/3855928124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09f960 0x7fd8dc13a090 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.117+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/3855928124 >> 172.21.15.53:0/3855928124 conn(0x7fd8dc0a3be0 msgr2=0x7fd8dc0a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.117+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/3855928124 shutdown_connections 2024-04-25T09:12:03.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.117+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/3855928124 wait complete. 2024-04-25T09:12:03.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.117+0000 7fd8e3a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:03.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.119+0000 7fd8e3a6d640 1 Processor -- start 2024-04-25T09:12:03.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.119+0000 7fd8e3a6d640 1 -- start start 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8e3a6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09ee40 0x7fd8dc1c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8e3a6d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc120860 con 0x7fd8dc09ee40 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8e1809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09ee40 0x7fd8dc1c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8e1809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09ee40 0x7fd8dc1c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52792/0 (socket says 172.21.15.53:52792) 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8e1809640 1 -- 172.21.15.53:0/2543160710 learned_addr learned my addr 172.21.15.53:0/2543160710 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8e1809640 1 -- 172.21.15.53:0/2543160710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc120cc0 con 0x7fd8dc09ee40 2024-04-25T09:12:03.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8e1809640 1 --2- 172.21.15.53:0/2543160710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09ee40 0x7fd8dc1c9c60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8d27fc640 1 -- 172.21.15.53:0/2543160710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd8d8005a60 con 0x7fd8dc09ee40 2024-04-25T09:12:03.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8d27fc640 1 -- 172.21.15.53:0/2543160710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd8d8005bc0 con 0x7fd8dc09ee40 2024-04-25T09:12:03.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/2543160710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8dc1c95b0 con 0x7fd8dc09ee40 2024-04-25T09:12:03.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8d27fc640 1 -- 172.21.15.53:0/2543160710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd8d8005e60 con 0x7fd8dc09ee40 2024-04-25T09:12:03.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.121+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/2543160710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8dc122090 con 0x7fd8dc09ee40 2024-04-25T09:12:03.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.122+0000 7fd8d27fc640 1 -- 172.21.15.53:0/2543160710 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fd8d800cb10 con 0x7fd8dc09ee40 2024-04-25T09:12:03.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.122+0000 7fd8d27fc640 1 -- 172.21.15.53:0/2543160710 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7fd8d800f980 con 0x7fd8dc09ee40 2024-04-25T09:12:03.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.122+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/2543160710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8dc1c9a60 con 0x7fd8dc09ee40 2024-04-25T09:12:03.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.125+0000 7fd8d27fc640 1 -- 172.21.15.53:0/2543160710 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7fd8d800fbe0 con 0x7fd8dc09ee40 2024-04-25T09:12:03.152 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:03.165+0000 7f9e11e33000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:12:03.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.202+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/2543160710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7fd8dc063880 con 0x7fd8dc09ee40 2024-04-25T09:12:03.190 INFO:tasks.ceph.mon.a.smithi053.stderr:2024-04-25T09:12:03.202+0000 7f68a77f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-04-25T09:12:03.190 INFO:tasks.ceph.mon.a.smithi053.stderr:Please be aware that this feature is experimental, untested, 2024-04-25T09:12:03.190 INFO:tasks.ceph.mon.a.smithi053.stderr:unsupported, and may result in data corruption, data loss, 2024-04-25T09:12:03.190 INFO:tasks.ceph.mon.a.smithi053.stderr:and/or irreparable damage to your cluster. Do not use 2024-04-25T09:12:03.190 INFO:tasks.ceph.mon.a.smithi053.stderr:feature with important data. 2024-04-25T09:12:03.190 INFO:tasks.ceph.mon.a.smithi053.stderr: 2024-04-25T09:12:03.204 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:03.217+0000 7f9e11e33000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:12:03.455 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:03.468+0000 7f9e11e33000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:12:03.501 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:03.514+0000 7f9e11e33000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:12:03.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.993+0000 7fd8d27fc640 1 -- 172.21.15.53:0/2543160710 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7fd8d800fd80 con 0x7fd8dc09ee40 2024-04-25T09:12:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.994+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/2543160710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09ee40 msgr2=0x7fd8dc1c9c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.994+0000 7fd8e3a6d640 1 --2- 172.21.15.53:0/2543160710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09ee40 0x7fd8dc1c9c60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.994+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/2543160710 shutdown_connections 2024-04-25T09:12:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.994+0000 7fd8e3a6d640 1 --2- 172.21.15.53:0/2543160710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd8dc09ee40 0x7fd8dc1c9c60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.995+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/2543160710 >> 172.21.15.53:0/2543160710 conn(0x7fd8dc0a3be0 msgr2=0x7fd8dc1bcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.995+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/2543160710 shutdown_connections 2024-04-25T09:12:03.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:03.995+0000 7fd8e3a6d640 1 -- 172.21.15.53:0/2543160710 wait complete. 2024-04-25T09:12:03.997 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T09:12:03.997 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:12:03.997 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T09:12:04.025 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:12:04.025 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T09:12:04.092 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:12:04.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T09:12:04.116 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-04-25T09:12:04.116 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T09:12:04.180 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 1f07b6c3-dbda-4185-b49a-db14623145f8 0 2024-04-25T09:12:04.208 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:04.221+0000 7f9e11e33000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:12:04.303 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:04.316+0000 7f9e11e33000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:12:04.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.321+0000 7f4234a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:04.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.327+0000 7f4234a6d640 1 Processor -- start 2024-04-25T09:12:04.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.327+0000 7f4234a6d640 1 -- start start 2024-04-25T09:12:04.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.328+0000 7f4234a6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f423011c640 0x7f423011ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.328+0000 7f4234a6d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f423011f030 con 0x7f4230113990 2024-04-25T09:12:04.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.328+0000 7f4234a6d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f42301201d0 con 0x7f423011c640 2024-04-25T09:12:04.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.328+0000 7f422dd9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f423011c640 0x7f423011ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.328+0000 7f422e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4230113990 0x7f4230113da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.151:38598/0 (socket says 172.21.15.151:38598) 2024-04-25T09:12:04.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.328+0000 7f422e59c640 1 -- 172.21.15.151:0/826452836 learned_addr learned my addr 172.21.15.151:0/826452836 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-04-25T09:12:04.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.329+0000 7f422dd9b640 1 -- 172.21.15.151:0/826452836 >> v1:172.21.15.53:6789/0 conn(0x7f4230113990 legacy=0x7f4230113da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.329+0000 7f422dd9b640 1 -- 172.21.15.151:0/826452836 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4230120310 con 0x7f423011c640 2024-04-25T09:12:04.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.329+0000 7f422dd9b640 1 --2- 172.21.15.151:0/826452836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f423011c640 0x7f423011ea60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f480300ac5a7511d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.329+0000 7f422d59a640 1 -- 172.21.15.151:0/826452836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4220009d90 con 0x7f423011c640 2024-04-25T09:12:04.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.329+0000 7f422d59a640 1 -- 172.21.15.151:0/826452836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f422000e230 con 0x7f423011c640 2024-04-25T09:12:04.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.329+0000 7f422d59a640 1 -- 172.21.15.151:0/826452836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f422000e4d0 con 0x7f423011c640 2024-04-25T09:12:04.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.330+0000 7f4234a6d640 1 -- 172.21.15.151:0/826452836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f423011c640 msgr2=0x7f423011ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.330+0000 7f4234a6d640 1 --2- 172.21.15.151:0/826452836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f423011c640 0x7f423011ea60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.330+0000 7f4234a6d640 1 -- 172.21.15.151:0/826452836 shutdown_connections 2024-04-25T09:12:04.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.330+0000 7f4234a6d640 1 --2- 172.21.15.151:0/826452836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f423011c640 0x7f423011ea60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.330+0000 7f4234a6d640 1 -- 172.21.15.151:0/826452836 >> 172.21.15.151:0/826452836 conn(0x7f423006eda0 msgr2=0x7f4230111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.330+0000 7f4234a6d640 1 -- 172.21.15.151:0/826452836 shutdown_connections 2024-04-25T09:12:04.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.330+0000 7f4234a6d640 1 -- 172.21.15.151:0/826452836 wait complete. 2024-04-25T09:12:04.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.330+0000 7f4234a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.331+0000 7f4234a6d640 1 Processor -- start 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.331+0000 7f4234a6d640 1 -- start start 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.331+0000 7f4234a6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4230113990 0x7f42301ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.331+0000 7f4234a6d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f42301ae6d0 con 0x7f4230113990 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f422e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4230113990 0x7f42301ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f422e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4230113990 0x7f42301ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.151:44752/0 (socket says 172.21.15.151:44752) 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f422e59c640 1 -- 172.21.15.151:0/1913723665 learned_addr learned my addr 172.21.15.151:0/1913723665 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f422e59c640 1 -- 172.21.15.151:0/1913723665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42301ae810 con 0x7f4230113990 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f422e59c640 1 --2- 172.21.15.151:0/1913723665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4230113990 0x7f42301ae100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f421effd640 1 -- 172.21.15.151:0/1913723665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4224005a60 con 0x7f4230113990 2024-04-25T09:12:04.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f421effd640 1 -- 172.21.15.151:0/1913723665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4224005bc0 con 0x7f4230113990 2024-04-25T09:12:04.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f4234a6d640 1 -- 172.21.15.151:0/1913723665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42301aea60 con 0x7f4230113990 2024-04-25T09:12:04.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f421effd640 1 -- 172.21.15.151:0/1913723665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4224005e60 con 0x7f4230113990 2024-04-25T09:12:04.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.332+0000 7f4234a6d640 1 -- 172.21.15.151:0/1913723665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42301a84e0 con 0x7f4230113990 2024-04-25T09:12:04.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.333+0000 7f421effd640 1 -- 172.21.15.151:0/1913723665 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f422400cbb0 con 0x7f4230113990 2024-04-25T09:12:04.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.333+0000 7f421effd640 1 -- 172.21.15.151:0/1913723665 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f422400fa80 con 0x7f4230113990 2024-04-25T09:12:04.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.333+0000 7f4234a6d640 1 -- 172.21.15.151:0/1913723665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4230063880 con 0x7f4230113990 2024-04-25T09:12:04.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.336+0000 7f421effd640 1 -- 172.21.15.151:0/1913723665 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f422400f2e0 con 0x7f4230113990 2024-04-25T09:12:04.349 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:04.362+0000 7f9e11e33000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:12:04.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.408+0000 7f4234a6d640 1 -- 172.21.15.151:0/1913723665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1f07b6c3-dbda-4185-b49a-db14623145f8", "id": 0} v 0) -- 0x7f423011c710 con 0x7f4230113990 2024-04-25T09:12:04.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.409+0000 7f421effd640 1 -- 172.21.15.151:0/1913723665 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f07b6c3-dbda-4185-b49a-db14623145f8", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f422400fe30 con 0x7f4230113990 2024-04-25T09:12:04.397 INFO:teuthology.orchestra.run.smithi151.stdout:0 2024-04-25T09:12:04.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.410+0000 7f4234a6d640 1 -- 172.21.15.151:0/1913723665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4230113990 msgr2=0x7f42301ae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.410+0000 7f4234a6d640 1 --2- 172.21.15.151:0/1913723665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4230113990 0x7f42301ae100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.410+0000 7f4234a6d640 1 -- 172.21.15.151:0/1913723665 shutdown_connections 2024-04-25T09:12:04.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.410+0000 7f4234a6d640 1 --2- 172.21.15.151:0/1913723665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4230113990 0x7f42301ae100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.410+0000 7f4234a6d640 1 -- 172.21.15.151:0/1913723665 >> 172.21.15.151:0/1913723665 conn(0x7f423006eda0 msgr2=0x7f423011dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.410+0000 7f4234a6d640 1 -- 172.21.15.151:0/1913723665 shutdown_connections 2024-04-25T09:12:04.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.410+0000 7f4234a6d640 1 -- 172.21.15.151:0/1913723665 wait complete. 2024-04-25T09:12:04.408 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new b2fcfcb4-83c0-4dac-bb3f-2f82dc63d670 1 2024-04-25T09:12:04.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.521+0000 7fe2d231d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:04.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.528+0000 7fe2d231d640 1 Processor -- start 2024-04-25T09:12:04.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.528+0000 7fe2d231d640 1 -- start start 2024-04-25T09:12:04.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.528+0000 7fe2d231d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe2cc113990 0x7fe2cc113da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.528+0000 7fe2d231d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2cc114560 con 0x7fe2cc118370 2024-04-25T09:12:04.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.528+0000 7fe2d231d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe2cc118eb0 con 0x7fe2cc113990 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2cbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe2cc113990 0x7fe2cc113da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2cb7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe2cc118370 0x7fe2cc118780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.151:38606/0 (socket says 172.21.15.151:38606) 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2cbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe2cc113990 0x7fe2cc113da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.151:44768/0 (socket says 172.21.15.151:44768) 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2cb7fe640 1 -- 172.21.15.151:0/1908187567 learned_addr learned my addr 172.21.15.151:0/1908187567 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2cbfff640 1 -- 172.21.15.151:0/1908187567 >> v1:172.21.15.53:6789/0 conn(0x7fe2cc118370 legacy=0x7fe2cc118780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2cbfff640 1 -- 172.21.15.151:0/1908187567 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc119020 con 0x7fe2cc113990 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2cbfff640 1 --2- 172.21.15.151:0/1908187567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 0x7fe2cc113da0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7e98b762be6d80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2caffd640 1 -- 172.21.15.151:0/1908187567 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe2bc009d90 con 0x7fe2cc113990 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2caffd640 1 -- 172.21.15.151:0/1908187567 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe2bc00e230 con 0x7fe2cc113990 2024-04-25T09:12:04.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.529+0000 7fe2caffd640 1 -- 172.21.15.151:0/1908187567 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe2bc00e4d0 con 0x7fe2cc113990 2024-04-25T09:12:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.530+0000 7fe2d231d640 1 -- 172.21.15.151:0/1908187567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 msgr2=0x7fe2cc113da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.530+0000 7fe2d231d640 1 --2- 172.21.15.151:0/1908187567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 0x7fe2cc113da0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.530+0000 7fe2d231d640 1 -- 172.21.15.151:0/1908187567 shutdown_connections 2024-04-25T09:12:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.530+0000 7fe2d231d640 1 --2- 172.21.15.151:0/1908187567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 0x7fe2cc113da0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.530+0000 7fe2d231d640 1 -- 172.21.15.151:0/1908187567 >> 172.21.15.151:0/1908187567 conn(0x7fe2cc06eda0 msgr2=0x7fe2cc111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.530+0000 7fe2d231d640 1 -- 172.21.15.151:0/1908187567 shutdown_connections 2024-04-25T09:12:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.530+0000 7fe2d231d640 1 -- 172.21.15.151:0/1908187567 wait complete. 2024-04-25T09:12:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.530+0000 7fe2d231d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.531+0000 7fe2d231d640 1 Processor -- start 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.531+0000 7fe2d231d640 1 -- start start 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.532+0000 7fe2d231d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 0x7fe2cc1ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.532+0000 7fe2d231d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe2cc1ae680 con 0x7fe2cc113990 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.532+0000 7fe2cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 0x7fe2cc1ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.532+0000 7fe2cbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 0x7fe2cc1ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.151:44776/0 (socket says 172.21.15.151:44776) 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.532+0000 7fe2cbfff640 1 -- 172.21.15.151:0/3374005307 learned_addr learned my addr 172.21.15.151:0/3374005307 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.532+0000 7fe2cbfff640 1 -- 172.21.15.151:0/3374005307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc1ae7c0 con 0x7fe2cc113990 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.532+0000 7fe2cbfff640 1 --2- 172.21.15.151:0/3374005307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 0x7fe2cc1ae0b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.533+0000 7fe2c8ff9640 1 -- 172.21.15.151:0/3374005307 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe2bc014750 con 0x7fe2cc113990 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.533+0000 7fe2c8ff9640 1 -- 172.21.15.151:0/3374005307 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe2bc0148b0 con 0x7fe2cc113990 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.533+0000 7fe2c8ff9640 1 -- 172.21.15.151:0/3374005307 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe2bc014b50 con 0x7fe2cc113990 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.533+0000 7fe2d231d640 1 -- 172.21.15.151:0/3374005307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2cc1ae9b0 con 0x7fe2cc113990 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.533+0000 7fe2d231d640 1 -- 172.21.15.151:0/3374005307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2cc1a8490 con 0x7fe2cc113990 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.533+0000 7fe2c8ff9640 1 -- 172.21.15.151:0/3374005307 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fe2bc013790 con 0x7fe2cc113990 2024-04-25T09:12:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.533+0000 7fe2c8ff9640 1 -- 172.21.15.151:0/3374005307 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7fe2bc019040 con 0x7fe2cc113990 2024-04-25T09:12:04.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.534+0000 7fe2d231d640 1 -- 172.21.15.151:0/3374005307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2cc1aeba0 con 0x7fe2cc113990 2024-04-25T09:12:04.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.536+0000 7fe2c8ff9640 1 -- 172.21.15.151:0/3374005307 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7fe2bc014d00 con 0x7fe2cc113990 2024-04-25T09:12:04.530 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:04.540+0000 7f9e11e33000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:12:04.577 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:04.590+0000 7f9e11e33000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:12:04.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.609+0000 7fe2d231d640 1 -- 172.21.15.151:0/3374005307 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b2fcfcb4-83c0-4dac-bb3f-2f82dc63d670", "id": 1} v 0) -- 0x7fe2cc1183a0 con 0x7fe2cc113990 2024-04-25T09:12:04.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.611+0000 7fe2c8ff9640 1 -- 172.21.15.151:0/3374005307 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b2fcfcb4-83c0-4dac-bb3f-2f82dc63d670", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7fe2bc013c20 con 0x7fe2cc113990 2024-04-25T09:12:04.598 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-04-25T09:12:04.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.612+0000 7fe2d231d640 1 -- 172.21.15.151:0/3374005307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 msgr2=0x7fe2cc1ae0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.612+0000 7fe2d231d640 1 --2- 172.21.15.151:0/3374005307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 0x7fe2cc1ae0b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.612+0000 7fe2d231d640 1 -- 172.21.15.151:0/3374005307 shutdown_connections 2024-04-25T09:12:04.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.612+0000 7fe2d231d640 1 --2- 172.21.15.151:0/3374005307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe2cc113990 0x7fe2cc1ae0b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.612+0000 7fe2d231d640 1 -- 172.21.15.151:0/3374005307 >> 172.21.15.151:0/3374005307 conn(0x7fe2cc06eda0 msgr2=0x7fe2cc111fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.612+0000 7fe2d231d640 1 -- 172.21.15.151:0/3374005307 shutdown_connections 2024-04-25T09:12:04.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.612+0000 7fe2d231d640 1 -- 172.21.15.151:0/3374005307 wait complete. 2024-04-25T09:12:04.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 71a08380-1b88-46bf-88ed-1d1f06dac230 2 2024-04-25T09:12:04.633 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:04.646+0000 7f9e11e33000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:12:04.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.723+0000 7f31affd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:04.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.729+0000 7f31affd7640 1 Processor -- start 2024-04-25T09:12:04.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.729+0000 7f31affd7640 1 -- start start 2024-04-25T09:12:04.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.730+0000 7f31affd7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f31a811c640 0x7f31a811ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.730+0000 7f31affd7640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a811f030 con 0x7f31a8113990 2024-04-25T09:12:04.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.730+0000 7f31affd7640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f31a81201d0 con 0x7f31a811c640 2024-04-25T09:12:04.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.730+0000 7f31ad572640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f31a811c640 0x7f31a811ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.730+0000 7f31ad572640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f31a811c640 0x7f31a811ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.151:44780/0 (socket says 172.21.15.151:44780) 2024-04-25T09:12:04.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.730+0000 7f31ad572640 1 -- 172.21.15.151:0/1865963980 learned_addr learned my addr 172.21.15.151:0/1865963980 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-04-25T09:12:04.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.731+0000 7f31ad572640 1 -- 172.21.15.151:0/1865963980 >> v1:172.21.15.53:6789/0 conn(0x7f31a8113990 legacy=0x7f31a8113da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.731+0000 7f31ad572640 1 -- 172.21.15.151:0/1865963980 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a8120310 con 0x7f31a811c640 2024-04-25T09:12:04.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.731+0000 7f31ad572640 1 --2- 172.21.15.151:0/1865963980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a811c640 0x7f31a811ea60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a1b5e86ed7a324 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.731+0000 7f31acd71640 1 -- 172.21.15.151:0/1865963980 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3198009e50 con 0x7f31a811c640 2024-04-25T09:12:04.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.731+0000 7f31acd71640 1 -- 172.21.15.151:0/1865963980 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f319800e230 con 0x7f31a811c640 2024-04-25T09:12:04.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.731+0000 7f31acd71640 1 -- 172.21.15.151:0/1865963980 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f319800e4d0 con 0x7f31a811c640 2024-04-25T09:12:04.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.732+0000 7f31affd7640 1 -- 172.21.15.151:0/1865963980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a811c640 msgr2=0x7f31a811ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.732+0000 7f31affd7640 1 --2- 172.21.15.151:0/1865963980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a811c640 0x7f31a811ea60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.732+0000 7f31affd7640 1 -- 172.21.15.151:0/1865963980 shutdown_connections 2024-04-25T09:12:04.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.732+0000 7f31affd7640 1 --2- 172.21.15.151:0/1865963980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a811c640 0x7f31a811ea60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.732+0000 7f31affd7640 1 -- 172.21.15.151:0/1865963980 >> 172.21.15.151:0/1865963980 conn(0x7f31a806eda0 msgr2=0x7f31a8111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.732+0000 7f31affd7640 1 -- 172.21.15.151:0/1865963980 shutdown_connections 2024-04-25T09:12:04.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.732+0000 7f31affd7640 1 -- 172.21.15.151:0/1865963980 wait complete. 2024-04-25T09:12:04.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.732+0000 7f31affd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:04.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.733+0000 7f31affd7640 1 Processor -- start 2024-04-25T09:12:04.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.733+0000 7f31affd7640 1 -- start start 2024-04-25T09:12:04.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.733+0000 7f31affd7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a8113990 0x7f31a81ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.733+0000 7f31affd7640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f31a81ae6d0 con 0x7f31a8113990 2024-04-25T09:12:04.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.733+0000 7f31add73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a8113990 0x7f31a81ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.733+0000 7f31add73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a8113990 0x7f31a81ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.151:44790/0 (socket says 172.21.15.151:44790) 2024-04-25T09:12:04.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.733+0000 7f31add73640 1 -- 172.21.15.151:0/3819502838 learned_addr learned my addr 172.21.15.151:0/3819502838 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-04-25T09:12:04.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.734+0000 7f31add73640 1 -- 172.21.15.151:0/3819502838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a81ae810 con 0x7f31a8113990 2024-04-25T09:12:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.734+0000 7f31add73640 1 --2- 172.21.15.151:0/3819502838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a8113990 0x7f31a81ae100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.734+0000 7f319e7fc640 1 -- 172.21.15.151:0/3819502838 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f31a400c910 con 0x7f31a8113990 2024-04-25T09:12:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.734+0000 7f319e7fc640 1 -- 172.21.15.151:0/3819502838 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f31a400ca70 con 0x7f31a8113990 2024-04-25T09:12:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.734+0000 7f31affd7640 1 -- 172.21.15.151:0/3819502838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a81aea60 con 0x7f31a8113990 2024-04-25T09:12:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.734+0000 7f319e7fc640 1 -- 172.21.15.151:0/3819502838 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f31a400cd10 con 0x7f31a8113990 2024-04-25T09:12:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.734+0000 7f31affd7640 1 -- 172.21.15.151:0/3819502838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a81a84e0 con 0x7f31a8113990 2024-04-25T09:12:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.734+0000 7f319e7fc640 1 -- 172.21.15.151:0/3819502838 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f31a40116a0 con 0x7f31a8113990 2024-04-25T09:12:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.734+0000 7f319e7fc640 1 -- 172.21.15.151:0/3819502838 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7f31a4010e60 con 0x7f31a8113990 2024-04-25T09:12:04.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.735+0000 7f31affd7640 1 -- 172.21.15.151:0/3819502838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a8063880 con 0x7f31a8113990 2024-04-25T09:12:04.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.738+0000 7f319e7fc640 1 -- 172.21.15.151:0/3819502838 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f31a4010a20 con 0x7f31a8113990 2024-04-25T09:12:04.754 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:04.767+0000 7f9e11e33000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:12:04.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.811+0000 7f31affd7640 1 -- 172.21.15.151:0/3819502838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "71a08380-1b88-46bf-88ed-1d1f06dac230", "id": 2} v 0) -- 0x7f31a811c710 con 0x7f31a8113990 2024-04-25T09:12:04.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.812+0000 7f319e7fc640 1 -- 172.21.15.151:0/3819502838 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71a08380-1b88-46bf-88ed-1d1f06dac230", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7f31a4010bc0 con 0x7f31a8113990 2024-04-25T09:12:04.800 INFO:teuthology.orchestra.run.smithi151.stdout:2 2024-04-25T09:12:04.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.813+0000 7f31affd7640 1 -- 172.21.15.151:0/3819502838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a8113990 msgr2=0x7f31a81ae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.813+0000 7f31affd7640 1 --2- 172.21.15.151:0/3819502838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a8113990 0x7f31a81ae100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.814+0000 7f31affd7640 1 -- 172.21.15.151:0/3819502838 shutdown_connections 2024-04-25T09:12:04.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.814+0000 7f31affd7640 1 --2- 172.21.15.151:0/3819502838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31a8113990 0x7f31a81ae100 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.814+0000 7f31affd7640 1 -- 172.21.15.151:0/3819502838 >> 172.21.15.151:0/3819502838 conn(0x7f31a806eda0 msgr2=0x7f31a811dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.814+0000 7f31affd7640 1 -- 172.21.15.151:0/3819502838 shutdown_connections 2024-04-25T09:12:04.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.814+0000 7f31affd7640 1 -- 172.21.15.151:0/3819502838 wait complete. 2024-04-25T09:12:04.811 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new a59b2717-6d15-45cd-acf1-73867afba713 3 2024-04-25T09:12:04.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.965+0000 7fad33f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:04.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.971+0000 7fad33f5d640 1 Processor -- start 2024-04-25T09:12:04.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.971+0000 7fad33f5d640 1 -- start start 2024-04-25T09:12:04.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.972+0000 7fad33f5d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fad2c113990 0x7fad2c113da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.972+0000 7fad33f5d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2c114560 con 0x7fad2c118370 2024-04-25T09:12:04.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.972+0000 7fad33f5d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fad2c118eb0 con 0x7fad2c113990 2024-04-25T09:12:04.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.972+0000 7fad31cf9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fad2c113990 0x7fad2c113da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.972+0000 7fad314f8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fad2c118370 0x7fad2c118780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.151:38622/0 (socket says 172.21.15.151:38622) 2024-04-25T09:12:04.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.972+0000 7fad314f8640 1 -- 172.21.15.151:0/3060254150 learned_addr learned my addr 172.21.15.151:0/3060254150 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-04-25T09:12:04.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.972+0000 7fad31cf9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fad2c113990 0x7fad2c113da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.151:44800/0 (socket says 172.21.15.151:44800) 2024-04-25T09:12:04.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.973+0000 7fad31cf9640 1 -- 172.21.15.151:0/3060254150 >> v1:172.21.15.53:6789/0 conn(0x7fad2c118370 legacy=0x7fad2c118780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.973+0000 7fad31cf9640 1 -- 172.21.15.151:0/3060254150 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c119020 con 0x7fad2c113990 2024-04-25T09:12:04.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.973+0000 7fad31cf9640 1 --2- 172.21.15.151:0/3060254150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 0x7fad2c113da0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abbaad542ac05e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.973+0000 7fad30cf7640 1 -- 172.21.15.151:0/3060254150 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad1c009d90 con 0x7fad2c113990 2024-04-25T09:12:04.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.973+0000 7fad30cf7640 1 -- 172.21.15.151:0/3060254150 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fad1c00e230 con 0x7fad2c113990 2024-04-25T09:12:04.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.973+0000 7fad30cf7640 1 -- 172.21.15.151:0/3060254150 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad1c00e4d0 con 0x7fad2c113990 2024-04-25T09:12:04.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.974+0000 7fad33f5d640 1 -- 172.21.15.151:0/3060254150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 msgr2=0x7fad2c113da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.974+0000 7fad33f5d640 1 --2- 172.21.15.151:0/3060254150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 0x7fad2c113da0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.974+0000 7fad33f5d640 1 -- 172.21.15.151:0/3060254150 shutdown_connections 2024-04-25T09:12:04.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.974+0000 7fad33f5d640 1 --2- 172.21.15.151:0/3060254150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 0x7fad2c113da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.974+0000 7fad33f5d640 1 -- 172.21.15.151:0/3060254150 >> 172.21.15.151:0/3060254150 conn(0x7fad2c06eda0 msgr2=0x7fad2c111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.974+0000 7fad33f5d640 1 -- 172.21.15.151:0/3060254150 shutdown_connections 2024-04-25T09:12:04.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.974+0000 7fad33f5d640 1 -- 172.21.15.151:0/3060254150 wait complete. 2024-04-25T09:12:04.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.974+0000 7fad33f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:04.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.975+0000 7fad33f5d640 1 Processor -- start 2024-04-25T09:12:04.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.975+0000 7fad33f5d640 1 -- start start 2024-04-25T09:12:04.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.975+0000 7fad33f5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 0x7fad2c1ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.975+0000 7fad33f5d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c1ae680 con 0x7fad2c113990 2024-04-25T09:12:04.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad31cf9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 0x7fad2c1ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad31cf9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 0x7fad2c1ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.151:44802/0 (socket says 172.21.15.151:44802) 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad31cf9640 1 -- 172.21.15.151:0/1594767696 learned_addr learned my addr 172.21.15.151:0/1594767696 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad31cf9640 1 -- 172.21.15.151:0/1594767696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c1ae7c0 con 0x7fad2c113990 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad31cf9640 1 --2- 172.21.15.151:0/1594767696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 0x7fad2c1ae0b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad227fc640 1 -- 172.21.15.151:0/1594767696 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad1c014750 con 0x7fad2c113990 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad227fc640 1 -- 172.21.15.151:0/1594767696 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fad1c0148b0 con 0x7fad2c113990 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad33f5d640 1 -- 172.21.15.151:0/1594767696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2c1ae9b0 con 0x7fad2c113990 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad227fc640 1 -- 172.21.15.151:0/1594767696 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad1c014b50 con 0x7fad2c113990 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad33f5d640 1 -- 172.21.15.151:0/1594767696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad2c1a8490 con 0x7fad2c113990 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.976+0000 7fad227fc640 1 -- 172.21.15.151:0/1594767696 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fad1c013790 con 0x7fad2c113990 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.977+0000 7fad227fc640 1 -- 172.21.15.151:0/1594767696 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7fad1c019040 con 0x7fad2c113990 2024-04-25T09:12:04.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.977+0000 7fad33f5d640 1 -- 172.21.15.151:0/1594767696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad2c1aeba0 con 0x7fad2c113990 2024-04-25T09:12:04.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:04.980+0000 7fad227fc640 1 -- 172.21.15.151:0/1594767696 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7fad1c014d00 con 0x7fad2c113990 2024-04-25T09:12:05.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:05.052+0000 7fad33f5d640 1 -- 172.21.15.151:0/1594767696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a59b2717-6d15-45cd-acf1-73867afba713", "id": 3} v 0) -- 0x7fad2c1183a0 con 0x7fad2c113990 2024-04-25T09:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:05.053+0000 7fad227fc640 1 -- 172.21.15.151:0/1594767696 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a59b2717-6d15-45cd-acf1-73867afba713", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7fad1c013c20 con 0x7fad2c113990 2024-04-25T09:12:05.041 INFO:teuthology.orchestra.run.smithi151.stdout:3 2024-04-25T09:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:05.054+0000 7fad33f5d640 1 -- 172.21.15.151:0/1594767696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 msgr2=0x7fad2c1ae0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:05.054+0000 7fad33f5d640 1 --2- 172.21.15.151:0/1594767696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 0x7fad2c1ae0b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:05.054+0000 7fad33f5d640 1 -- 172.21.15.151:0/1594767696 shutdown_connections 2024-04-25T09:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:05.054+0000 7fad33f5d640 1 --2- 172.21.15.151:0/1594767696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad2c113990 0x7fad2c1ae0b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:05.054+0000 7fad33f5d640 1 -- 172.21.15.151:0/1594767696 >> 172.21.15.151:0/1594767696 conn(0x7fad2c06eda0 msgr2=0x7fad2c111fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:05.054+0000 7fad33f5d640 1 -- 172.21.15.151:0/1594767696 shutdown_connections 2024-04-25T09:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-04-25T09:12:05.054+0000 7fad33f5d640 1 -- 172.21.15.151:0/1594767696 wait complete. 2024-04-25T09:12:05.052 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-04-25T09:12:05.087 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T09:12:05.087 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-04-25T09:12:05.130 INFO:tasks.ceph.osd.0:Started 2024-04-25T09:12:05.130 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-04-25T09:12:05.155 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:05.168+0000 7f9e11e33000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T09:12:05.162 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T09:12:05.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-04-25T09:12:05.205 INFO:tasks.ceph.osd.1:Started 2024-04-25T09:12:05.205 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-04-25T09:12:05.234 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T09:12:05.234 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-04-25T09:12:05.276 INFO:tasks.ceph.osd.2:Started 2024-04-25T09:12:05.276 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-04-25T09:12:05.304 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T09:12:05.304 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-04-25T09:12:05.346 INFO:tasks.ceph.osd.3:Started 2024-04-25T09:12:05.347 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:05.432 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:05.445+0000 7f9e11e33000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:12:05.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.473+0000 7f5ed1c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:05.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.479+0000 7f5ed1c2d640 1 Processor -- start 2024-04-25T09:12:05.467 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.479+0000 7f5ed1c2d640 1 -- start start 2024-04-25T09:12:05.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.480+0000 7f5ed1c2d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ecc09ee40 0x7f5ecc09f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.480+0000 7f5ed1c2d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ecc06f0b0 con 0x7f5ecc09f790 2024-04-25T09:12:05.469 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.480+0000 7f5ed1c2d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5ecc073c50 con 0x7f5ecc09ee40 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.480+0000 7f5ecb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5ecc09ee40 0x7f5ecc09f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.480+0000 7f5ec3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5ecc09f790 0x7f5ecc1316d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45020/0 (socket says 172.21.15.53:45020) 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.480+0000 7f5ec3fff640 1 -- 172.21.15.53:0/140691328 learned_addr learned my addr 172.21.15.53:0/140691328 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.481+0000 7f5ecb7fe640 1 -- 172.21.15.53:0/140691328 >> v1:172.21.15.53:6789/0 conn(0x7f5ecc09f790 legacy=0x7f5ecc1316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.481+0000 7f5ecb7fe640 1 -- 172.21.15.53:0/140691328 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc0a1120 con 0x7f5ecc09ee40 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.481+0000 7f5ecaffd640 1 -- 172.21.15.53:0/140691328 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2233549430 0 0) 0x7f5ecc06f0b0 con 0x7f5ecc09f790 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.481+0000 7f5ecb7fe640 1 --2- 172.21.15.53:0/140691328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 0x7f5ecc09f250 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfc2ffa8d74c5f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.481+0000 7f5ecaffd640 1 -- 172.21.15.53:0/140691328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5ebc009d90 con 0x7f5ecc09ee40 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.481+0000 7f5ecaffd640 1 -- 172.21.15.53:0/140691328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5ebc00e230 con 0x7f5ecc09ee40 2024-04-25T09:12:05.470 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.481+0000 7f5ecaffd640 1 -- 172.21.15.53:0/140691328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5ebc00e4d0 con 0x7f5ecc09ee40 2024-04-25T09:12:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.482+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/140691328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 msgr2=0x7f5ecc09f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.482+0000 7f5ed1c2d640 1 --2- 172.21.15.53:0/140691328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 0x7f5ecc09f250 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.482+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/140691328 shutdown_connections 2024-04-25T09:12:05.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.482+0000 7f5ed1c2d640 1 --2- 172.21.15.53:0/140691328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 0x7f5ecc09f250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.482+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/140691328 >> 172.21.15.53:0/140691328 conn(0x7f5ecc0a3be0 msgr2=0x7f5ecc0a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.482+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/140691328 shutdown_connections 2024-04-25T09:12:05.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.482+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/140691328 wait complete. 2024-04-25T09:12:05.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.482+0000 7f5ed1c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:05.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.484+0000 7f5ed1c2d640 1 Processor -- start 2024-04-25T09:12:05.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.484+0000 7f5ed1c2d640 1 -- start start 2024-04-25T09:12:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.486+0000 7f5ed1c2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 0x7f5ecc11e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.486+0000 7f5ed1c2d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc120740 con 0x7f5ecc09ee40 2024-04-25T09:12:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.486+0000 7f5ecb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 0x7f5ecc11e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.486+0000 7f5ecb7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 0x7f5ecc11e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52814/0 (socket says 172.21.15.53:52814) 2024-04-25T09:12:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.486+0000 7f5ecb7fe640 1 -- 172.21.15.53:0/3465270106 learned_addr learned my addr 172.21.15.53:0/3465270106 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.486+0000 7f5ecb7fe640 1 -- 172.21.15.53:0/3465270106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc11f700 con 0x7f5ecc09ee40 2024-04-25T09:12:05.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.486+0000 7f5ecb7fe640 1 --2- 172.21.15.53:0/3465270106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 0x7f5ecc11e5e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.486+0000 7f5ec8ff9640 1 -- 172.21.15.53:0/3465270106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5ebc014620 con 0x7f5ecc09ee40 2024-04-25T09:12:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.487+0000 7f5ec8ff9640 1 -- 172.21.15.53:0/3465270106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5ebc014780 con 0x7f5ecc09ee40 2024-04-25T09:12:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.487+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/3465270106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ecc122230 con 0x7f5ecc09ee40 2024-04-25T09:12:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.487+0000 7f5ec8ff9640 1 -- 172.21.15.53:0/3465270106 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5ebc014a20 con 0x7f5ecc09ee40 2024-04-25T09:12:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.487+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/3465270106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ecc120e90 con 0x7f5ecc09ee40 2024-04-25T09:12:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.487+0000 7f5ec8ff9640 1 -- 172.21.15.53:0/3465270106 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f5ebc013400 con 0x7f5ecc09ee40 2024-04-25T09:12:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.487+0000 7f5ec8ff9640 1 -- 172.21.15.53:0/3465270106 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f5ebc019040 con 0x7f5ecc09ee40 2024-04-25T09:12:05.476 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.488+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/3465270106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ecc120a00 con 0x7f5ecc09ee40 2024-04-25T09:12:05.477 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.490+0000 7f5ec8ff9640 1 -- 172.21.15.53:0/3465270106 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f5ebc011c60 con 0x7f5ecc09ee40 2024-04-25T09:12:05.492 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:05.505+0000 7f9e11e33000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:12:05.540 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.553+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/3465270106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ecc063880 con 0x7f5ecc09ee40 2024-04-25T09:12:05.541 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.553+0000 7f5ec8ff9640 1 -- 172.21.15.53:0/3465270106 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f5ebc0116a0 con 0x7f5ecc09ee40 2024-04-25T09:12:05.541 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:12:05.541 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":7,"fsid":"12417946-fe70-462a-890a-9259fe1aeb83","created":"2024-04-25T09:12:02.900066+0000","modified":"2024-04-25T09:12:05.054144+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:12:05.054144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"1f07b6c3-dbda-4185-b49a-db14623145f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b2fcfcb4-83c0-4dac-bb3f-2f82dc63d670","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"71a08380-1b88-46bf-88ed-1d1f06dac230","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a59b2717-6d15-45cd-acf1-73867afba713","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.554+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/3465270106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 msgr2=0x7f5ecc11e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.554+0000 7f5ed1c2d640 1 --2- 172.21.15.53:0/3465270106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 0x7f5ecc11e5e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.554+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/3465270106 shutdown_connections 2024-04-25T09:12:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.554+0000 7f5ed1c2d640 1 --2- 172.21.15.53:0/3465270106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ecc09ee40 0x7f5ecc11e5e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.554+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/3465270106 >> 172.21.15.53:0/3465270106 conn(0x7f5ecc0a3be0 msgr2=0x7f5ecc1bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.554+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/3465270106 shutdown_connections 2024-04-25T09:12:05.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:05.554+0000 7f5ed1c2d640 1 -- 172.21.15.53:0/3465270106 wait complete. 2024-04-25T09:12:05.553 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T09:12:05.553 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T09:12:05.622 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:05.634+0000 7f9e11e33000 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T09:12:05.920 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:05.933+0000 7f9e11e33000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:12:05.957 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:05.974 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:05.987+0000 7f9e11e33000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:12:06.063 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.071+0000 7f2739d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:06.064 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.076+0000 7f2739d9d640 1 Processor -- start 2024-04-25T09:12:06.064 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.076+0000 7f2739d9d640 1 -- start start 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.078+0000 7f2739d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27340a2130 0x7f27340a2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.078+0000 7f2739d9d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27340a1260 con 0x7f2734134a80 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.078+0000 7f2739d9d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f27340a3450 con 0x7f27340a2130 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.078+0000 7f27337fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27340a2130 0x7f27340a2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.078+0000 7f2732ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2734134a80 0x7f2734134e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:45022/0 (socket says 172.21.15.53:45022) 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.078+0000 7f27337fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f27340a2130 0x7f27340a2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52830/0 (socket says 172.21.15.53:52830) 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.078+0000 7f2732ffd640 1 -- 172.21.15.53:0/4179596887 learned_addr learned my addr 172.21.15.53:0/4179596887 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.078+0000 7f27337fe640 1 -- 172.21.15.53:0/4179596887 >> v1:172.21.15.53:6789/0 conn(0x7f2734134a80 legacy=0x7f2734134e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.078+0000 7f27337fe640 1 -- 172.21.15.53:0/4179596887 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273409bb80 con 0x7f27340a2130 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.079+0000 7f27337fe640 1 --2- 172.21.15.53:0/4179596887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 0x7f27340a2540 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb369a3f8ebae8ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.067 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.079+0000 7f27327fc640 1 -- 172.21.15.53:0/4179596887 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2724009d90 con 0x7f27340a2130 2024-04-25T09:12:06.068 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.079+0000 7f27327fc640 1 -- 172.21.15.53:0/4179596887 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f272400e230 con 0x7f27340a2130 2024-04-25T09:12:06.068 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.079+0000 7f27327fc640 1 -- 172.21.15.53:0/4179596887 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f272400e4d0 con 0x7f27340a2130 2024-04-25T09:12:06.068 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.080+0000 7f2739d9d640 1 -- 172.21.15.53:0/4179596887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 msgr2=0x7f27340a2540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.069 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.080+0000 7f2739d9d640 1 --2- 172.21.15.53:0/4179596887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 0x7f27340a2540 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.069 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.080+0000 7f2739d9d640 1 -- 172.21.15.53:0/4179596887 shutdown_connections 2024-04-25T09:12:06.069 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.080+0000 7f2739d9d640 1 --2- 172.21.15.53:0/4179596887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 0x7f27340a2540 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.069 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.080+0000 7f2739d9d640 1 -- 172.21.15.53:0/4179596887 >> 172.21.15.53:0/4179596887 conn(0x7f27340a3b00 msgr2=0x7f27340a3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.069 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.080+0000 7f2739d9d640 1 -- 172.21.15.53:0/4179596887 shutdown_connections 2024-04-25T09:12:06.069 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.080+0000 7f2739d9d640 1 -- 172.21.15.53:0/4179596887 wait complete. 2024-04-25T09:12:06.069 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.080+0000 7f2739d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:06.069 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.082+0000 7f2739d9d640 1 Processor -- start 2024-04-25T09:12:06.070 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.082+0000 7f2739d9d640 1 -- start start 2024-04-25T09:12:06.071 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.083+0000 7f2739d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 0x7f273411e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.072 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.083+0000 7f2739d9d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f273411e3e0 con 0x7f27340a2130 2024-04-25T09:12:06.072 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.084+0000 7f27337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 0x7f273411e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.072 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.084+0000 7f27337fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 0x7f273411e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52844/0 (socket says 172.21.15.53:52844) 2024-04-25T09:12:06.072 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.084+0000 7f27337fe640 1 -- 172.21.15.53:0/2974674380 learned_addr learned my addr 172.21.15.53:0/2974674380 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:06.073 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.084+0000 7f27337fe640 1 -- 172.21.15.53:0/2974674380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2734120360 con 0x7f27340a2130 2024-04-25T09:12:06.073 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.084+0000 7f27337fe640 1 --2- 172.21.15.53:0/2974674380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 0x7f273411e7a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.073 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.084+0000 7f271bfff640 1 -- 172.21.15.53:0/2974674380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2724014620 con 0x7f27340a2130 2024-04-25T09:12:06.073 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.084+0000 7f271bfff640 1 -- 172.21.15.53:0/2974674380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2724014780 con 0x7f27340a2130 2024-04-25T09:12:06.073 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.085+0000 7f271bfff640 1 -- 172.21.15.53:0/2974674380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2724014a20 con 0x7f27340a2130 2024-04-25T09:12:06.073 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.085+0000 7f2739d9d640 1 -- 172.21.15.53:0/2974674380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273411e040 con 0x7f27340a2130 2024-04-25T09:12:06.073 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.085+0000 7f2739d9d640 1 -- 172.21.15.53:0/2974674380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2734121470 con 0x7f27340a2130 2024-04-25T09:12:06.074 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.085+0000 7f271bfff640 1 -- 172.21.15.53:0/2974674380 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f2724013400 con 0x7f27340a2130 2024-04-25T09:12:06.074 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.085+0000 7f271bfff640 1 -- 172.21.15.53:0/2974674380 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f2724019040 con 0x7f27340a2130 2024-04-25T09:12:06.074 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.086+0000 7f2739d9d640 1 -- 172.21.15.53:0/2974674380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2734063880 con 0x7f27340a2130 2024-04-25T09:12:06.076 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.088+0000 7f271bfff640 1 -- 172.21.15.53:0/2974674380 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f2724011bc0 con 0x7f27340a2130 2024-04-25T09:12:06.139 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.151+0000 7f2739d9d640 1 -- 172.21.15.53:0/2974674380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f273406cc30 con 0x7f27340a2130 2024-04-25T09:12:06.139 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.151+0000 7f271bfff640 1 -- 172.21.15.53:0/2974674380 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f2724011d60 con 0x7f27340a2130 2024-04-25T09:12:06.140 INFO:teuthology.misc.health.smithi053.stdout: 2024-04-25T09:12:06.140 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":7,"fsid":"12417946-fe70-462a-890a-9259fe1aeb83","created":"2024-04-25T09:12:02.900066+0000","modified":"2024-04-25T09:12:05.054144+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:12:05.054144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"1f07b6c3-dbda-4185-b49a-db14623145f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b2fcfcb4-83c0-4dac-bb3f-2f82dc63d670","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"71a08380-1b88-46bf-88ed-1d1f06dac230","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a59b2717-6d15-45cd-acf1-73867afba713","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:06.141 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.152+0000 7f2739d9d640 1 -- 172.21.15.53:0/2974674380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 msgr2=0x7f273411e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.141 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.152+0000 7f2739d9d640 1 --2- 172.21.15.53:0/2974674380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 0x7f273411e7a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.141 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.152+0000 7f2739d9d640 1 -- 172.21.15.53:0/2974674380 shutdown_connections 2024-04-25T09:12:06.141 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.153+0000 7f2739d9d640 1 --2- 172.21.15.53:0/2974674380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27340a2130 0x7f273411e7a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.141 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.153+0000 7f2739d9d640 1 -- 172.21.15.53:0/2974674380 >> 172.21.15.53:0/2974674380 conn(0x7f27340a3b00 msgr2=0x7f27341bccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.141 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.153+0000 7f2739d9d640 1 -- 172.21.15.53:0/2974674380 shutdown_connections 2024-04-25T09:12:06.141 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:06.153+0000 7f2739d9d640 1 -- 172.21.15.53:0/2974674380 wait complete. 2024-04-25T09:12:06.147 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:06.161+0000 7f9e11e33000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:12:06.150 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-25T09:12:06.291 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:06.303+0000 7f9e11e33000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:12:06.346 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:06.358+0000 7f9e11e33000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:12:06.421 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:06.434+0000 7f9e11e33000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:12:06.469 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:06.483+0000 7f9e11e33000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:12:06.974 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:06.987+0000 7f9e11e33000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:12:07.104 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:07.117+0000 7f9e11e33000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:12:08.115 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-04-25T09:12:08.127+0000 7f9db0bc1640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-25T09:12:12.554 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:12.662 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.671+0000 7fe19acad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:12.663 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.677+0000 7fe19acad640 1 Processor -- start 2024-04-25T09:12:12.664 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.677+0000 7fe19acad640 1 -- start start 2024-04-25T09:12:12.666 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.678+0000 7fe19acad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe194137d90 0x7fe19413a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.666 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.678+0000 7fe19acad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1940a1260 con 0x7fe1940a2130 2024-04-25T09:12:12.666 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.678+0000 7fe19acad640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe1940a2c50 con 0x7fe194137d90 2024-04-25T09:12:12.666 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.678+0000 7fe193fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe194137d90 0x7fe19413a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.666 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.678+0000 7fe198a49640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe1940a2130 0x7fe1940a2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60796/0 (socket says 172.21.15.53:60796) 2024-04-25T09:12:12.666 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.678+0000 7fe198a49640 1 -- 172.21.15.53:0/251913570 learned_addr learned my addr 172.21.15.53:0/251913570 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:12.666 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.679+0000 7fe193fff640 1 -- 172.21.15.53:0/251913570 >> v1:172.21.15.53:6789/0 conn(0x7fe1940a2130 legacy=0x7fe1940a2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.667 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.679+0000 7fe193fff640 1 -- 172.21.15.53:0/251913570 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19409bb80 con 0x7fe194137d90 2024-04-25T09:12:12.667 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.679+0000 7fe1937fe640 1 -- 172.21.15.53:0/251913570 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102324683 0 0) 0x7fe1940a1260 con 0x7fe1940a2130 2024-04-25T09:12:12.667 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.679+0000 7fe193fff640 1 --2- 172.21.15.53:0/251913570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe194137d90 0x7fe19413a1b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d9c24edf630d80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.667 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.679+0000 7fe1937fe640 1 -- 172.21.15.53:0/251913570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe180009d90 con 0x7fe194137d90 2024-04-25T09:12:12.667 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.679+0000 7fe1937fe640 1 -- 172.21.15.53:0/251913570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe18000e230 con 0x7fe194137d90 2024-04-25T09:12:12.667 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.679+0000 7fe1937fe640 1 -- 172.21.15.53:0/251913570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe18000e4d0 con 0x7fe194137d90 2024-04-25T09:12:12.668 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.680+0000 7fe19acad640 1 -- 172.21.15.53:0/251913570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe194137d90 msgr2=0x7fe19413a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.668 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.680+0000 7fe19acad640 1 --2- 172.21.15.53:0/251913570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe194137d90 0x7fe19413a1b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.668 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.680+0000 7fe19acad640 1 -- 172.21.15.53:0/251913570 shutdown_connections 2024-04-25T09:12:12.668 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.680+0000 7fe19acad640 1 --2- 172.21.15.53:0/251913570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe194137d90 0x7fe19413a1b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.668 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.680+0000 7fe19acad640 1 -- 172.21.15.53:0/251913570 >> 172.21.15.53:0/251913570 conn(0x7fe1940a3b00 msgr2=0x7fe1940a3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:12.668 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.680+0000 7fe19acad640 1 -- 172.21.15.53:0/251913570 shutdown_connections 2024-04-25T09:12:12.668 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.680+0000 7fe19acad640 1 -- 172.21.15.53:0/251913570 wait complete. 2024-04-25T09:12:12.668 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.680+0000 7fe19acad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:12.669 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.682+0000 7fe19acad640 1 Processor -- start 2024-04-25T09:12:12.669 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.682+0000 7fe19acad640 1 -- start start 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.684+0000 7fe19acad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1940a2130 0x7fe19411f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.684+0000 7fe19acad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe1941209f0 con 0x7fe1940a2130 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.684+0000 7fe198a49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1940a2130 0x7fe19411f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.684+0000 7fe198a49640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1940a2130 0x7fe19411f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45722/0 (socket says 172.21.15.53:45722) 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.684+0000 7fe198a49640 1 -- 172.21.15.53:0/3680659023 learned_addr learned my addr 172.21.15.53:0/3680659023 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.684+0000 7fe198a49640 1 -- 172.21.15.53:0/3680659023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe194121f90 con 0x7fe1940a2130 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.684+0000 7fe198a49640 1 --2- 172.21.15.53:0/3680659023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1940a2130 0x7fe19411f740 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.685+0000 7fe1917fa640 1 -- 172.21.15.53:0/3680659023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe188004b80 con 0x7fe1940a2130 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.685+0000 7fe1917fa640 1 -- 172.21.15.53:0/3680659023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe188004ce0 con 0x7fe1940a2130 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.685+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19411f420 con 0x7fe1940a2130 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.685+0000 7fe1917fa640 1 -- 172.21.15.53:0/3680659023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe188007120 con 0x7fe1940a2130 2024-04-25T09:12:12.672 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.685+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe194122e00 con 0x7fe1940a2130 2024-04-25T09:12:12.673 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.686+0000 7fe1917fa640 1 -- 172.21.15.53:0/3680659023 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7fe1880072d0 con 0x7fe1940a2130 2024-04-25T09:12:12.673 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.686+0000 7fe1917fa640 1 --2- 172.21.15.53:0/3680659023 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe1780388f0 0x7fe17803ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.673 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.686+0000 7fe1917fa640 1 -- 172.21.15.53:0/3680659023 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7fe188048070 con 0x7fe1940a2130 2024-04-25T09:12:12.674 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.686+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19411f230 con 0x7fe1940a2130 2024-04-25T09:12:12.674 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.686+0000 7fe193fff640 1 --2- 172.21.15.53:0/3680659023 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe1780388f0 0x7fe17803ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.674 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.687+0000 7fe193fff640 1 --2- 172.21.15.53:0/3680659023 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe1780388f0 0x7fe17803ae00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.679 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.692+0000 7fe1917fa640 1 -- 172.21.15.53:0/3680659023 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fe18800f230 con 0x7fe1940a2130 2024-04-25T09:12:12.869 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.882+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe194063880 con 0x7fe1940a2130 2024-04-25T09:12:12.869 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.883+0000 7fe1917fa640 1 -- 172.21.15.53:0/3680659023 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6931 (crc 0 0 0) 0x7fe18800a5d0 con 0x7fe1940a2130 2024-04-25T09:12:12.870 INFO:teuthology.misc.health.smithi053.stdout: 2024-04-25T09:12:12.870 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":11,"fsid":"12417946-fe70-462a-890a-9259fe1aeb83","created":"2024-04-25T09:12:02.900066+0000","modified":"2024-04-25T09:12:12.163986+0000","last_up_change":"2024-04-25T09:12:09.155255+0000","last_in_change":"2024-04-25T09:12:05.054144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:12:11.143000+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1f07b6c3-dbda-4185-b49a-db14623145f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3778022725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3778022725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":3778022725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3778022725}]},"public_addr":"172.21.15.53:6801/3778022725","cluster_addr":"172.21.15.53:6802/3778022725","heartbeat_back_addr":"172.21.15.53:6803/3778022725","heartbeat_front_addr":"172.21.15.53:6806/3778022725","state":["exists","up"]},{"osd":1,"uuid":"b2fcfcb4-83c0-4dac-bb3f-2f82dc63d670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3736905990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3736905990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3736905990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3736905990}]},"public_addr":"172.21.15.53:6805/3736905990","cluster_addr":"172.21.15.53:6804/3736905990","heartbeat_back_addr":"172.21.15.53:6808/3736905990","heartbeat_front_addr":"172.21.15.53:6809/3736905990","state":["exists","up"]},{"osd":2,"uuid":"71a08380-1b88-46bf-88ed-1d1f06dac230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":3300556569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3300556569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":3300556569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":3300556569}]},"public_addr":"172.21.15.151:6805/3300556569","cluster_addr":"172.21.15.151:6804/3300556569","heartbeat_back_addr":"172.21.15.151:6815/3300556569","heartbeat_front_addr":"172.21.15.151:6816/3300556569","state":["exists","up"]},{"osd":3,"uuid":"a59b2717-6d15-45cd-acf1-73867afba713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":46311736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":46311736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":46311736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":46311736}]},"public_addr":"172.21.15.151:6806/46311736","cluster_addr":"172.21.15.151:6807/46311736","heartbeat_back_addr":"172.21.15.151:6818/46311736","heartbeat_front_addr":"172.21.15.151:6819/46311736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:12.872 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe1780388f0 msgr2=0x7fe17803ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.872 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 --2- 172.21.15.53:0/3680659023 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe1780388f0 0x7fe17803ae00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.872 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1940a2130 msgr2=0x7fe19411f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.873 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 --2- 172.21.15.53:0/3680659023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1940a2130 0x7fe19411f740 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.873 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 shutdown_connections 2024-04-25T09:12:12.873 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 --2- 172.21.15.53:0/3680659023 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe1780388f0 0x7fe17803ae00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.873 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 --2- 172.21.15.53:0/3680659023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1940a2130 0x7fe19411f740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.873 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 >> 172.21.15.53:0/3680659023 conn(0x7fe1940a3b00 msgr2=0x7fe194136c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:12.873 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 shutdown_connections 2024-04-25T09:12:12.873 INFO:teuthology.misc.health.smithi053.stderr:2024-04-25T09:12:12.885+0000 7fe19acad640 1 -- 172.21.15.53:0/3680659023 wait complete. 2024-04-25T09:12:12.882 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-25T09:12:12.882 INFO:tasks.ceph:Creating RBD pool 2024-04-25T09:12:12.882 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T09:12:12.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.001+0000 7fe8d0a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:12.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.009+0000 7fe8d0a2d640 1 Processor -- start 2024-04-25T09:12:12.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.009+0000 7fe8d0a2d640 1 -- start start 2024-04-25T09:12:12.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.011+0000 7fe8d0a2d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe8cc09e5b0 0x7fe8cc09e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.011+0000 7fe8d0a2d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8cc0a0e70 con 0x7fe8cc09ef00 2024-04-25T09:12:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.011+0000 7fe8d0a2d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe8cc068760 con 0x7fe8cc09e5b0 2024-04-25T09:12:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.011+0000 7fe8ca59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe8cc09e5b0 0x7fe8cc09e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.011+0000 7fe8c9d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe8cc09ef00 0x7fe8cc09d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60810/0 (socket says 172.21.15.53:60810) 2024-04-25T09:12:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.011+0000 7fe8ca59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe8cc09e5b0 0x7fe8cc09e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45728/0 (socket says 172.21.15.53:45728) 2024-04-25T09:12:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.011+0000 7fe8c9d9b640 1 -- 172.21.15.53:0/568086641 learned_addr learned my addr 172.21.15.53:0/568086641 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.012+0000 7fe8ca59c640 1 -- 172.21.15.53:0/568086641 >> v1:172.21.15.53:6789/0 conn(0x7fe8cc09ef00 legacy=0x7fe8cc09d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.012+0000 7fe8ca59c640 1 -- 172.21.15.53:0/568086641 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc06e900 con 0x7fe8cc09e5b0 2024-04-25T09:12:12.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.012+0000 7fe8ca59c640 1 --2- 172.21.15.53:0/568086641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 0x7fe8cc09e9c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc07a8b6c5a9a1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:13.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.064+0000 7fe8c959a640 1 -- 172.21.15.53:0/568086641 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8b4009d90 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.064+0000 7fe8c959a640 1 -- 172.21.15.53:0/568086641 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe8b400e230 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.064+0000 7fe8c959a640 1 -- 172.21.15.53:0/568086641 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8b400e4d0 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.065+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/568086641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 msgr2=0x7fe8cc09e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:13.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.065+0000 7fe8d0a2d640 1 --2- 172.21.15.53:0/568086641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 0x7fe8cc09e9c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.065+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/568086641 shutdown_connections 2024-04-25T09:12:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.065+0000 7fe8d0a2d640 1 --2- 172.21.15.53:0/568086641 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 0x7fe8cc09e9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.065+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/568086641 >> 172.21.15.53:0/568086641 conn(0x7fe8cc0a50e0 msgr2=0x7fe8cc0a54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.065+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/568086641 shutdown_connections 2024-04-25T09:12:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.065+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/568086641 wait complete. 2024-04-25T09:12:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.065+0000 7fe8d0a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.067+0000 7fe8d0a2d640 1 Processor -- start 2024-04-25T09:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.067+0000 7fe8d0a2d640 1 -- start start 2024-04-25T09:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8d0a2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 0x7fe8cc130640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8d0a2d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc131a80 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8ca59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 0x7fe8cc130640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8ca59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 0x7fe8cc130640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45742/0 (socket says 172.21.15.53:45742) 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8ca59c640 1 -- 172.21.15.53:0/3547415042 learned_addr learned my addr 172.21.15.53:0/3547415042 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8ca59c640 1 -- 172.21.15.53:0/3547415042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc1301f0 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8ca59c640 1 --2- 172.21.15.53:0/3547415042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 0x7fe8cc130640 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8c2ffd640 1 -- 172.21.15.53:0/3547415042 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8b4014620 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8c2ffd640 1 -- 172.21.15.53:0/3547415042 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe8b4014780 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8cc1316b0 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8c2ffd640 1 -- 172.21.15.53:0/3547415042 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8b4014a20 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.069+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8cc133ba0 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.070+0000 7fe8c2ffd640 1 -- 172.21.15.53:0/3547415042 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7fe8b4014bd0 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.070+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8cc0692b0 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.071+0000 7fe8c2ffd640 1 --2- 172.21.15.53:0/3547415042 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe8ac0388f0 0x7fe8ac03ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.071+0000 7fe8c2ffd640 1 -- 172.21.15.53:0/3547415042 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7fe8b4019040 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.071+0000 7fe8c9d9b640 1 --2- 172.21.15.53:0/3547415042 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe8ac0388f0 0x7fe8ac03ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:13.059 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.071+0000 7fe8c9d9b640 1 --2- 172.21.15.53:0/3547415042 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe8ac0388f0 0x7fe8ac03ae00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:13.066 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.079+0000 7fe8c2ffd640 1 -- 172.21.15.53:0/3547415042 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fe8b4018190 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.175+0000 7fe8c2ffd640 1 -- 172.21.15.53:0/3547415042 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fe8b400f2a0 con 0x7fe8cc09e5b0 2024-04-25T09:12:13.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:13.269+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fe8cc131f90 con 0x7fe8cc09e5b0 2024-04-25T09:12:14.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.178+0000 7fe8c2ffd640 1 -- 172.21.15.53:0/3547415042 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (crc 0 0 0) 0x7fe8b4013e40 con 0x7fe8cc09e5b0 2024-04-25T09:12:14.165 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe8ac0388f0 msgr2=0x7fe8ac03ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 --2- 172.21.15.53:0/3547415042 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe8ac0388f0 0x7fe8ac03ae00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 msgr2=0x7fe8cc130640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 --2- 172.21.15.53:0/3547415042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 0x7fe8cc130640 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 shutdown_connections 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 --2- 172.21.15.53:0/3547415042 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fe8ac0388f0 0x7fe8ac03ae00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 --2- 172.21.15.53:0/3547415042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe8cc09e5b0 0x7fe8cc130640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 >> 172.21.15.53:0/3547415042 conn(0x7fe8cc0a50e0 msgr2=0x7fe8cc1bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 shutdown_connections 2024-04-25T09:12:14.170 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.181+0000 7fe8d0a2d640 1 -- 172.21.15.53:0/3547415042 wait complete. 2024-04-25T09:12:14.189 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T09:12:14.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.327+0000 7f793359d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:14.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.337+0000 7f793359d640 1 Processor -- start 2024-04-25T09:12:14.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.338+0000 7f793359d640 1 -- start start 2024-04-25T09:12:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.339+0000 7f793359d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f792c135c60 0x7f792c138080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.339+0000 7f793359d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f792c132950 con 0x7f792c071b70 2024-04-25T09:12:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.339+0000 7f793359d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f792c071f80 con 0x7f792c135c60 2024-04-25T09:12:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.339+0000 7f7930b38640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f792c135c60 0x7f792c138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.339+0000 7f7931339640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f792c071b70 0x7f792c133020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60816/0 (socket says 172.21.15.53:60816) 2024-04-25T09:12:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.339+0000 7f7930b38640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f792c135c60 0x7f792c138080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45754/0 (socket says 172.21.15.53:45754) 2024-04-25T09:12:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.339+0000 7f7931339640 1 -- 172.21.15.53:0/3277243971 learned_addr learned my addr 172.21.15.53:0/3277243971 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:14.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.340+0000 7f7930b38640 1 -- 172.21.15.53:0/3277243971 >> v1:172.21.15.53:6789/0 conn(0x7f792c071b70 legacy=0x7f792c133020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.340+0000 7f7930b38640 1 -- 172.21.15.53:0/3277243971 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c132bf0 con 0x7f792c135c60 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.340+0000 7f7930b38640 1 --2- 172.21.15.53:0/3277243971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c135c60 0x7f792c138080 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef3c1ee6eb5eb80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.340+0000 7f792bfff640 1 -- 172.21.15.53:0/3277243971 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7920009d90 con 0x7f792c135c60 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.340+0000 7f792bfff640 1 -- 172.21.15.53:0/3277243971 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f792000e230 con 0x7f792c135c60 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.340+0000 7f792bfff640 1 -- 172.21.15.53:0/3277243971 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f792000e4d0 con 0x7f792c135c60 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.341+0000 7f793359d640 1 -- 172.21.15.53:0/3277243971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c135c60 msgr2=0x7f792c138080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.341+0000 7f793359d640 1 --2- 172.21.15.53:0/3277243971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c135c60 0x7f792c138080 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.341+0000 7f793359d640 1 -- 172.21.15.53:0/3277243971 shutdown_connections 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.341+0000 7f793359d640 1 --2- 172.21.15.53:0/3277243971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c135c60 0x7f792c138080 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.341+0000 7f793359d640 1 -- 172.21.15.53:0/3277243971 >> 172.21.15.53:0/3277243971 conn(0x7f792c0a17c0 msgr2=0x7f792c0a1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.329 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.341+0000 7f793359d640 1 -- 172.21.15.53:0/3277243971 shutdown_connections 2024-04-25T09:12:14.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.341+0000 7f793359d640 1 -- 172.21.15.53:0/3277243971 wait complete. 2024-04-25T09:12:14.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.341+0000 7f793359d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:14.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.343+0000 7f793359d640 1 Processor -- start 2024-04-25T09:12:14.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.343+0000 7f793359d640 1 -- start start 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.344+0000 7f793359d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c071b70 0x7f792c1c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.344+0000 7f793359d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f792c121a40 con 0x7f792c071b70 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.344+0000 7f7931339640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c071b70 0x7f792c1c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.344+0000 7f7931339640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c071b70 0x7f792c1c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45770/0 (socket says 172.21.15.53:45770) 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.344+0000 7f7931339640 1 -- 172.21.15.53:0/3429024239 learned_addr learned my addr 172.21.15.53:0/3429024239 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:14.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.345+0000 7f7931339640 1 -- 172.21.15.53:0/3429024239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c1338b0 con 0x7f792c071b70 2024-04-25T09:12:14.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.345+0000 7f7931339640 1 --2- 172.21.15.53:0/3429024239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c071b70 0x7f792c1c9e70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.345+0000 7f7929ffb640 1 -- 172.21.15.53:0/3429024239 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7924005a60 con 0x7f792c071b70 2024-04-25T09:12:14.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.345+0000 7f7929ffb640 1 -- 172.21.15.53:0/3429024239 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7924005bc0 con 0x7f792c071b70 2024-04-25T09:12:14.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.345+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792c130270 con 0x7f792c071b70 2024-04-25T09:12:14.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.345+0000 7f7929ffb640 1 -- 172.21.15.53:0/3429024239 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7924005e60 con 0x7f792c071b70 2024-04-25T09:12:14.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.345+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f792c123100 con 0x7f792c071b70 2024-04-25T09:12:14.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.346+0000 7f7929ffb640 1 -- 172.21.15.53:0/3429024239 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f792400c780 con 0x7f792c071b70 2024-04-25T09:12:14.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.346+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792c130070 con 0x7f792c071b70 2024-04-25T09:12:14.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.346+0000 7f7929ffb640 1 --2- 172.21.15.53:0/3429024239 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7918038980 0x7f791803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.346+0000 7f7929ffb640 1 -- 172.21.15.53:0/3429024239 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2661+0+0 (crc 0 0 0) 0x7f7924048170 con 0x7f792c071b70 2024-04-25T09:12:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.347+0000 7f7930b38640 1 --2- 172.21.15.53:0/3429024239 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7918038980 0x7f791803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.347+0000 7f7930b38640 1 --2- 172.21.15.53:0/3429024239 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7918038980 0x7f791803ae90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.352+0000 7f7929ffb640 1 -- 172.21.15.53:0/3429024239 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f792400d330 con 0x7f792c071b70 2024-04-25T09:12:14.530 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:14.543+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f792c122f60 con 0x7f792c071b70 2024-04-25T09:12:15.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.182+0000 7f7929ffb640 1 -- 172.21.15.53:0/3429024239 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 173+0+0 (crc 0 0 0) 0x7f792c122f60 con 0x7f792c071b70 2024-04-25T09:12:15.169 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T09:12:15.172 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7918038980 msgr2=0x7f791803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 --2- 172.21.15.53:0/3429024239 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7918038980 0x7f791803ae90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c071b70 msgr2=0x7f792c1c9e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 --2- 172.21.15.53:0/3429024239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c071b70 0x7f792c1c9e70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 shutdown_connections 2024-04-25T09:12:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 --2- 172.21.15.53:0/3429024239 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7918038980 0x7f791803ae90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 --2- 172.21.15.53:0/3429024239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f792c071b70 0x7f792c1c9e70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 >> 172.21.15.53:0/3429024239 conn(0x7f792c0a17c0 msgr2=0x7f792c130750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 shutdown_connections 2024-04-25T09:12:15.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.185+0000 7f793359d640 1 -- 172.21.15.53:0/3429024239 wait complete. 2024-04-25T09:12:15.191 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T09:12:15.192 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T09:12:15.192 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T09:12:15.192 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T09:12:15.193 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T09:12:15.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.336+0000 7fc8bd310640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.341+0000 7fc8bd310640 1 Processor -- start 2024-04-25T09:12:15.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.341+0000 7fc8bd310640 1 -- start start 2024-04-25T09:12:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.342+0000 7fc8bd310640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8b809f960 0x7fc8b813a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.342+0000 7fc8bd310640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b806f0b0 con 0x7fc8b809ee40 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.342+0000 7fc8bd310640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b8073c50 con 0x7fc8b809f960 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b67fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc8b809f960 0x7fc8b813a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc8b809ee40 0x7fc8b809f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60832/0 (socket says 172.21.15.53:60832) 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b6ffd640 1 -- 172.21.15.53:0/834341246 learned_addr learned my addr 172.21.15.53:0/834341246 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b5ffb640 1 -- 172.21.15.53:0/834341246 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94418248 0 0) 0x7fc8b806f0b0 con 0x7fc8b809ee40 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b5ffb640 1 -- 172.21.15.53:0/834341246 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8a4003580 con 0x7fc8b809ee40 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b67fc640 1 -- 172.21.15.53:0/834341246 >> v1:172.21.15.53:6789/0 conn(0x7fc8b809ee40 legacy=0x7fc8b809f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b67fc640 1 -- 172.21.15.53:0/834341246 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b80a1120 con 0x7fc8b809f960 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b67fc640 1 --2- 172.21.15.53:0/834341246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809f960 0x7fc8b813a090 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e4b85e5e7912b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b5ffb640 1 -- 172.21.15.53:0/834341246 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc8a0009d90 con 0x7fc8b809f960 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b5ffb640 1 -- 172.21.15.53:0/834341246 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc8a000e230 con 0x7fc8b809f960 2024-04-25T09:12:15.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.343+0000 7fc8b5ffb640 1 -- 172.21.15.53:0/834341246 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc8a000e4d0 con 0x7fc8b809f960 2024-04-25T09:12:15.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.344+0000 7fc8bd310640 1 -- 172.21.15.53:0/834341246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809f960 msgr2=0x7fc8b813a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.344+0000 7fc8bd310640 1 --2- 172.21.15.53:0/834341246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809f960 0x7fc8b813a090 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.344+0000 7fc8bd310640 1 -- 172.21.15.53:0/834341246 shutdown_connections 2024-04-25T09:12:15.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.344+0000 7fc8bd310640 1 --2- 172.21.15.53:0/834341246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809f960 0x7fc8b813a090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.344+0000 7fc8bd310640 1 -- 172.21.15.53:0/834341246 >> 172.21.15.53:0/834341246 conn(0x7fc8b80a3be0 msgr2=0x7fc8b80a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.344+0000 7fc8bd310640 1 -- 172.21.15.53:0/834341246 shutdown_connections 2024-04-25T09:12:15.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.344+0000 7fc8bd310640 1 -- 172.21.15.53:0/834341246 wait complete. 2024-04-25T09:12:15.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.344+0000 7fc8bd310640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:15.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.346+0000 7fc8bd310640 1 Processor -- start 2024-04-25T09:12:15.333 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.346+0000 7fc8bd310640 1 -- start start 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8bd310640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809ee40 0x7fc8b81c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8bd310640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8120050 con 0x7fc8b809ee40 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8b6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809ee40 0x7fc8b81c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8b6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809ee40 0x7fc8b81c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45784/0 (socket says 172.21.15.53:45784) 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8b6ffd640 1 -- 172.21.15.53:0/3158526563 learned_addr learned my addr 172.21.15.53:0/3158526563 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8b6ffd640 1 -- 172.21.15.53:0/3158526563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b811fc80 con 0x7fc8b809ee40 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8b6ffd640 1 --2- 172.21.15.53:0/3158526563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809ee40 0x7fc8b81c6450 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8af7fe640 1 -- 172.21.15.53:0/3158526563 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc8a80070b0 con 0x7fc8b809ee40 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8af7fe640 1 -- 172.21.15.53:0/3158526563 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc8a8007210 con 0x7fc8b809ee40 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b81205a0 con 0x7fc8b809ee40 2024-04-25T09:12:15.336 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.348+0000 7fc8af7fe640 1 -- 172.21.15.53:0/3158526563 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc8a80074b0 con 0x7fc8b809ee40 2024-04-25T09:12:15.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.349+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b8121bf0 con 0x7fc8b809ee40 2024-04-25T09:12:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.350+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b81c6250 con 0x7fc8b809ee40 2024-04-25T09:12:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.350+0000 7fc8af7fe640 1 -- 172.21.15.53:0/3158526563 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc8a8007660 con 0x7fc8b809ee40 2024-04-25T09:12:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.350+0000 7fc8af7fe640 1 --2- 172.21.15.53:0/3158526563 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc898038980 0x7fc89803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.350+0000 7fc8af7fe640 1 -- 172.21.15.53:0/3158526563 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fc8a8048be0 con 0x7fc8b809ee40 2024-04-25T09:12:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.350+0000 7fc8b67fc640 1 --2- 172.21.15.53:0/3158526563 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc898038980 0x7fc89803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.338 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.351+0000 7fc8b67fc640 1 --2- 172.21.15.53:0/3158526563 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc898038980 0x7fc89803ae90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.342 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.355+0000 7fc8af7fe640 1 -- 172.21.15.53:0/3158526563 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fc8a80092e0 con 0x7fc8b809ee40 2024-04-25T09:12:15.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.593+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc8b8063880 con 0x7fc8b809ee40 2024-04-25T09:12:15.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.595+0000 7fc8af7fe640 1 -- 172.21.15.53:0/3158526563 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87805 (crc 0 0 0) 0x7fc8a800d150 con 0x7fc8b809ee40 2024-04-25T09:12:15.583 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc898038980 msgr2=0x7fc89803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 --2- 172.21.15.53:0/3158526563 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc898038980 0x7fc89803ae90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809ee40 msgr2=0x7fc8b81c6450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 --2- 172.21.15.53:0/3158526563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809ee40 0x7fc8b81c6450 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 shutdown_connections 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 --2- 172.21.15.53:0/3158526563 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc898038980 0x7fc89803ae90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 --2- 172.21.15.53:0/3158526563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8b809ee40 0x7fc8b81c6450 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 >> 172.21.15.53:0/3158526563 conn(0x7fc8b80a3be0 msgr2=0x7fc8b81bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 shutdown_connections 2024-04-25T09:12:15.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.597+0000 7fc8bd310640 1 -- 172.21.15.53:0/3158526563 wait complete. 2024-04-25T09:12:15.595 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":1387723690},{"type":"v1","addr":"172.21.15.151:6801","nonce":1387723690}]},"active_addr":"172.21.15.151:6801/1387723690","active_change":"2024-04-25T09:12:07.120446+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":2254742641}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":167648692}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":2883682295}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":3565189880}]}]} 2024-04-25T09:12:15.597 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T09:12:15.597 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T09:12:15.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:15.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.717+0000 7ffa64aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.722+0000 7ffa64aad640 1 Processor -- start 2024-04-25T09:12:15.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.722+0000 7ffa64aad640 1 -- start start 2024-04-25T09:12:15.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa64aad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ffa600a01e0 0x7ffa60137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa64aad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa60070d80 con 0x7ffa6009f6c0 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa64aad640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ffa600717b0 con 0x7ffa600a01e0 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa5e59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ffa6009f6c0 0x7ffa6009fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60848/0 (socket says 172.21.15.53:60848) 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa5e59c640 1 -- 172.21.15.53:0/1676943329 learned_addr learned my addr 172.21.15.53:0/1676943329 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa5dd9b640 1 --2- 172.21.15.53:0/1676943329 >> v2:172.21.15.53:3300/0 conn(0x7ffa600a01e0 0x7ffa60137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa5d59a640 1 -- 172.21.15.53:0/1676943329 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701540167 0 0) 0x7ffa60070d80 con 0x7ffa6009f6c0 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa5d59a640 1 -- 172.21.15.53:0/1676943329 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa48003580 con 0x7ffa6009f6c0 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa5dd9b640 1 -- 172.21.15.53:0/1676943329 >> v1:172.21.15.53:6789/0 conn(0x7ffa6009f6c0 legacy=0x7ffa6009fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.724+0000 7ffa5dd9b640 1 -- 172.21.15.53:0/1676943329 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa60072330 con 0x7ffa600a01e0 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.725+0000 7ffa5dd9b640 1 --2- 172.21.15.53:0/1676943329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa600a01e0 0x7ffa60137c40 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3bd738b270deb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.725+0000 7ffa5d59a640 1 -- 172.21.15.53:0/1676943329 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffa54009d90 con 0x7ffa600a01e0 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.725+0000 7ffa5d59a640 1 -- 172.21.15.53:0/1676943329 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffa5400e230 con 0x7ffa600a01e0 2024-04-25T09:12:15.714 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.725+0000 7ffa5d59a640 1 -- 172.21.15.53:0/1676943329 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffa5400e4d0 con 0x7ffa600a01e0 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.725+0000 7ffa64aad640 1 -- 172.21.15.53:0/1676943329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa600a01e0 msgr2=0x7ffa60137c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.725+0000 7ffa64aad640 1 --2- 172.21.15.53:0/1676943329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa600a01e0 0x7ffa60137c40 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.726+0000 7ffa64aad640 1 -- 172.21.15.53:0/1676943329 shutdown_connections 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.726+0000 7ffa64aad640 1 --2- 172.21.15.53:0/1676943329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa600a01e0 0x7ffa60137c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.726+0000 7ffa64aad640 1 -- 172.21.15.53:0/1676943329 >> 172.21.15.53:0/1676943329 conn(0x7ffa600a1960 msgr2=0x7ffa600a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.726+0000 7ffa64aad640 1 -- 172.21.15.53:0/1676943329 shutdown_connections 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.726+0000 7ffa64aad640 1 -- 172.21.15.53:0/1676943329 wait complete. 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.726+0000 7ffa64aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.728+0000 7ffa64aad640 1 Processor -- start 2024-04-25T09:12:15.715 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.728+0000 7ffa64aad640 1 -- start start 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.729+0000 7ffa64aad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6009f6c0 0x7ffa601c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.729+0000 7ffa64aad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ffa601c3cd0 con 0x7ffa6009f6c0 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.729+0000 7ffa5e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6009f6c0 0x7ffa601c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.729+0000 7ffa5e59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6009f6c0 0x7ffa601c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45788/0 (socket says 172.21.15.53:45788) 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.729+0000 7ffa5e59c640 1 -- 172.21.15.53:0/3484425211 learned_addr learned my addr 172.21.15.53:0/3484425211 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.730+0000 7ffa5e59c640 1 -- 172.21.15.53:0/3484425211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6011e5e0 con 0x7ffa6009f6c0 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.730+0000 7ffa5e59c640 1 --2- 172.21.15.53:0/3484425211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6009f6c0 0x7ffa601c4280 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.730+0000 7ffa4effd640 1 -- 172.21.15.53:0/3484425211 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffa50005a60 con 0x7ffa6009f6c0 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.730+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa601c3f70 con 0x7ffa6009f6c0 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.730+0000 7ffa4effd640 1 -- 172.21.15.53:0/3484425211 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffa50005bc0 con 0x7ffa6009f6c0 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.730+0000 7ffa4effd640 1 -- 172.21.15.53:0/3484425211 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffa50005e60 con 0x7ffa6009f6c0 2024-04-25T09:12:15.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.730+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6011e9e0 con 0x7ffa6009f6c0 2024-04-25T09:12:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.731+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6011e7e0 con 0x7ffa6009f6c0 2024-04-25T09:12:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.731+0000 7ffa4effd640 1 -- 172.21.15.53:0/3484425211 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ffa500070b0 con 0x7ffa6009f6c0 2024-04-25T09:12:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.731+0000 7ffa4effd640 1 --2- 172.21.15.53:0/3484425211 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ffa40038920 0x7ffa4003ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.731+0000 7ffa4effd640 1 -- 172.21.15.53:0/3484425211 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7ffa500481e0 con 0x7ffa6009f6c0 2024-04-25T09:12:15.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.731+0000 7ffa5dd9b640 1 --2- 172.21.15.53:0/3484425211 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ffa40038920 0x7ffa4003ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.719 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.732+0000 7ffa5dd9b640 1 --2- 172.21.15.53:0/3484425211 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ffa40038920 0x7ffa4003ae30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.723 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.736+0000 7ffa4effd640 1 -- 172.21.15.53:0/3484425211 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ffa5000d510 con 0x7ffa6009f6c0 2024-04-25T09:12:15.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.924+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa600692b0 con 0x7ffa6009f6c0 2024-04-25T09:12:15.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.925+0000 7ffa4effd640 1 -- 172.21.15.53:0/3484425211 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8723 (crc 0 0 0) 0x7ffa5000d150 con 0x7ffa6009f6c0 2024-04-25T09:12:15.912 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:12:15.912 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":14,"fsid":"12417946-fe70-462a-890a-9259fe1aeb83","created":"2024-04-25T09:12:02.900066+0000","modified":"2024-04-25T09:12:15.179342+0000","last_up_change":"2024-04-25T09:12:09.155255+0000","last_in_change":"2024-04-25T09:12:05.054144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:12:11.143000+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T09:12:13.273451+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1f07b6c3-dbda-4185-b49a-db14623145f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3778022725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3778022725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":3778022725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3778022725}]},"public_addr":"172.21.15.53:6801/3778022725","cluster_addr":"172.21.15.53:6802/3778022725","heartbeat_back_addr":"172.21.15.53:6803/3778022725","heartbeat_front_addr":"172.21.15.53:6806/3778022725","state":["exists","up"]},{"osd":1,"uuid":"b2fcfcb4-83c0-4dac-bb3f-2f82dc63d670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3736905990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3736905990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3736905990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3736905990}]},"public_addr":"172.21.15.53:6805/3736905990","cluster_addr":"172.21.15.53:6804/3736905990","heartbeat_back_addr":"172.21.15.53:6808/3736905990","heartbeat_front_addr":"172.21.15.53:6809/3736905990","state":["exists","up"]},{"osd":2,"uuid":"71a08380-1b88-46bf-88ed-1d1f06dac230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":3300556569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3300556569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":3300556569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":3300556569}]},"public_addr":"172.21.15.151:6805/3300556569","cluster_addr":"172.21.15.151:6804/3300556569","heartbeat_back_addr":"172.21.15.151:6815/3300556569","heartbeat_front_addr":"172.21.15.151:6816/3300556569","state":["exists","up"]},{"osd":3,"uuid":"a59b2717-6d15-45cd-acf1-73867afba713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":46311736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":46311736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":46311736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":46311736}]},"public_addr":"172.21.15.151:6806/46311736","cluster_addr":"172.21.15.151:6807/46311736","heartbeat_back_addr":"172.21.15.151:6818/46311736","heartbeat_front_addr":"172.21.15.151:6819/46311736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ffa40038920 msgr2=0x7ffa4003ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 --2- 172.21.15.53:0/3484425211 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ffa40038920 0x7ffa4003ae30 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6009f6c0 msgr2=0x7ffa601c4280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 --2- 172.21.15.53:0/3484425211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6009f6c0 0x7ffa601c4280 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 shutdown_connections 2024-04-25T09:12:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 --2- 172.21.15.53:0/3484425211 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ffa40038920 0x7ffa4003ae30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 --2- 172.21.15.53:0/3484425211 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffa6009f6c0 0x7ffa601c4280 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.914 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 >> 172.21.15.53:0/3484425211 conn(0x7ffa600a1960 msgr2=0x7ffa601b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 shutdown_connections 2024-04-25T09:12:15.915 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:15.927+0000 7ffa64aad640 1 -- 172.21.15.53:0/3484425211 wait complete. 2024-04-25T09:12:15.925 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T09:12:15.925 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:16.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.045+0000 7fb43e15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.051+0000 7fb43e15d640 1 Processor -- start 2024-04-25T09:12:16.038 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.051+0000 7fb43e15d640 1 -- start start 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.052+0000 7fb43e15d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb43809f6c0 0x7fb43809fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.052+0000 7fb43e15d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb438070d80 con 0x7fb4380a0010 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.052+0000 7fb43e15d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb4380717b0 con 0x7fb43809f6c0 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.052+0000 7fb4377fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb43809f6c0 0x7fb43809fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.052+0000 7fb436ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb4380a0010 0x7fb4381329f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60858/0 (socket says 172.21.15.53:60858) 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.052+0000 7fb436ffd640 1 -- 172.21.15.53:0/3541989745 learned_addr learned my addr 172.21.15.53:0/3541989745 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.053+0000 7fb4377fe640 1 -- 172.21.15.53:0/3541989745 >> v1:172.21.15.53:6789/0 conn(0x7fb4380a0010 legacy=0x7fb4381329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.053+0000 7fb4377fe640 1 -- 172.21.15.53:0/3541989745 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb438072330 con 0x7fb43809f6c0 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.053+0000 7fb4377fe640 1 --2- 172.21.15.53:0/3541989745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 0x7fb43809fad0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6658d32f09f5626 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.053+0000 7fb4367fc640 1 -- 172.21.15.53:0/3541989745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb420009d90 con 0x7fb43809f6c0 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.053+0000 7fb4367fc640 1 -- 172.21.15.53:0/3541989745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb42000e230 con 0x7fb43809f6c0 2024-04-25T09:12:16.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.053+0000 7fb4367fc640 1 -- 172.21.15.53:0/3541989745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb42000e4d0 con 0x7fb43809f6c0 2024-04-25T09:12:16.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.054+0000 7fb43e15d640 1 -- 172.21.15.53:0/3541989745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 msgr2=0x7fb43809fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.054+0000 7fb43e15d640 1 --2- 172.21.15.53:0/3541989745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 0x7fb43809fad0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.054+0000 7fb43e15d640 1 -- 172.21.15.53:0/3541989745 shutdown_connections 2024-04-25T09:12:16.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.054+0000 7fb43e15d640 1 --2- 172.21.15.53:0/3541989745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 0x7fb43809fad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.054+0000 7fb43e15d640 1 -- 172.21.15.53:0/3541989745 >> 172.21.15.53:0/3541989745 conn(0x7fb4380a1960 msgr2=0x7fb4380a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.054+0000 7fb43e15d640 1 -- 172.21.15.53:0/3541989745 shutdown_connections 2024-04-25T09:12:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.054+0000 7fb43e15d640 1 -- 172.21.15.53:0/3541989745 wait complete. 2024-04-25T09:12:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.054+0000 7fb43e15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.056+0000 7fb43e15d640 1 Processor -- start 2024-04-25T09:12:16.043 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.056+0000 7fb43e15d640 1 -- start start 2024-04-25T09:12:16.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.057+0000 7fb43e15d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 0x7fb43806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.057+0000 7fb43e15d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb438121c50 con 0x7fb43809f6c0 2024-04-25T09:12:16.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb4377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 0x7fb43806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb4377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 0x7fb43806ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45802/0 (socket says 172.21.15.53:45802) 2024-04-25T09:12:16.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb4377fe640 1 -- 172.21.15.53:0/987428654 learned_addr learned my addr 172.21.15.53:0/987428654 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb4377fe640 1 -- 172.21.15.53:0/987428654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb438121ed0 con 0x7fb43809f6c0 2024-04-25T09:12:16.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb4377fe640 1 --2- 172.21.15.53:0/987428654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 0x7fb43806ea80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb42ffff640 1 -- 172.21.15.53:0/987428654 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb420014540 con 0x7fb43809f6c0 2024-04-25T09:12:16.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb42ffff640 1 -- 172.21.15.53:0/987428654 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb4200146a0 con 0x7fb43809f6c0 2024-04-25T09:12:16.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb42ffff640 1 -- 172.21.15.53:0/987428654 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb420014940 con 0x7fb43809f6c0 2024-04-25T09:12:16.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb438130260 con 0x7fb43809f6c0 2024-04-25T09:12:16.046 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.058+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb438120a80 con 0x7fb43809f6c0 2024-04-25T09:12:16.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.059+0000 7fb42ffff640 1 -- 172.21.15.53:0/987428654 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb420014af0 con 0x7fb43809f6c0 2024-04-25T09:12:16.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.059+0000 7fb42ffff640 1 --2- 172.21.15.53:0/987428654 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb418038980 0x7fb41803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.059+0000 7fb42ffff640 1 -- 172.21.15.53:0/987428654 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fb420019040 con 0x7fb43809f6c0 2024-04-25T09:12:16.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.059+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4380692b0 con 0x7fb43809f6c0 2024-04-25T09:12:16.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.060+0000 7fb436ffd640 1 --2- 172.21.15.53:0/987428654 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb418038980 0x7fb41803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.047 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.060+0000 7fb436ffd640 1 --2- 172.21.15.53:0/987428654 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb418038980 0x7fb41803ae90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.065+0000 7fb42ffff640 1 -- 172.21.15.53:0/987428654 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fb420014df0 con 0x7fb43809f6c0 2024-04-25T09:12:16.242 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.255+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb438063880 con 0x7fb43809f6c0 2024-04-25T09:12:16.243 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.256+0000 7fb42ffff640 1 -- 172.21.15.53:0/987428654 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8714 (crc 0 0 0) 0x7fb42000fb30 con 0x7fb43809f6c0 2024-04-25T09:12:16.243 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:12:16.244 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":15,"fsid":"12417946-fe70-462a-890a-9259fe1aeb83","created":"2024-04-25T09:12:02.900066+0000","modified":"2024-04-25T09:12:16.182741+0000","last_up_change":"2024-04-25T09:12:09.155255+0000","last_in_change":"2024-04-25T09:12:05.054144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:12:11.143000+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T09:12:13.273451+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1f07b6c3-dbda-4185-b49a-db14623145f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3778022725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3778022725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":3778022725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3778022725}]},"public_addr":"172.21.15.53:6801/3778022725","cluster_addr":"172.21.15.53:6802/3778022725","heartbeat_back_addr":"172.21.15.53:6803/3778022725","heartbeat_front_addr":"172.21.15.53:6806/3778022725","state":["exists","up"]},{"osd":1,"uuid":"b2fcfcb4-83c0-4dac-bb3f-2f82dc63d670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3736905990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3736905990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3736905990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3736905990}]},"public_addr":"172.21.15.53:6805/3736905990","cluster_addr":"172.21.15.53:6804/3736905990","heartbeat_back_addr":"172.21.15.53:6808/3736905990","heartbeat_front_addr":"172.21.15.53:6809/3736905990","state":["exists","up"]},{"osd":2,"uuid":"71a08380-1b88-46bf-88ed-1d1f06dac230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":3300556569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3300556569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":3300556569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":3300556569}]},"public_addr":"172.21.15.151:6805/3300556569","cluster_addr":"172.21.15.151:6804/3300556569","heartbeat_back_addr":"172.21.15.151:6815/3300556569","heartbeat_front_addr":"172.21.15.151:6816/3300556569","state":["exists","up"]},{"osd":3,"uuid":"a59b2717-6d15-45cd-acf1-73867afba713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":46311736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":46311736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":46311736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":46311736}]},"public_addr":"172.21.15.151:6806/46311736","cluster_addr":"172.21.15.151:6807/46311736","heartbeat_back_addr":"172.21.15.151:6818/46311736","heartbeat_front_addr":"172.21.15.151:6819/46311736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:16.246 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.258+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb418038980 msgr2=0x7fb41803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.258+0000 7fb43e15d640 1 --2- 172.21.15.53:0/987428654 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb418038980 0x7fb41803ae90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.259+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 msgr2=0x7fb43806ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.259+0000 7fb43e15d640 1 --2- 172.21.15.53:0/987428654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 0x7fb43806ea80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.259+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 shutdown_connections 2024-04-25T09:12:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.259+0000 7fb43e15d640 1 --2- 172.21.15.53:0/987428654 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb418038980 0x7fb41803ae90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.259+0000 7fb43e15d640 1 --2- 172.21.15.53:0/987428654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb43809f6c0 0x7fb43806ea80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.259+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 >> 172.21.15.53:0/987428654 conn(0x7fb4380a1960 msgr2=0x7fb4381bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.259+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 shutdown_connections 2024-04-25T09:12:16.247 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.259+0000 7fb43e15d640 1 -- 172.21.15.53:0/987428654 wait complete. 2024-04-25T09:12:16.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T09:12:16.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T09:12:16.257 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T09:12:16.258 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T09:12:16.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.388+0000 7fab49ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.389+0000 7f1cbc59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.381 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.388+0000 7fdc0586d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.389+0000 7f1fbf26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.395+0000 7f1cbc59d640 1 Processor -- start 2024-04-25T09:12:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.395+0000 7fdc0586d640 1 Processor -- start 2024-04-25T09:12:16.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.395+0000 7f1cbc59d640 1 -- start start 2024-04-25T09:12:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.395+0000 7fdc0586d640 1 -- start start 2024-04-25T09:12:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.395+0000 7fab49ced640 1 Processor -- start 2024-04-25T09:12:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.395+0000 7f1fbf26d640 1 Processor -- start 2024-04-25T09:12:16.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.395+0000 7fab49ced640 1 -- start start 2024-04-25T09:12:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.395+0000 7f1fbf26d640 1 -- start start 2024-04-25T09:12:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.396+0000 7fdc0586d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdc0009f960 0x7fdc0013a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.396+0000 7fdc0586d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc0006f0b0 con 0x7fdc0009ee40 2024-04-25T09:12:16.384 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.396+0000 7fdc0586d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdc00073c50 con 0x7fdc0009f960 2024-04-25T09:12:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.396+0000 7fab49ced640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fab440a11e0 0x7fab4406ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fab49ced640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab441321e0 con 0x7fab4409fe50 2024-04-25T09:12:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fab49ced640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fab440a0d90 con 0x7fab440a11e0 2024-04-25T09:12:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fdbfeffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdc0009ee40 0x7fdc0009f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60868/0 (socket says 172.21.15.53:60868) 2024-04-25T09:12:16.385 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fdbfe7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdc0009f960 0x7fdc0013a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1cbc59d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1cb406ec40 0x7f1cb413a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.386 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fdbfeffd640 1 -- 172.21.15.53:0/2765386504 learned_addr learned my addr 172.21.15.53:0/2765386504 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1cbc59d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cb41321e0 con 0x7f1cb40a11e0 2024-04-25T09:12:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1cbc59d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1cb40a0d90 con 0x7f1cb406ec40 2024-04-25T09:12:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1cb9b38640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1cb406ec40 0x7f1cb413a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1cb9b38640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1cb406ec40 0x7f1cb413a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45834/0 (socket says 172.21.15.53:45834) 2024-04-25T09:12:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1cb9b38640 1 -- 172.21.15.53:0/2034397684 learned_addr learned my addr 172.21.15.53:0/2034397684 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.387 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1fbf26d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1fb8132fb0 0x7f1fb8137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fab42ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fab4409fe50 0x7fab44134e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60884/0 (socket says 172.21.15.53:60884) 2024-04-25T09:12:16.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fab42ffd640 1 -- 172.21.15.53:0/683448376 learned_addr learned my addr 172.21.15.53:0/683448376 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:16.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fab437fe640 1 --2- 172.21.15.53:0/683448376 >> v2:172.21.15.53:3300/0 conn(0x7fab440a11e0 0x7fab4406ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1fbf26d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb8072330 con 0x7f1fb80725f0 2024-04-25T09:12:16.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1fbf26d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1fb80a0ef0 con 0x7f1fb8132fb0 2024-04-25T09:12:16.388 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1fbc808640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1fb8132fb0 0x7f1fb8137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fdbfdffb640 1 -- 172.21.15.53:0/2765386504 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235296058 0 0) 0x7fdc0006f0b0 con 0x7fdc0009ee40 2024-04-25T09:12:16.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fdbfdffb640 1 -- 172.21.15.53:0/2765386504 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbe8003580 con 0x7fdc0009ee40 2024-04-25T09:12:16.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1fbc808640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1fb8132fb0 0x7f1fb8137dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45848/0 (socket says 172.21.15.53:45848) 2024-04-25T09:12:16.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1fbc808640 1 -- 172.21.15.53:0/1612661469 learned_addr learned my addr 172.21.15.53:0/1612661469 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.389 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1cb9b38640 1 -- 172.21.15.53:0/2034397684 >> v1:172.21.15.53:6789/0 conn(0x7f1cb40a11e0 legacy=0x7f1cb409fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:16.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fdbfe7fc640 1 -- 172.21.15.53:0/2765386504 >> v1:172.21.15.53:6789/0 conn(0x7fdc0009ee40 legacy=0x7fdc0009f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7fdbfe7fc640 1 -- 172.21.15.53:0/2765386504 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc000a1120 con 0x7fdc0009f960 2024-04-25T09:12:16.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.397+0000 7f1cb9b38640 1 -- 172.21.15.53:0/2034397684 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb406f050 con 0x7f1cb406ec40 2024-04-25T09:12:16.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7f1fbc808640 1 -- 172.21.15.53:0/1612661469 >> v1:172.21.15.53:6789/0 conn(0x7f1fb80725f0 legacy=0x7f1fb81328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:16.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7f1fbc808640 1 -- 172.21.15.53:0/1612661469 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb80a0be0 con 0x7f1fb8132fb0 2024-04-25T09:12:16.391 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7fab437fe640 1 -- 172.21.15.53:0/683448376 >> v1:172.21.15.53:6789/0 conn(0x7fab4409fe50 legacy=0x7fab44134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:16.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7fab437fe640 1 -- 172.21.15.53:0/683448376 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab44131ed0 con 0x7fab440a11e0 2024-04-25T09:12:16.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7fab437fe640 1 --2- 172.21.15.53:0/683448376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab440a11e0 0x7fab4406ec40 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea874f97091647 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7fdbfe7fc640 1 --2- 172.21.15.53:0/2765386504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009f960 0x7fdc0013a090 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73e43da54bb35d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7fab427fc640 1 -- 172.21.15.53:0/683448376 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab34009d00 con 0x7fab440a11e0 2024-04-25T09:12:16.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7f1cb9b38640 1 --2- 172.21.15.53:0/2034397684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 0x7f1cb413a140 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b91965cf8087268 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7f1fbc808640 1 --2- 172.21.15.53:0/1612661469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 0x7f1fb8137dd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5176017cef0d5e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7fab427fc640 1 -- 172.21.15.53:0/683448376 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab34009e60 con 0x7fab440a11e0 2024-04-25T09:12:16.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7fab427fc640 1 -- 172.21.15.53:0/683448376 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab3400e360 con 0x7fab440a11e0 2024-04-25T09:12:16.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7f1cb9337640 1 -- 172.21.15.53:0/2034397684 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1ca4009e50 con 0x7f1cb406ec40 2024-04-25T09:12:16.394 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7fdbfdffb640 1 -- 172.21.15.53:0/2765386504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbf4009d90 con 0x7fdc0009f960 2024-04-25T09:12:16.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7f1cb9337640 1 -- 172.21.15.53:0/2034397684 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1ca400e230 con 0x7f1cb406ec40 2024-04-25T09:12:16.395 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7f1faffff640 1 -- 172.21.15.53:0/1612661469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1fa8009dc0 con 0x7f1fb8132fb0 2024-04-25T09:12:16.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.398+0000 7f1cb9337640 1 -- 172.21.15.53:0/2034397684 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1ca400e4d0 con 0x7f1cb406ec40 2024-04-25T09:12:16.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7f1faffff640 1 -- 172.21.15.53:0/1612661469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1fa800e230 con 0x7f1fb8132fb0 2024-04-25T09:12:16.396 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7f1faffff640 1 -- 172.21.15.53:0/1612661469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1fa800e4d0 con 0x7f1fb8132fb0 2024-04-25T09:12:16.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7fdbfdffb640 1 -- 172.21.15.53:0/2765386504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdbf400e230 con 0x7fdc0009f960 2024-04-25T09:12:16.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7fdbfdffb640 1 -- 172.21.15.53:0/2765386504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbf400e4d0 con 0x7fdc0009f960 2024-04-25T09:12:16.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7fab49ced640 1 -- 172.21.15.53:0/683448376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab440a11e0 msgr2=0x7fab4406ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.397 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7fab49ced640 1 --2- 172.21.15.53:0/683448376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab440a11e0 0x7fab4406ec40 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7f1cbc59d640 1 -- 172.21.15.53:0/2034397684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 msgr2=0x7f1cb413a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7f1cbc59d640 1 --2- 172.21.15.53:0/2034397684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 0x7f1cb413a140 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7fab49ced640 1 -- 172.21.15.53:0/683448376 shutdown_connections 2024-04-25T09:12:16.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7fab49ced640 1 --2- 172.21.15.53:0/683448376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab440a11e0 0x7fab4406ec40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7fab49ced640 1 -- 172.21.15.53:0/683448376 >> 172.21.15.53:0/683448376 conn(0x7fab440a5050 msgr2=0x7fab440a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7fab49ced640 1 -- 172.21.15.53:0/683448376 shutdown_connections 2024-04-25T09:12:16.398 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.399+0000 7fab49ced640 1 -- 172.21.15.53:0/683448376 wait complete. 2024-04-25T09:12:16.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7f1cbc59d640 1 -- 172.21.15.53:0/2034397684 shutdown_connections 2024-04-25T09:12:16.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7f1cbc59d640 1 --2- 172.21.15.53:0/2034397684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 0x7f1cb413a140 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7f1cbc59d640 1 -- 172.21.15.53:0/2034397684 >> 172.21.15.53:0/2034397684 conn(0x7f1cb40a5050 msgr2=0x7f1cb40a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7f1cbc59d640 1 -- 172.21.15.53:0/2034397684 shutdown_connections 2024-04-25T09:12:16.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7f1cbc59d640 1 -- 172.21.15.53:0/2034397684 wait complete. 2024-04-25T09:12:16.399 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7fab49ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7f1fbf26d640 1 -- 172.21.15.53:0/1612661469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 msgr2=0x7f1fb8137dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7f1fbf26d640 1 --2- 172.21.15.53:0/1612661469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 0x7f1fb8137dd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.400 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7f1cbc59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7fdc0586d640 1 -- 172.21.15.53:0/2765386504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009f960 msgr2=0x7fdc0013a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7fdc0586d640 1 --2- 172.21.15.53:0/2765386504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009f960 0x7fdc0013a090 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7fdc0586d640 1 -- 172.21.15.53:0/2765386504 shutdown_connections 2024-04-25T09:12:16.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7fdc0586d640 1 --2- 172.21.15.53:0/2765386504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009f960 0x7fdc0013a090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.401 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7fdc0586d640 1 -- 172.21.15.53:0/2765386504 >> 172.21.15.53:0/2765386504 conn(0x7fdc000a3be0 msgr2=0x7fdc000a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7fdc0586d640 1 -- 172.21.15.53:0/2765386504 shutdown_connections 2024-04-25T09:12:16.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.400+0000 7fdc0586d640 1 -- 172.21.15.53:0/2765386504 wait complete. 2024-04-25T09:12:16.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.401+0000 7f1fbf26d640 1 -- 172.21.15.53:0/1612661469 shutdown_connections 2024-04-25T09:12:16.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.401+0000 7f1fbf26d640 1 --2- 172.21.15.53:0/1612661469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 0x7f1fb8137dd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.401+0000 7f1fbf26d640 1 -- 172.21.15.53:0/1612661469 >> 172.21.15.53:0/1612661469 conn(0x7f1fb80a1c00 msgr2=0x7f1fb80a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.402 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.401+0000 7fdc0586d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.401+0000 7f1fbf26d640 1 -- 172.21.15.53:0/1612661469 shutdown_connections 2024-04-25T09:12:16.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.401+0000 7f1fbf26d640 1 -- 172.21.15.53:0/1612661469 wait complete. 2024-04-25T09:12:16.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.401+0000 7f1fbf26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.403 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.402+0000 7f1cbc59d640 1 Processor -- start 2024-04-25T09:12:16.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.402+0000 7f1cbc59d640 1 -- start start 2024-04-25T09:12:16.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.402+0000 7fab49ced640 1 Processor -- start 2024-04-25T09:12:16.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.402+0000 7fab49ced640 1 -- start start 2024-04-25T09:12:16.404 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.403+0000 7f1cbc59d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 0x7f1cb41c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.403+0000 7fdc0586d640 1 Processor -- start 2024-04-25T09:12:16.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1cbc59d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb40700a0 con 0x7f1cb406ec40 2024-04-25T09:12:16.405 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1cba339640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 0x7f1cb41c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1cba339640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 0x7f1cb41c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45858/0 (socket says 172.21.15.53:45858) 2024-04-25T09:12:16.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1cba339640 1 -- 172.21.15.53:0/1961028134 learned_addr learned my addr 172.21.15.53:0/1961028134 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7fdc0586d640 1 -- start start 2024-04-25T09:12:16.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7fab49ced640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab4409fe50 0x7fab4411e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.406 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7fab49ced640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fab44120cf0 con 0x7fab4409fe50 2024-04-25T09:12:16.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1fbf26d640 1 Processor -- start 2024-04-25T09:12:16.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1cba339640 1 -- 172.21.15.53:0/1961028134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb4072170 con 0x7f1cb406ec40 2024-04-25T09:12:16.407 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1fbf26d640 1 -- start start 2024-04-25T09:12:16.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7fab437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab4409fe50 0x7fab4411e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7fab437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab4409fe50 0x7fab4411e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45870/0 (socket says 172.21.15.53:45870) 2024-04-25T09:12:16.408 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7fab437fe640 1 -- 172.21.15.53:0/3903095086 learned_addr learned my addr 172.21.15.53:0/3903095086 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1cba339640 1 --2- 172.21.15.53:0/1961028134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 0x7f1cb41c98a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1caaffd640 1 -- 172.21.15.53:0/1961028134 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1cb000c860 con 0x7f1cb406ec40 2024-04-25T09:12:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.404+0000 7f1caaffd640 1 -- 172.21.15.53:0/1961028134 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1cb000c9c0 con 0x7f1cb406ec40 2024-04-25T09:12:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.405+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb4072490 con 0x7f1cb406ec40 2024-04-25T09:12:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.405+0000 7f1caaffd640 1 -- 172.21.15.53:0/1961028134 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1cb000cc60 con 0x7f1cb406ec40 2024-04-25T09:12:16.409 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.405+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb406fd00 con 0x7f1cb406ec40 2024-04-25T09:12:16.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.405+0000 7fab437fe640 1 -- 172.21.15.53:0/3903095086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab44120700 con 0x7fab4409fe50 2024-04-25T09:12:16.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.405+0000 7fab437fe640 1 --2- 172.21.15.53:0/3903095086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab4409fe50 0x7fab4411e2f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.405+0000 7fab2bfff640 1 -- 172.21.15.53:0/3903095086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab34014540 con 0x7fab4409fe50 2024-04-25T09:12:16.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.406+0000 7f1caaffd640 1 -- 172.21.15.53:0/1961028134 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1cb0011310 con 0x7f1cb406ec40 2024-04-25T09:12:16.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.406+0000 7f1caaffd640 1 --2- 172.21.15.53:0/1961028134 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1c98038930 0x7f1c9803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.410 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.406+0000 7f1caaffd640 1 -- 172.21.15.53:0/1961028134 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7f1cb000e1c0 con 0x7f1cb406ec40 2024-04-25T09:12:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.405+0000 7fab2bfff640 1 -- 172.21.15.53:0/3903095086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab340146a0 con 0x7fab4409fe50 2024-04-25T09:12:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.405+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4412f2f0 con 0x7fab4409fe50 2024-04-25T09:12:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.405+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab441217c0 con 0x7fab4409fe50 2024-04-25T09:12:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.406+0000 7f1cbc59d640 1 --2- 172.21.15.53:0/1961028134 >> v2:172.21.15.53:6805/3736905990 conn(0x7f1cb40a11e0 0x7f1cb41c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.406+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 --> v2:172.21.15.53:6805/3736905990 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1cb406fef0 con 0x7f1cb40a11e0 2024-04-25T09:12:16.411 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab441224b0 con 0x7fab4409fe50 2024-04-25T09:12:16.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7f1cb9b38640 1 --2- 172.21.15.53:0/1961028134 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1c98038930 0x7f1c9803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7f1fbf26d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 0x7f1fb811bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fab2bfff640 1 -- 172.21.15.53:0/3903095086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab34014540 con 0x7fab4409fe50 2024-04-25T09:12:16.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7f1fbd009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 0x7f1fb811bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7f1fbd009640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 0x7f1fb811bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45876/0 (socket says 172.21.15.53:45876) 2024-04-25T09:12:16.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7f1fbd009640 1 -- 172.21.15.53:0/112509676 learned_addr learned my addr 172.21.15.53:0/112509676 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.413 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb8120090 con 0x7f1fb8132fb0 2024-04-25T09:12:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fab2bfff640 1 -- 172.21.15.53:0/3903095086 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fab34014810 con 0x7fab4409fe50 2024-04-25T09:12:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7f1cb9b38640 1 --2- 172.21.15.53:0/1961028134 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1c98038930 0x7f1c9803ae40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.414 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fab2bfff640 1 --2- 172.21.15.53:0/3903095086 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fab30038970 0x7fab3003ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fdc0586d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009ee40 0x7fdc0011e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fdc0586d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdc001222c0 con 0x7fdc0009ee40 2024-04-25T09:12:16.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fab2bfff640 1 -- 172.21.15.53:0/3903095086 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7fab34019040 con 0x7fab4409fe50 2024-04-25T09:12:16.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fab2bfff640 1 --2- 172.21.15.53:0/3903095086 >> v2:172.21.15.53:6801/3778022725 conn(0x7fab3003d970 0x7fab3003fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fab2bfff640 1 -- 172.21.15.53:0/3903095086 --> v2:172.21.15.53:6801/3778022725 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab30040490 con 0x7fab3003d970 2024-04-25T09:12:16.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fab2bfff640 1 -- 172.21.15.53:0/3903095086 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7fab3404bcc0 con 0x7fab4409fe50 2024-04-25T09:12:16.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.407+0000 7fab42ffd640 1 --2- 172.21.15.53:0/3903095086 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fab30038970 0x7fab3003ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.408+0000 7f1cbab3a640 1 --2- 172.21.15.53:0/1961028134 >> v2:172.21.15.53:6805/3736905990 conn(0x7f1cb40a11e0 0x7f1cb41c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:12:16.416 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.408+0000 7fab42ffd640 1 --2- 172.21.15.53:0/3903095086 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fab30038970 0x7fab3003ae80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.408+0000 7f1fbd009640 1 -- 172.21.15.53:0/112509676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb8130100 con 0x7f1fb8132fb0 2024-04-25T09:12:16.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.408+0000 7fdbfeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009ee40 0x7fdc0011e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.408+0000 7fdbfeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009ee40 0x7fdc0011e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45892/0 (socket says 172.21.15.53:45892) 2024-04-25T09:12:16.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.408+0000 7fdbfeffd640 1 -- 172.21.15.53:0/542319162 learned_addr learned my addr 172.21.15.53:0/542319162 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.408+0000 7f1fbd009640 1 --2- 172.21.15.53:0/112509676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 0x7f1fb811bfa0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.408+0000 7fab43fff640 1 --2- 172.21.15.53:0/3903095086 >> v2:172.21.15.53:6801/3778022725 conn(0x7fab3003d970 0x7fab3003fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:12:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.409+0000 7f1fadffb640 1 -- 172.21.15.53:0/112509676 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1fb400b880 con 0x7f1fb8132fb0 2024-04-25T09:12:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.409+0000 7f1fadffb640 1 -- 172.21.15.53:0/112509676 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1fb400b9e0 con 0x7f1fb8132fb0 2024-04-25T09:12:16.418 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.409+0000 7f1fadffb640 1 -- 172.21.15.53:0/112509676 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1fb400bc80 con 0x7f1fb8132fb0 2024-04-25T09:12:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.409+0000 7fdbfeffd640 1 -- 172.21.15.53:0/542319162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc00132500 con 0x7fdc0009ee40 2024-04-25T09:12:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.409+0000 7fdbfeffd640 1 --2- 172.21.15.53:0/542319162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009ee40 0x7fdc0011e100 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.409+0000 7fdbe7fff640 1 -- 172.21.15.53:0/542319162 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbf0004b80 con 0x7fdc0009ee40 2024-04-25T09:12:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.410+0000 7fdbe7fff640 1 -- 172.21.15.53:0/542319162 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdbf0004ce0 con 0x7fdc0009ee40 2024-04-25T09:12:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.410+0000 7fdbe7fff640 1 -- 172.21.15.53:0/542319162 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdbf0007120 con 0x7fdc0009ee40 2024-04-25T09:12:16.419 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.410+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc00121d40 con 0x7fdc0009ee40 2024-04-25T09:12:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.410+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb811e410 con 0x7f1fb8132fb0 2024-04-25T09:12:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.410+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb811f570 con 0x7f1fb8132fb0 2024-04-25T09:12:16.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.411+0000 7f1fadffb640 1 -- 172.21.15.53:0/112509676 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1fb4011380 con 0x7f1fb8132fb0 2024-04-25T09:12:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.412+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1fb8130290 con 0x7f1fb8132fb0 2024-04-25T09:12:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.412+0000 7f1fadffb640 1 --2- 172.21.15.53:0/112509676 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f9c03ce60 0x7f1f9c03f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.412+0000 7f1fadffb640 1 -- 172.21.15.53:0/112509676 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7f1fb4048bc0 con 0x7f1fb8132fb0 2024-04-25T09:12:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.412+0000 7f1fadffb640 1 --2- 172.21.15.53:0/112509676 >> v2:172.21.15.151:6806/46311736 conn(0x7f1f9c041e60 0x7f1f9c0442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.412+0000 7f1fadffb640 1 -- 172.21.15.53:0/112509676 --> v2:172.21.15.151:6806/46311736 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f9c044980 con 0x7f1f9c041e60 2024-04-25T09:12:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.412+0000 7f1fbc808640 1 --2- 172.21.15.53:0/112509676 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f9c03ce60 0x7f1f9c03f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.412+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc001215d0 con 0x7fdc0009ee40 2024-04-25T09:12:16.421 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.413+0000 7f1fadffb640 1 -- 172.21.15.53:0/112509676 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f1fb4011680 con 0x7f1fb8132fb0 2024-04-25T09:12:16.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.414+0000 7fab43fff640 1 --2- 172.21.15.53:0/3903095086 >> v2:172.21.15.53:6801/3778022725 conn(0x7fab3003d970 0x7fab3003fe00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.413+0000 7f1fbd80a640 1 --2- 172.21.15.53:0/112509676 >> v2:172.21.15.151:6806/46311736 conn(0x7f1f9c041e60 0x7f1f9c0442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:12:16.422 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.413+0000 7f1fbc808640 1 --2- 172.21.15.53:0/112509676 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f9c03ce60 0x7f1f9c03f370 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.413+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc000a0090 con 0x7fdc0009ee40 2024-04-25T09:12:16.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.413+0000 7fdbe7fff640 1 -- 172.21.15.53:0/542319162 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fdbf00072d0 con 0x7fdc0009ee40 2024-04-25T09:12:16.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.413+0000 7fdbe7fff640 1 --2- 172.21.15.53:0/542319162 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdbec038980 0x7fdbec03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.413+0000 7fdbe7fff640 1 -- 172.21.15.53:0/542319162 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7fdbf000eb10 con 0x7fdc0009ee40 2024-04-25T09:12:16.423 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.414+0000 7fdbe7fff640 1 --2- 172.21.15.53:0/542319162 >> v2:172.21.15.151:6805/3300556569 conn(0x7fdbec03e0f0 0x7fdbec0405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.414+0000 7fdbe7fff640 1 -- 172.21.15.53:0/542319162 --> v2:172.21.15.151:6805/3300556569 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbec040c70 con 0x7fdbec03e0f0 2024-04-25T09:12:16.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.414+0000 7fdbfe7fc640 1 --2- 172.21.15.53:0/542319162 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdbec038980 0x7fdbec03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.414+0000 7fdbe7fff640 1 -- 172.21.15.53:0/542319162 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7fdbf000f230 con 0x7fdc0009ee40 2024-04-25T09:12:16.424 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.414+0000 7fdbfe7fc640 1 --2- 172.21.15.53:0/542319162 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdbec038980 0x7fdbec03ae90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.414+0000 7f1cbab3a640 1 --2- 172.21.15.53:0/1961028134 >> v2:172.21.15.53:6805/3736905990 conn(0x7f1cb40a11e0 0x7f1cb41c9de0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.415+0000 7fdbff7fe640 1 --2- 172.21.15.53:0/542319162 >> v2:172.21.15.151:6805/3300556569 conn(0x7fdbec03e0f0 0x7fdbec0405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:12:16.425 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.416+0000 7fab2bfff640 1 -- 172.21.15.53:0/3903095086 <== osd.0 v2:172.21.15.53:6801/3778022725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7fab30040490 con 0x7fab3003d970 2024-04-25T09:12:16.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.417+0000 7f1caaffd640 1 -- 172.21.15.53:0/1961028134 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f1cb406fef0 con 0x7f1cb40a11e0 2024-04-25T09:12:16.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.417+0000 7f1fbd80a640 1 --2- 172.21.15.53:0/112509676 >> v2:172.21.15.151:6806/46311736 conn(0x7f1f9c041e60 0x7f1f9c0442f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.418+0000 7f1fadffb640 1 -- 172.21.15.53:0/112509676 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f1f9c044980 con 0x7f1f9c041e60 2024-04-25T09:12:16.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.419+0000 7fdbff7fe640 1 --2- 172.21.15.53:0/542319162 >> v2:172.21.15.151:6805/3300556569 conn(0x7fdbec03e0f0 0x7fdbec0405e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.421+0000 7fdbe7fff640 1 -- 172.21.15.53:0/542319162 <== osd.2 v2:172.21.15.151:6805/3300556569 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7fdbec040c70 con 0x7fdbec03e0f0 2024-04-25T09:12:16.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.422+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 --> v2:172.21.15.151:6806/46311736 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1fb8073a40 con 0x7f1f9c041e60 2024-04-25T09:12:16.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.423+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 --> v2:172.21.15.53:6801/3778022725 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab44135530 con 0x7fab3003d970 2024-04-25T09:12:16.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fadffb640 1 -- 172.21.15.53:0/112509676 <== osd.3 v2:172.21.15.151:6806/46311736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1fb000a820 con 0x7f1f9c041e60 2024-04-25T09:12:16.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 >> v2:172.21.15.151:6806/46311736 conn(0x7f1f9c041e60 msgr2=0x7f1f9c0442f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 --2- 172.21.15.53:0/112509676 >> v2:172.21.15.151:6806/46311736 conn(0x7f1f9c041e60 0x7f1f9c0442f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.428 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f9c03ce60 msgr2=0x7f1f9c03f370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 --2- 172.21.15.53:0/112509676 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f9c03ce60 0x7f1f9c03f370 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 msgr2=0x7f1fb811bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 --2- 172.21.15.53:0/112509676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 0x7f1fb811bfa0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.429 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 --> v2:172.21.15.53:6805/3736905990 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1cb411dc10 con 0x7f1cb40a11e0 2024-04-25T09:12:16.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 shutdown_connections 2024-04-25T09:12:16.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 --2- 172.21.15.53:0/112509676 >> v2:172.21.15.151:6806/46311736 conn(0x7f1f9c041e60 0x7f1f9c0442f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 --2- 172.21.15.53:0/112509676 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f9c03ce60 0x7f1f9c03f370 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 --2- 172.21.15.53:0/112509676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1fb8132fb0 0x7f1fb811bfa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 >> 172.21.15.53:0/112509676 conn(0x7f1fb80a1c00 msgr2=0x7f1fb81ba8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.424+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 shutdown_connections 2024-04-25T09:12:16.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.425+0000 7f1fbf26d640 1 -- 172.21.15.53:0/112509676 wait complete. 2024-04-25T09:12:16.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.425+0000 7fab2bfff640 1 -- 172.21.15.53:0/3903095086 <== osd.0 v2:172.21.15.53:6801/3778022725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fab3c00a820 con 0x7fab3003d970 2024-04-25T09:12:16.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 --> v2:172.21.15.151:6805/3300556569 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc0006ec50 con 0x7fdbec03e0f0 2024-04-25T09:12:16.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 >> v2:172.21.15.53:6801/3778022725 conn(0x7fab3003d970 msgr2=0x7fab3003fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 --2- 172.21.15.53:0/3903095086 >> v2:172.21.15.53:6801/3778022725 conn(0x7fab3003d970 0x7fab3003fe00 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.431 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7f1caaffd640 1 -- 172.21.15.53:0/1961028134 <== osd.1 v2:172.21.15.53:6805/3736905990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1cb411dc10 con 0x7f1cb40a11e0 2024-04-25T09:12:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fab30038970 msgr2=0x7fab3003ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 --2- 172.21.15.53:0/3903095086 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fab30038970 0x7fab3003ae80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab4409fe50 msgr2=0x7fab4411e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 --2- 172.21.15.53:0/3903095086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab4409fe50 0x7fab4411e2f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.432 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 shutdown_connections 2024-04-25T09:12:16.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 --2- 172.21.15.53:0/3903095086 >> v2:172.21.15.53:6801/3778022725 conn(0x7fab3003d970 0x7fab3003fe00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 --2- 172.21.15.53:0/3903095086 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fab30038970 0x7fab3003ae80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 --2- 172.21.15.53:0/3903095086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab4409fe50 0x7fab4411e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 >> 172.21.15.53:0/3903095086 conn(0x7fab440a5050 msgr2=0x7fab44130ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 shutdown_connections 2024-04-25T09:12:16.433 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.426+0000 7fab49ced640 1 -- 172.21.15.53:0/3903095086 wait complete. 2024-04-25T09:12:16.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 >> v2:172.21.15.53:6805/3736905990 conn(0x7f1cb40a11e0 msgr2=0x7f1cb41c9de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 --2- 172.21.15.53:0/1961028134 >> v2:172.21.15.53:6805/3736905990 conn(0x7f1cb40a11e0 0x7f1cb41c9de0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1c98038930 msgr2=0x7f1c9803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 --2- 172.21.15.53:0/1961028134 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1c98038930 0x7f1c9803ae40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 msgr2=0x7f1cb41c98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 --2- 172.21.15.53:0/1961028134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 0x7f1cb41c98a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 shutdown_connections 2024-04-25T09:12:16.434 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 --2- 172.21.15.53:0/1961028134 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1c98038930 0x7f1c9803ae40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 --2- 172.21.15.53:0/1961028134 >> v2:172.21.15.53:6805/3736905990 conn(0x7f1cb40a11e0 0x7f1cb41c9de0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 --2- 172.21.15.53:0/1961028134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1cb406ec40 0x7f1cb41c98a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 >> 172.21.15.53:0/1961028134 conn(0x7f1cb40a5050 msgr2=0x7f1cb40a18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 shutdown_connections 2024-04-25T09:12:16.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.427+0000 7f1cbc59d640 1 -- 172.21.15.53:0/1961028134 wait complete. 2024-04-25T09:12:16.435 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.428+0000 7fdbe7fff640 1 -- 172.21.15.53:0/542319162 <== osd.2 v2:172.21.15.151:6805/3300556569 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdbf800a820 con 0x7fdbec03e0f0 2024-04-25T09:12:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.428+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 >> v2:172.21.15.151:6805/3300556569 conn(0x7fdbec03e0f0 msgr2=0x7fdbec0405e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.428+0000 7fdc0586d640 1 --2- 172.21.15.53:0/542319162 >> v2:172.21.15.151:6805/3300556569 conn(0x7fdbec03e0f0 0x7fdbec0405e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdbec038980 msgr2=0x7fdbec03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 --2- 172.21.15.53:0/542319162 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdbec038980 0x7fdbec03ae90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009ee40 msgr2=0x7fdc0011e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 --2- 172.21.15.53:0/542319162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009ee40 0x7fdc0011e100 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 shutdown_connections 2024-04-25T09:12:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 --2- 172.21.15.53:0/542319162 >> v2:172.21.15.151:6805/3300556569 conn(0x7fdbec03e0f0 0x7fdbec0405e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.436 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 --2- 172.21.15.53:0/542319162 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdbec038980 0x7fdbec03ae90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 --2- 172.21.15.53:0/542319162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc0009ee40 0x7fdc0011e100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 >> 172.21.15.53:0/542319162 conn(0x7fdc000a3be0 msgr2=0x7fdc001bcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 shutdown_connections 2024-04-25T09:12:16.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.429+0000 7fdc0586d640 1 -- 172.21.15.53:0/542319162 wait complete. 2024-04-25T09:12:16.437 INFO:teuthology.orchestra.run.smithi053.stdout:38654705671 2024-04-25T09:12:16.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:12:16.439 INFO:teuthology.orchestra.run.smithi053.stdout:38654705671 2024-04-25T09:12:16.439 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:12:16.440 INFO:teuthology.orchestra.run.smithi053.stdout:38654705671 2024-04-25T09:12:16.440 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:12:16.441 INFO:teuthology.orchestra.run.smithi053.stdout:38654705671 2024-04-25T09:12:16.441 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:12:16.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.609+0000 7f326215d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.609+0000 7fde086ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.609+0000 7f428dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.609+0000 7f84af99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.615+0000 7fde086ed640 1 Processor -- start 2024-04-25T09:12:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.615+0000 7f326215d640 1 Processor -- start 2024-04-25T09:12:16.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.615+0000 7fde086ed640 1 -- start start 2024-04-25T09:12:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.615+0000 7f326215d640 1 -- start start 2024-04-25T09:12:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.615+0000 7f428dc6d640 1 Processor -- start 2024-04-25T09:12:16.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.615+0000 7f84af99d640 1 Processor -- start 2024-04-25T09:12:16.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.615+0000 7f428dc6d640 1 -- start start 2024-04-25T09:12:16.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.615+0000 7f84af99d640 1 -- start start 2024-04-25T09:12:16.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7fde086ed640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fde0009ee40 0x7fde0009f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f326215d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f325c0a11e0 0x7f325c06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7fde086ed640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0006f0b0 con 0x7fde0009f790 2024-04-25T09:12:16.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7fde086ed640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fde00073c50 con 0x7fde0009ee40 2024-04-25T09:12:16.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f326215d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325c1321e0 con 0x7f325c09fe50 2024-04-25T09:12:16.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f326215d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f325c0a0d90 con 0x7f325c0a11e0 2024-04-25T09:12:16.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7fde05c88640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fde0009f790 0x7fde001316d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60920/0 (socket says 172.21.15.53:60920) 2024-04-25T09:12:16.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7fde05c88640 1 -- 172.21.15.53:0/3295273795 learned_addr learned my addr 172.21.15.53:0/3295273795 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:16.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f325affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f325c09fe50 0x7f325c134e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60930/0 (socket says 172.21.15.53:60930) 2024-04-25T09:12:16.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f325affd640 1 -- 172.21.15.53:0/4151338713 learned_addr learned my addr 172.21.15.53:0/4151338713 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f428dc6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f428809ee40 0x7f428809f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f428dc6d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428806f0b0 con 0x7f428809f790 2024-04-25T09:12:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f428dc6d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4288073c50 con 0x7f428809ee40 2024-04-25T09:12:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f42877fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f428809ee40 0x7f428809f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f84af99d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f84a809f960 0x7f84a813a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f42877fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f428809ee40 0x7f428809f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:45914/0 (socket says 172.21.15.53:45914) 2024-04-25T09:12:16.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f42877fe640 1 -- 172.21.15.53:0/3172461366 learned_addr learned my addr 172.21.15.53:0/3172461366 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f84af99d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84a806f0b0 con 0x7f84a809ee40 2024-04-25T09:12:16.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f84af99d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f84a8073c50 con 0x7f84a809f960 2024-04-25T09:12:16.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7fde06489640 1 --2- 172.21.15.53:0/3295273795 >> v2:172.21.15.53:3300/0 conn(0x7fde0009ee40 0x7fde0009f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362924530 0 0) 0x7f325c1321e0 con 0x7f325c09fe50 2024-04-25T09:12:16.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3244003580 con 0x7f325c09fe50 2024-04-25T09:12:16.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.617+0000 7f325b7fe640 1 --2- 172.21.15.53:0/4151338713 >> v2:172.21.15.53:3300/0 conn(0x7f325c0a11e0 0x7f325c06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385390693 0 0) 0x7fde0006f0b0 con 0x7fde0009f790 2024-04-25T09:12:16.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddec003580 con 0x7fde0009f790 2024-04-25T09:12:16.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f42877fe640 1 -- 172.21.15.53:0/3172461366 >> v1:172.21.15.53:6789/0 conn(0x7f428809f790 legacy=0x7f42881316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f42877fe640 1 -- 172.21.15.53:0/3172461366 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42880a1120 con 0x7f428809ee40 2024-04-25T09:12:16.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3873711964 0 0) 0x7f3244003580 con 0x7f325c09fe50 2024-04-25T09:12:16.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 >> v2:172.21.15.53:3300/0 conn(0x7f325c0a11e0 msgr2=0x7f325c06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:16.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f325a7fc640 1 --2- 172.21.15.53:0/4151338713 >> v2:172.21.15.53:3300/0 conn(0x7f325c0a11e0 0x7f325c06ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c131ed0 con 0x7f325c09fe50 2024-04-25T09:12:16.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3144169483 0 0) 0x7f32500015a0 con 0x7f325c09fe50 2024-04-25T09:12:16.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 >> v1:172.21.15.53:6789/0 conn(0x7f325c09fe50 legacy=0x7f325c134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f325a7fc640 1 --2- 172.21.15.53:0/4151338713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32440039d0 0x7f3244003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f325c0a0d90 con 0x7f32440039d0 2024-04-25T09:12:16.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f42877fe640 1 --2- 172.21.15.53:0/3172461366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 0x7f428809f250 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c958d928abb7e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3756547150 0 0) 0x7fddec003580 con 0x7fde0009f790 2024-04-25T09:12:16.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 >> v2:172.21.15.53:3300/0 conn(0x7fde0009ee40 msgr2=0x7fde0009f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:16.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 --2- 172.21.15.53:0/3295273795 >> v2:172.21.15.53:3300/0 conn(0x7fde0009ee40 0x7fde0009f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde000a1120 con 0x7fde0009f790 2024-04-25T09:12:16.613 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3144169483 0 0) 0x7fddf00015a0 con 0x7fde0009f790 2024-04-25T09:12:16.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f84ad739640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f84a809ee40 0x7f84a809f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60938/0 (socket says 172.21.15.53:60938) 2024-04-25T09:12:16.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f84ad739640 1 -- 172.21.15.53:0/2489353725 learned_addr learned my addr 172.21.15.53:0/2489353725 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:16.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f84acf38640 1 --2- 172.21.15.53:0/2489353725 >> v2:172.21.15.53:3300/0 conn(0x7f84a809f960 0x7f84a813a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 >> v1:172.21.15.53:6789/0 conn(0x7fde0009f790 legacy=0x7fde001316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 --2- 172.21.15.53:0/3295273795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fddec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.614 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fddec004530 con 0x7fddec003a20 2024-04-25T09:12:16.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f325b7fe640 1 --2- 172.21.15.53:0/4151338713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32440039d0 0x7f3244003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f42867fc640 1 -- 172.21.15.53:0/3172461366 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f428000e040 con 0x7f428809ee40 2024-04-25T09:12:16.615 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7fde06489640 1 --2- 172.21.15.53:0/3295273795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fddec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.618+0000 7f42867fc640 1 -- 172.21.15.53:0/3172461366 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f42800091e0 con 0x7f428809ee40 2024-04-25T09:12:16.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f849ffff640 1 -- 172.21.15.53:0/2489353725 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615907395 0 0) 0x7f84a806f0b0 con 0x7f84a809ee40 2024-04-25T09:12:16.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f849ffff640 1 -- 172.21.15.53:0/2489353725 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8494003580 con 0x7f84a809ee40 2024-04-25T09:12:16.616 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f42867fc640 1 -- 172.21.15.53:0/3172461366 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4280007730 con 0x7f428809ee40 2024-04-25T09:12:16.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f325b7fe640 1 -- 172.21.15.53:0/4151338713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c131ed0 con 0x7f32440039d0 2024-04-25T09:12:16.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f84acf38640 1 -- 172.21.15.53:0/2489353725 >> v1:172.21.15.53:6789/0 conn(0x7f84a809ee40 legacy=0x7f84a809f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f849ffff640 1 -- 172.21.15.53:0/2489353725 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2715018723 0 0) 0x7f8494003580 con 0x7f84a809ee40 2024-04-25T09:12:16.617 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f84acf38640 1 -- 172.21.15.53:0/2489353725 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a80a1120 con 0x7f84a809f960 2024-04-25T09:12:16.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f325b7fe640 1 --2- 172.21.15.53:0/4151338713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32440039d0 0x7f3244003e20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239067cf2cdd969d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7fde06489640 1 -- 172.21.15.53:0/3295273795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddec003580 con 0x7fddec003a20 2024-04-25T09:12:16.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f84acf38640 1 --2- 172.21.15.53:0/2489353725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809f960 0x7f84a813a090 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f3028b9a8e25ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.618 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f324c009600 con 0x7f32440039d0 2024-04-25T09:12:16.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f324c00c040 con 0x7f32440039d0 2024-04-25T09:12:16.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7fde06489640 1 --2- 172.21.15.53:0/3295273795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fddec003e70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4845604be4560ab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f325a7fc640 1 -- 172.21.15.53:0/4151338713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f324c009c40 con 0x7f32440039d0 2024-04-25T09:12:16.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fddfc0096f0 con 0x7fddec003a20 2024-04-25T09:12:16.619 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fddfc009d90 con 0x7fddec003a20 2024-04-25T09:12:16.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f849ffff640 1 -- 172.21.15.53:0/2489353725 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84a40015a0 con 0x7f84a809f960 2024-04-25T09:12:16.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.619+0000 7f849ffff640 1 -- 172.21.15.53:0/2489353725 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8498009b50 con 0x7f84a809f960 2024-04-25T09:12:16.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f849ffff640 1 -- 172.21.15.53:0/2489353725 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8498009df0 con 0x7f84a809f960 2024-04-25T09:12:16.620 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7fde05487640 1 -- 172.21.15.53:0/3295273795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fddfc0096f0 con 0x7fddec003a20 2024-04-25T09:12:16.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f428dc6d640 1 -- 172.21.15.53:0/3172461366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 msgr2=0x7f428809f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f428dc6d640 1 --2- 172.21.15.53:0/3172461366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 0x7f428809f250 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f428dc6d640 1 -- 172.21.15.53:0/3172461366 shutdown_connections 2024-04-25T09:12:16.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f428dc6d640 1 --2- 172.21.15.53:0/3172461366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 0x7f428809f250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f428dc6d640 1 -- 172.21.15.53:0/3172461366 >> 172.21.15.53:0/3172461366 conn(0x7f42880a3be0 msgr2=0x7f42880a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f428dc6d640 1 -- 172.21.15.53:0/3172461366 shutdown_connections 2024-04-25T09:12:16.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f428dc6d640 1 -- 172.21.15.53:0/3172461366 wait complete. 2024-04-25T09:12:16.621 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f428dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f326215d640 1 -- 172.21.15.53:0/4151338713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32440039d0 msgr2=0x7f3244003e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f326215d640 1 --2- 172.21.15.53:0/4151338713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32440039d0 0x7f3244003e20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f84af99d640 1 -- 172.21.15.53:0/2489353725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809f960 msgr2=0x7f84a813a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.622 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f84af99d640 1 --2- 172.21.15.53:0/2489353725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809f960 0x7f84a813a090 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f326215d640 1 -- 172.21.15.53:0/4151338713 shutdown_connections 2024-04-25T09:12:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f326215d640 1 --2- 172.21.15.53:0/4151338713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32440039d0 0x7f3244003e20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f326215d640 1 --2- 172.21.15.53:0/4151338713 >> v2:172.21.15.53:3300/0 conn(0x7f325c0a11e0 0x7f325c06ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.620+0000 7f326215d640 1 -- 172.21.15.53:0/4151338713 >> 172.21.15.53:0/4151338713 conn(0x7f325c0a5050 msgr2=0x7f325c0a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.623 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7f84af99d640 1 -- 172.21.15.53:0/2489353725 shutdown_connections 2024-04-25T09:12:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7f326215d640 1 -- 172.21.15.53:0/4151338713 shutdown_connections 2024-04-25T09:12:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7f84af99d640 1 --2- 172.21.15.53:0/2489353725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809f960 0x7f84a813a090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7f326215d640 1 -- 172.21.15.53:0/4151338713 wait complete. 2024-04-25T09:12:16.624 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7f84af99d640 1 -- 172.21.15.53:0/2489353725 >> 172.21.15.53:0/2489353725 conn(0x7f84a80a3be0 msgr2=0x7f84a80a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7fde086ed640 1 -- 172.21.15.53:0/3295273795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 msgr2=0x7fddec003e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7fde086ed640 1 --2- 172.21.15.53:0/3295273795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fddec003e70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7f84af99d640 1 -- 172.21.15.53:0/2489353725 shutdown_connections 2024-04-25T09:12:16.625 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7fde086ed640 1 -- 172.21.15.53:0/3295273795 shutdown_connections 2024-04-25T09:12:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7fde086ed640 1 --2- 172.21.15.53:0/3295273795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fddec003e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7fde086ed640 1 --2- 172.21.15.53:0/3295273795 >> v2:172.21.15.53:3300/0 conn(0x7fde0009ee40 0x7fde0009f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7fde086ed640 1 -- 172.21.15.53:0/3295273795 >> 172.21.15.53:0/3295273795 conn(0x7fde000a3be0 msgr2=0x7fde000a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7f84af99d640 1 -- 172.21.15.53:0/2489353725 wait complete. 2024-04-25T09:12:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7f326215d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.626 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7fde086ed640 1 -- 172.21.15.53:0/3295273795 shutdown_connections 2024-04-25T09:12:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7fde086ed640 1 -- 172.21.15.53:0/3295273795 wait complete. 2024-04-25T09:12:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7f84af99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.627 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.621+0000 7fde086ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.622+0000 7f428dc6d640 1 Processor -- start 2024-04-25T09:12:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.623+0000 7f428dc6d640 1 -- start start 2024-04-25T09:12:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.623+0000 7fde086ed640 1 Processor -- start 2024-04-25T09:12:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.623+0000 7fde086ed640 1 -- start start 2024-04-25T09:12:16.628 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.624+0000 7f326215d640 1 Processor -- start 2024-04-25T09:12:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.624+0000 7f326215d640 1 -- start start 2024-04-25T09:12:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.624+0000 7f428dc6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 0x7f428811e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.624+0000 7f428dc6d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4288121890 con 0x7f428809ee40 2024-04-25T09:12:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.624+0000 7f42877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 0x7f428811e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.629 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.624+0000 7f84af99d640 1 Processor -- start 2024-04-25T09:12:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.624+0000 7f42877fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 0x7f428811e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55338/0 (socket says 172.21.15.53:55338) 2024-04-25T09:12:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.624+0000 7f42877fe640 1 -- 172.21.15.53:0/3799216637 learned_addr learned my addr 172.21.15.53:0/3799216637 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.624+0000 7f84af99d640 1 -- start start 2024-04-25T09:12:16.630 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7f42877fe640 1 -- 172.21.15.53:0/3799216637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4288074f10 con 0x7f428809ee40 2024-04-25T09:12:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7f42877fe640 1 --2- 172.21.15.53:0/3799216637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 0x7f428811e280 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7f427ffff640 1 -- 172.21.15.53:0/3799216637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f428000e040 con 0x7f428809ee40 2024-04-25T09:12:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7fde086ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fde0011e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7fde086ed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fde0011fb40 con 0x7fddec003a20 2024-04-25T09:12:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7f427ffff640 1 -- 172.21.15.53:0/3799216637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4280007e80 con 0x7f428809ee40 2024-04-25T09:12:16.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4288132540 con 0x7f428809ee40 2024-04-25T09:12:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7fde06489640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fde0011e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7fde06489640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fde0011e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55354/0 (socket says 172.21.15.53:55354) 2024-04-25T09:12:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7fde06489640 1 -- 172.21.15.53:0/697951317 learned_addr learned my addr 172.21.15.53:0/697951317 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7fde06489640 1 -- 172.21.15.53:0/697951317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0011e310 con 0x7fddec003a20 2024-04-25T09:12:16.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7fde06489640 1 --2- 172.21.15.53:0/697951317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fde0011e840 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.625+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42881222b0 con 0x7f428809ee40 2024-04-25T09:12:16.633 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7f427ffff640 1 -- 172.21.15.53:0/3799216637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f42800118a0 con 0x7f428809ee40 2024-04-25T09:12:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7fddf6ffd640 1 -- 172.21.15.53:0/697951317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fddfc003a90 con 0x7fddec003a20 2024-04-25T09:12:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde00120370 con 0x7fddec003a20 2024-04-25T09:12:16.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde00121a70 con 0x7fddec003a20 2024-04-25T09:12:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7f427ffff640 1 -- 172.21.15.53:0/3799216637 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4280011a50 con 0x7f428809ee40 2024-04-25T09:12:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7f326215d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f325c09fe50 0x7f325c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.635 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7fddf6ffd640 1 -- 172.21.15.53:0/697951317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fddfc003bf0 con 0x7fddec003a20 2024-04-25T09:12:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.626+0000 7fddf6ffd640 1 -- 172.21.15.53:0/697951317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fddfc003e90 con 0x7fddec003a20 2024-04-25T09:12:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f427ffff640 1 --2- 172.21.15.53:0/3799216637 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f42680389b0 0x7f426803aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.636 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f325b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f325c09fe50 0x7f325c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f325b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f325c09fe50 0x7f325c071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55366/0 (socket says 172.21.15.53:55366) 2024-04-25T09:12:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f325b7fe640 1 -- 172.21.15.53:0/1095782759 learned_addr learned my addr 172.21.15.53:0/1095782759 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f325c12f590 con 0x7f325c09fe50 2024-04-25T09:12:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f427ffff640 1 -- 172.21.15.53:0/3799216637 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7f4280049550 con 0x7f428809ee40 2024-04-25T09:12:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f84af99d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809ee40 0x7f84a811e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f84ad739640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809ee40 0x7f84a811e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f4286ffd640 1 --2- 172.21.15.53:0/3799216637 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f42680389b0 0x7f426803aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f84ad739640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809ee40 0x7f84a811e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55370/0 (socket says 172.21.15.53:55370) 2024-04-25T09:12:16.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f84ad739640 1 -- 172.21.15.53:0/1889738201 learned_addr learned my addr 172.21.15.53:0/1889738201 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:16.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f84a8121800 con 0x7f84a809ee40 2024-04-25T09:12:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.627+0000 7f325b7fe640 1 -- 172.21.15.53:0/1095782759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c071090 con 0x7f325c09fe50 2024-04-25T09:12:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4288132520 con 0x7f428809ee40 2024-04-25T09:12:16.639 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7f325b7fe640 1 --2- 172.21.15.53:0/1095782759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f325c09fe50 0x7f325c071ab0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde80050f0 con 0x7fddec003a20 2024-04-25T09:12:16.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7fddf6ffd640 1 -- 172.21.15.53:0/697951317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fddfc015420 con 0x7fddec003a20 2024-04-25T09:12:16.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7fddf6ffd640 1 --2- 172.21.15.53:0/697951317 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdde40389d0 0x7fdde403aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.640 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7f84ad739640 1 -- 172.21.15.53:0/1889738201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a811f400 con 0x7f84a809ee40 2024-04-25T09:12:16.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7f3243fff640 1 -- 172.21.15.53:0/1095782759 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f324c0045b0 con 0x7f325c09fe50 2024-04-25T09:12:16.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7f3243fff640 1 -- 172.21.15.53:0/1095782759 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f324c003670 con 0x7f325c09fe50 2024-04-25T09:12:16.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7f3243fff640 1 -- 172.21.15.53:0/1095782759 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f324c003910 con 0x7f325c09fe50 2024-04-25T09:12:16.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f325c071660 con 0x7f325c09fe50 2024-04-25T09:12:16.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7fddf6ffd640 1 -- 172.21.15.53:0/697951317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7fddfc0495e0 con 0x7fddec003a20 2024-04-25T09:12:16.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f325c0712c0 con 0x7f325c09fe50 2024-04-25T09:12:16.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7fde05c88640 1 --2- 172.21.15.53:0/697951317 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdde40389d0 0x7fdde403aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.628+0000 7f84ad739640 1 --2- 172.21.15.53:0/1889738201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809ee40 0x7f84a811e100 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.629+0000 7f4286ffd640 1 --2- 172.21.15.53:0/3799216637 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f42680389b0 0x7f426803aec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.629+0000 7fde05c88640 1 --2- 172.21.15.53:0/697951317 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdde40389d0 0x7fdde403aee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.629+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325c063880 con 0x7f325c09fe50 2024-04-25T09:12:16.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.633+0000 7f427ffff640 1 -- 172.21.15.53:0/3799216637 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f4280015970 con 0x7f428809ee40 2024-04-25T09:12:16.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.639+0000 7fddf6ffd640 1 -- 172.21.15.53:0/697951317 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fddfc00f420 con 0x7fddec003a20 2024-04-25T09:12:16.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.639+0000 7f849dffb640 1 -- 172.21.15.53:0/1889738201 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84a4004b80 con 0x7f84a809ee40 2024-04-25T09:12:16.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.639+0000 7f849dffb640 1 -- 172.21.15.53:0/1889738201 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f84a4004ce0 con 0x7f84a809ee40 2024-04-25T09:12:16.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.639+0000 7f849dffb640 1 -- 172.21.15.53:0/1889738201 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84a4007120 con 0x7f84a809ee40 2024-04-25T09:12:16.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.639+0000 7f3243fff640 1 -- 172.21.15.53:0/1095782759 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f324c003a70 con 0x7f325c09fe50 2024-04-25T09:12:16.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.640+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a8074f80 con 0x7f84a809ee40 2024-04-25T09:12:16.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.640+0000 7f3243fff640 1 --2- 172.21.15.53:0/1095782759 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3248038a20 0x7f324803af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.645 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.640+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a811fd20 con 0x7f84a809ee40 2024-04-25T09:12:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.640+0000 7f3243fff640 1 -- 172.21.15.53:0/1095782759 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7f324c049290 con 0x7f325c09fe50 2024-04-25T09:12:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.640+0000 7f325affd640 1 --2- 172.21.15.53:0/1095782759 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3248038a20 0x7f324803af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.641+0000 7f325affd640 1 --2- 172.21.15.53:0/1095782759 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3248038a20 0x7f324803af30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.641+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a8133de0 con 0x7f84a809ee40 2024-04-25T09:12:16.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.645+0000 7f3243fff640 1 -- 172.21.15.53:0/1095782759 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f324c015c80 con 0x7f325c09fe50 2024-04-25T09:12:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.646+0000 7f849dffb640 1 -- 172.21.15.53:0/1889738201 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f84a4007310 con 0x7f84a809ee40 2024-04-25T09:12:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.646+0000 7f849dffb640 1 --2- 172.21.15.53:0/1889738201 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f848c0389d0 0x7f848c03aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.646+0000 7f849dffb640 1 -- 172.21.15.53:0/1889738201 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7f84a4048430 con 0x7f84a809ee40 2024-04-25T09:12:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.647+0000 7f84acf38640 1 --2- 172.21.15.53:0/1889738201 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f848c0389d0 0x7f848c03aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.648+0000 7f84acf38640 1 --2- 172.21.15.53:0/1889738201 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f848c0389d0 0x7f848c03aee0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:16.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.651+0000 7f849dffb640 1 -- 172.21.15.53:0/1889738201 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f84a400d520 con 0x7f84a809ee40 2024-04-25T09:12:16.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.846+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdde80053a0 con 0x7fddec003a20 2024-04-25T09:12:16.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.847+0000 7fddf6ffd640 1 -- 172.21.15.53:0/697951317 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fddfc011320 con 0x7fddec003a20 2024-04-25T09:12:16.834 INFO:teuthology.orchestra.run.smithi053.stdout:38654705671 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdde40389d0 msgr2=0x7fdde403aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 --2- 172.21.15.53:0/697951317 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdde40389d0 0x7fdde403aee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 msgr2=0x7fde0011e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 --2- 172.21.15.53:0/697951317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fde0011e840 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 shutdown_connections 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 --2- 172.21.15.53:0/697951317 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdde40389d0 0x7fdde403aee0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 --2- 172.21.15.53:0/697951317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fddec003a20 0x7fde0011e840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 >> 172.21.15.53:0/697951317 conn(0x7fde000a3be0 msgr2=0x7fde001bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 shutdown_connections 2024-04-25T09:12:16.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.849+0000 7fde086ed640 1 -- 172.21.15.53:0/697951317 wait complete. 2024-04-25T09:12:16.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.852+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f428811fdc0 con 0x7f428809ee40 2024-04-25T09:12:16.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.852+0000 7f427ffff640 1 -- 172.21.15.53:0/3799216637 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f428000f210 con 0x7f428809ee40 2024-04-25T09:12:16.839 INFO:teuthology.orchestra.run.smithi053.stdout:38654705671 2024-04-25T09:12:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.855+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f42680389b0 msgr2=0x7f426803aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.855+0000 7f428dc6d640 1 --2- 172.21.15.53:0/3799216637 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f42680389b0 0x7f426803aec0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.855+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 msgr2=0x7f428811e280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.855+0000 7f428dc6d640 1 --2- 172.21.15.53:0/3799216637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 0x7f428811e280 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.855+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 shutdown_connections 2024-04-25T09:12:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.855+0000 7f428dc6d640 1 --2- 172.21.15.53:0/3799216637 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f42680389b0 0x7f426803aec0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.855+0000 7f428dc6d640 1 --2- 172.21.15.53:0/3799216637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f428809ee40 0x7f428811e280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.855+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 >> 172.21.15.53:0/3799216637 conn(0x7f42880a3be0 msgr2=0x7f42880a5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.855+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f325c073c90 con 0x7f325c09fe50 2024-04-25T09:12:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.856+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 shutdown_connections 2024-04-25T09:12:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.856+0000 7f428dc6d640 1 -- 172.21.15.53:0/3799216637 wait complete. 2024-04-25T09:12:16.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.856+0000 7f3243fff640 1 -- 172.21.15.53:0/1095782759 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f324c015870 con 0x7f325c09fe50 2024-04-25T09:12:16.844 INFO:teuthology.orchestra.run.smithi053.stdout:38654705671 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3248038a20 msgr2=0x7f324803af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 --2- 172.21.15.53:0/1095782759 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3248038a20 0x7f324803af30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f325c09fe50 msgr2=0x7f325c071ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 --2- 172.21.15.53:0/1095782759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f325c09fe50 0x7f325c071ab0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 shutdown_connections 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 --2- 172.21.15.53:0/1095782759 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3248038a20 0x7f324803af30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 --2- 172.21.15.53:0/1095782759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f325c09fe50 0x7f325c071ab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 >> 172.21.15.53:0/1095782759 conn(0x7f325c0a5050 msgr2=0x7f325c1bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 shutdown_connections 2024-04-25T09:12:16.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.859+0000 7f326215d640 1 -- 172.21.15.53:0/1095782759 wait complete. 2024-04-25T09:12:16.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-04-25T09:12:16.849 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:16.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-04-25T09:12:16.859 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:16.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2024-04-25T09:12:16.860 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:16.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.879+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f84a8074f80 con 0x7f84a809ee40 2024-04-25T09:12:16.866 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.879+0000 7f849dffb640 1 -- 172.21.15.53:0/1889738201 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f84a8074f80 con 0x7f84a809ee40 2024-04-25T09:12:16.866 INFO:teuthology.orchestra.run.smithi053.stdout:38654705671 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f848c0389d0 msgr2=0x7f848c03aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 --2- 172.21.15.53:0/1889738201 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f848c0389d0 0x7f848c03aee0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809ee40 msgr2=0x7f84a811e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 --2- 172.21.15.53:0/1889738201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809ee40 0x7f84a811e100 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 shutdown_connections 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 --2- 172.21.15.53:0/1889738201 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f848c0389d0 0x7f848c03aee0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 --2- 172.21.15.53:0/1889738201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84a809ee40 0x7f84a811e100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 >> 172.21.15.53:0/1889738201 conn(0x7f84a80a3be0 msgr2=0x7f84a81bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 shutdown_connections 2024-04-25T09:12:16.869 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:16.882+0000 7f84af99d640 1 -- 172.21.15.53:0/1889738201 wait complete. 2024-04-25T09:12:16.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-04-25T09:12:16.879 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:16.879 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:12:16.879 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:17.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.039+0000 7fbaaa06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:17.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.044+0000 7fbaaa06d640 1 Processor -- start 2024-04-25T09:12:17.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.044+0000 7fbaaa06d640 1 -- start start 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.046+0000 7fbaaa06d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbaa409f6c0 0x7fbaa409fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.046+0000 7fbaaa06d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa4070d80 con 0x7fbaa40a0010 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.046+0000 7fbaaa06d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa40717b0 con 0x7fbaa409f6c0 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.046+0000 7fbaa37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbaa409f6c0 0x7fbaa409fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.046+0000 7fbaa2ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbaa40a0010 0x7fbaa41329f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60414/0 (socket says 172.21.15.53:60414) 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.046+0000 7fbaa2ffd640 1 -- 172.21.15.53:0/960979704 learned_addr learned my addr 172.21.15.53:0/960979704 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.046+0000 7fbaa37fe640 1 -- 172.21.15.53:0/960979704 >> v1:172.21.15.53:6789/0 conn(0x7fbaa40a0010 legacy=0x7fbaa41329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.046+0000 7fbaa37fe640 1 -- 172.21.15.53:0/960979704 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa4072330 con 0x7fbaa409f6c0 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.046+0000 7fbaa27fc640 1 -- 172.21.15.53:0/960979704 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166799704 0 0) 0x7fbaa4070d80 con 0x7fbaa40a0010 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.047+0000 7fbaa37fe640 1 --2- 172.21.15.53:0/960979704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 0x7fbaa409fad0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babb35c8c6a633d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.047+0000 7fbaa27fc640 1 -- 172.21.15.53:0/960979704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fba94009d90 con 0x7fbaa409f6c0 2024-04-25T09:12:17.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.047+0000 7fbaa27fc640 1 -- 172.21.15.53:0/960979704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fba9400e230 con 0x7fbaa409f6c0 2024-04-25T09:12:17.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.047+0000 7fbaa27fc640 1 -- 172.21.15.53:0/960979704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fba9400e4d0 con 0x7fbaa409f6c0 2024-04-25T09:12:17.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.047+0000 7fbaaa06d640 1 -- 172.21.15.53:0/960979704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 msgr2=0x7fbaa409fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.047+0000 7fbaaa06d640 1 --2- 172.21.15.53:0/960979704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 0x7fbaa409fad0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.047+0000 7fbaaa06d640 1 -- 172.21.15.53:0/960979704 shutdown_connections 2024-04-25T09:12:17.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.047+0000 7fbaaa06d640 1 --2- 172.21.15.53:0/960979704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 0x7fbaa409fad0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.047+0000 7fbaaa06d640 1 -- 172.21.15.53:0/960979704 >> 172.21.15.53:0/960979704 conn(0x7fbaa40a1960 msgr2=0x7fbaa40a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.048+0000 7fbaaa06d640 1 -- 172.21.15.53:0/960979704 shutdown_connections 2024-04-25T09:12:17.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.048+0000 7fbaaa06d640 1 -- 172.21.15.53:0/960979704 wait complete. 2024-04-25T09:12:17.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.048+0000 7fbaaa06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:17.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.049+0000 7fbaaa06d640 1 Processor -- start 2024-04-25T09:12:17.036 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.050+0000 7fbaaa06d640 1 -- start start 2024-04-25T09:12:17.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.051+0000 7fbaaa06d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 0x7fbaa406e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.039 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.051+0000 7fbaaa06d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4070560 con 0x7fbaa409f6c0 2024-04-25T09:12:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.051+0000 7fbaa37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 0x7fbaa406e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.051+0000 7fbaa37fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 0x7fbaa406e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55400/0 (socket says 172.21.15.53:55400) 2024-04-25T09:12:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.051+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2904679985 learned_addr learned my addr 172.21.15.53:0/2904679985 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.052+0000 7fbaa37fe640 1 -- 172.21.15.53:0/2904679985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa41215f0 con 0x7fbaa409f6c0 2024-04-25T09:12:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.052+0000 7fbaa37fe640 1 --2- 172.21.15.53:0/2904679985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 0x7fbaa406e9c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.040 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.052+0000 7fba8bfff640 1 -- 172.21.15.53:0/2904679985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fba94014620 con 0x7fbaa409f6c0 2024-04-25T09:12:17.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.052+0000 7fba8bfff640 1 -- 172.21.15.53:0/2904679985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fba94014780 con 0x7fbaa409f6c0 2024-04-25T09:12:17.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.052+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa4122070 con 0x7fbaa409f6c0 2024-04-25T09:12:17.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.052+0000 7fba8bfff640 1 -- 172.21.15.53:0/2904679985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fba94014a20 con 0x7fbaa409f6c0 2024-04-25T09:12:17.041 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.052+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa4120ac0 con 0x7fbaa409f6c0 2024-04-25T09:12:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.053+0000 7fba8bfff640 1 -- 172.21.15.53:0/2904679985 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fba94014bd0 con 0x7fbaa409f6c0 2024-04-25T09:12:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.053+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa40692b0 con 0x7fbaa409f6c0 2024-04-25T09:12:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.053+0000 7fba8bfff640 1 --2- 172.21.15.53:0/2904679985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fba90038a00 0x7fba9003af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.053+0000 7fba8bfff640 1 -- 172.21.15.53:0/2904679985 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7fba94019040 con 0x7fbaa409f6c0 2024-04-25T09:12:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.054+0000 7fbaa2ffd640 1 --2- 172.21.15.53:0/2904679985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fba90038a00 0x7fba9003af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.042 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.054+0000 7fbaa2ffd640 1 --2- 172.21.15.53:0/2904679985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fba90038a00 0x7fba9003af10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.045 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.059+0000 7fba8bfff640 1 -- 172.21.15.53:0/2904679985 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fba94013e40 con 0x7fbaa409f6c0 2024-04-25T09:12:17.230 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.244+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbaa4121480 con 0x7fba90038a00 2024-04-25T09:12:17.232 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.245+0000 7fba8bfff640 1 -- 172.21.15.53:0/2904679985 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31069 (crc 0 0 0) 0x7fbaa4121480 con 0x7fba90038a00 2024-04-25T09:12:17.233 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:12:17.233 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.247+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fba90038a00 msgr2=0x7fba9003af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.247+0000 7fbaaa06d640 1 --2- 172.21.15.53:0/2904679985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fba90038a00 0x7fba9003af10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.247+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 msgr2=0x7fbaa406e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.247+0000 7fbaaa06d640 1 --2- 172.21.15.53:0/2904679985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 0x7fbaa406e9c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.247+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 shutdown_connections 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.247+0000 7fbaaa06d640 1 --2- 172.21.15.53:0/2904679985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fba90038a00 0x7fba9003af10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.247+0000 7fbaaa06d640 1 --2- 172.21.15.53:0/2904679985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbaa409f6c0 0x7fbaa406e9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.247+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 >> 172.21.15.53:0/2904679985 conn(0x7fbaa40a1960 msgr2=0x7fbaa41b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.248+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 shutdown_connections 2024-04-25T09:12:17.235 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.248+0000 7fbaaa06d640 1 -- 172.21.15.53:0/2904679985 wait complete. 2024-04-25T09:12:17.245 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-04-25T09:12:17.125716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109808,"kb_used_data":1624,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320592,"statfs":{"total":429496729600,"available":429384286208,"internally_reserved":0,"allocated":1662976,"data_stored":1299808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.696049"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.259914+0000","last_change":"2024-04-25T09:12:15.261642+0000","last_active":"2024-04-25T09:12:15.259914+0000","last_peered":"2024-04-25T09:12:15.259914+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.255284+0000","last_became_peered":"2024-04-25T09:12:15.255284+0000","last_unstale":"2024-04-25T09:12:15.259914+0000","last_undegraded":"2024-04-25T09:12:15.259914+0000","last_fullsized":"2024-04-25T09:12:15.259914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:12:16.195569+0000","last_change":"2024-04-25T09:12:15.237133+0000","last_active":"2024-04-25T09:12:16.195569+0000","last_peered":"2024-04-25T09:12:16.195569+0000","last_clean":"2024-04-25T09:12:16.195569+0000","last_became_active":"2024-04-25T09:12:15.231593+0000","last_became_peered":"2024-04-25T09:12:15.231593+0000","last_unstale":"2024-04-25T09:12:16.195569+0000","last_undegraded":"2024-04-25T09:12:16.195569+0000","last_fullsized":"2024-04-25T09:12:16.195569+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.243098+0000","last_change":"2024-04-25T09:12:15.244463+0000","last_active":"2024-04-25T09:12:15.243098+0000","last_peered":"2024-04-25T09:12:15.243098+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.239187+0000","last_became_peered":"2024-04-25T09:12:15.239187+0000","last_unstale":"2024-04-25T09:12:15.243098+0000","last_undegraded":"2024-04-25T09:12:15.243098+0000","last_fullsized":"2024-04-25T09:12:15.243098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:12:16.191915+0000","last_change":"2024-04-25T09:12:15.226592+0000","last_active":"2024-04-25T09:12:16.191915+0000","last_peered":"2024-04-25T09:12:16.191915+0000","last_clean":"2024-04-25T09:12:16.191915+0000","last_became_active":"2024-04-25T09:12:15.221443+0000","last_became_peered":"2024-04-25T09:12:15.221443+0000","last_unstale":"2024-04-25T09:12:16.191915+0000","last_undegraded":"2024-04-25T09:12:16.191915+0000","last_fullsized":"2024-04-25T09:12:16.191915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.241099+0000","last_change":"2024-04-25T09:12:15.242605+0000","last_active":"2024-04-25T09:12:15.241099+0000","last_peered":"2024-04-25T09:12:15.241099+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.236080+0000","last_became_peered":"2024-04-25T09:12:15.236080+0000","last_unstale":"2024-04-25T09:12:15.241099+0000","last_undegraded":"2024-04-25T09:12:15.241099+0000","last_fullsized":"2024-04-25T09:12:15.241099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.243655+0000","last_change":"2024-04-25T09:12:15.245278+0000","last_active":"2024-04-25T09:12:15.243655+0000","last_peered":"2024-04-25T09:12:15.243655+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.239643+0000","last_became_peered":"2024-04-25T09:12:15.239643+0000","last_unstale":"2024-04-25T09:12:15.243655+0000","last_undegraded":"2024-04-25T09:12:15.243655+0000","last_fullsized":"2024-04-25T09:12:15.243655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.245920+0000","last_change":"2024-04-25T09:12:15.247151+0000","last_active":"2024-04-25T09:12:15.245920+0000","last_peered":"2024-04-25T09:12:15.245920+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.241282+0000","last_became_peered":"2024-04-25T09:12:15.241282+0000","last_unstale":"2024-04-25T09:12:15.245920+0000","last_undegraded":"2024-04-25T09:12:15.245920+0000","last_fullsized":"2024-04-25T09:12:15.245920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.256336+0000","last_change":"2024-04-25T09:12:15.257926+0000","last_active":"2024-04-25T09:12:15.256336+0000","last_peered":"2024-04-25T09:12:15.256336+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.252630+0000","last_became_peered":"2024-04-25T09:12:15.252630+0000","last_unstale":"2024-04-25T09:12:15.256336+0000","last_undegraded":"2024-04-25T09:12:15.256336+0000","last_fullsized":"2024-04-25T09:12:15.256336+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":144,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.191498+0000","last_change":"2024-04-25T09:12:12.208622+0000","last_active":"2024-04-25T09:12:15.191498+0000","last_peered":"2024-04-25T09:12:15.191498+0000","last_clean":"2024-04-25T09:12:15.191498+0000","last_became_active":"2024-04-25T09:12:12.203665+0000","last_became_peered":"2024-04-25T09:12:12.203665+0000","last_unstale":"2024-04-25T09:12:15.191498+0000","last_undegraded":"2024-04-25T09:12:15.191498+0000","last_fullsized":"2024-04-25T09:12:15.191498+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_clean_scrub_stamp":"2024-04-25T09:12:11.160311+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27836,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829764,"statfs":{"total":107374182400,"available":107345678336,"internally_reserved":0,"allocated":712704,"data_stored":620136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27068,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":118784,"data_stored":29768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27068,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":118784,"data_stored":29768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27836,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829764,"statfs":{"total":107374182400,"available":107345678336,"internally_reserved":0,"allocated":712704,"data_stored":620136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:17.247 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:17.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.367+0000 7ff2f8f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.372+0000 7ff2f8f5d640 1 Processor -- start 2024-04-25T09:12:17.359 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.372+0000 7ff2f8f5d640 1 -- start start 2024-04-25T09:12:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.373+0000 7ff2f8f5d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2f40a01e0 0x7ff2f4138120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.373+0000 7ff2f8f5d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f406dda0 con 0x7ff2f409f6c0 2024-04-25T09:12:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.373+0000 7ff2f8f5d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f406e2e0 con 0x7ff2f40a01e0 2024-04-25T09:12:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.374+0000 7ff2ebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2f40a01e0 0x7ff2f4138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.374+0000 7ff2f259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff2f409f6c0 0x7ff2f409fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60426/0 (socket says 172.21.15.53:60426) 2024-04-25T09:12:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.374+0000 7ff2f259c640 1 -- 172.21.15.53:0/1334841004 learned_addr learned my addr 172.21.15.53:0/1334841004 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.374+0000 7ff2ebfff640 1 -- 172.21.15.53:0/1334841004 >> v1:172.21.15.53:6789/0 conn(0x7ff2f409f6c0 legacy=0x7ff2f409fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.374+0000 7ff2ebfff640 1 -- 172.21.15.53:0/1334841004 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f406d920 con 0x7ff2f40a01e0 2024-04-25T09:12:17.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.374+0000 7ff2ebfff640 1 --2- 172.21.15.53:0/1334841004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f40a01e0 0x7ff2f4138120 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88199c75f279f342 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.374+0000 7ff2f1d9b640 1 -- 172.21.15.53:0/1334841004 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2dc009d90 con 0x7ff2f40a01e0 2024-04-25T09:12:17.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.374+0000 7ff2f1d9b640 1 -- 172.21.15.53:0/1334841004 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff2dc00e230 con 0x7ff2f40a01e0 2024-04-25T09:12:17.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.374+0000 7ff2f1d9b640 1 -- 172.21.15.53:0/1334841004 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2dc00e4d0 con 0x7ff2f40a01e0 2024-04-25T09:12:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.375+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/1334841004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f40a01e0 msgr2=0x7ff2f4138120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.375+0000 7ff2f8f5d640 1 --2- 172.21.15.53:0/1334841004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f40a01e0 0x7ff2f4138120 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.375+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/1334841004 shutdown_connections 2024-04-25T09:12:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.375+0000 7ff2f8f5d640 1 --2- 172.21.15.53:0/1334841004 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f40a01e0 0x7ff2f4138120 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.375+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/1334841004 >> 172.21.15.53:0/1334841004 conn(0x7ff2f40a0950 msgr2=0x7ff2f40a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.375+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/1334841004 shutdown_connections 2024-04-25T09:12:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.375+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/1334841004 wait complete. 2024-04-25T09:12:17.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.375+0000 7ff2f8f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:17.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.377+0000 7ff2f8f5d640 1 Processor -- start 2024-04-25T09:12:17.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.377+0000 7ff2f8f5d640 1 -- start start 2024-04-25T09:12:17.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2f8f5d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f409f6c0 0x7ff2f41c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2f8f5d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f409c640 con 0x7ff2f409f6c0 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2f259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f409f6c0 0x7ff2f41c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2f259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f409f6c0 0x7ff2f41c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55418/0 (socket says 172.21.15.53:55418) 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2f259c640 1 -- 172.21.15.53:0/2996493445 learned_addr learned my addr 172.21.15.53:0/2996493445 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2f259c640 1 -- 172.21.15.53:0/2996493445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f41202e0 con 0x7ff2f409f6c0 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2f259c640 1 --2- 172.21.15.53:0/2996493445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f409f6c0 0x7ff2f41c9a90 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2eaffd640 1 -- 172.21.15.53:0/2996493445 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2e4005a60 con 0x7ff2f409f6c0 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2eaffd640 1 -- 172.21.15.53:0/2996493445 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff2e4005bc0 con 0x7ff2f409f6c0 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f41c9780 con 0x7ff2f409f6c0 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.379+0000 7ff2eaffd640 1 -- 172.21.15.53:0/2996493445 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2e4005e60 con 0x7ff2f409f6c0 2024-04-25T09:12:17.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.380+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f4121a00 con 0x7ff2f409f6c0 2024-04-25T09:12:17.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.380+0000 7ff2eaffd640 1 -- 172.21.15.53:0/2996493445 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff2e400c780 con 0x7ff2f409f6c0 2024-04-25T09:12:17.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.381+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f4063880 con 0x7ff2f409f6c0 2024-04-25T09:12:17.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.381+0000 7ff2eaffd640 1 --2- 172.21.15.53:0/2996493445 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff2d4038980 0x7ff2d403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.381+0000 7ff2eaffd640 1 -- 172.21.15.53:0/2996493445 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7ff2e4048280 con 0x7ff2f409f6c0 2024-04-25T09:12:17.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.381+0000 7ff2ebfff640 1 --2- 172.21.15.53:0/2996493445 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff2d4038980 0x7ff2d403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.382+0000 7ff2ebfff640 1 --2- 172.21.15.53:0/2996493445 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff2d4038980 0x7ff2d403ae90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.386+0000 7ff2eaffd640 1 -- 172.21.15.53:0/2996493445 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ff2e400d330 con 0x7ff2f409f6c0 2024-04-25T09:12:17.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.573+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2f4122040 con 0x7ff2d4038980 2024-04-25T09:12:17.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.575+0000 7ff2eaffd640 1 -- 172.21.15.53:0/2996493445 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31069 (crc 0 0 0) 0x7ff2f4122040 con 0x7ff2d4038980 2024-04-25T09:12:17.562 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:12:17.562 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-25T09:12:17.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff2d4038980 msgr2=0x7ff2d403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 --2- 172.21.15.53:0/2996493445 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff2d4038980 0x7ff2d403ae90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f409f6c0 msgr2=0x7ff2f41c9a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 --2- 172.21.15.53:0/2996493445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f409f6c0 0x7ff2f41c9a90 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 shutdown_connections 2024-04-25T09:12:17.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 --2- 172.21.15.53:0/2996493445 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff2d4038980 0x7ff2d403ae90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 --2- 172.21.15.53:0/2996493445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2f409f6c0 0x7ff2f41c9a90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 >> 172.21.15.53:0/2996493445 conn(0x7ff2f40a0950 msgr2=0x7ff2f41bad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 shutdown_connections 2024-04-25T09:12:17.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.577+0000 7ff2f8f5d640 1 -- 172.21.15.53:0/2996493445 wait complete. 2024-04-25T09:12:17.575 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-04-25T09:12:17.125716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109808,"kb_used_data":1624,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320592,"statfs":{"total":429496729600,"available":429384286208,"internally_reserved":0,"allocated":1662976,"data_stored":1299808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.696049"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.259914+0000","last_change":"2024-04-25T09:12:15.261642+0000","last_active":"2024-04-25T09:12:15.259914+0000","last_peered":"2024-04-25T09:12:15.259914+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.255284+0000","last_became_peered":"2024-04-25T09:12:15.255284+0000","last_unstale":"2024-04-25T09:12:15.259914+0000","last_undegraded":"2024-04-25T09:12:15.259914+0000","last_fullsized":"2024-04-25T09:12:15.259914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:12:16.195569+0000","last_change":"2024-04-25T09:12:15.237133+0000","last_active":"2024-04-25T09:12:16.195569+0000","last_peered":"2024-04-25T09:12:16.195569+0000","last_clean":"2024-04-25T09:12:16.195569+0000","last_became_active":"2024-04-25T09:12:15.231593+0000","last_became_peered":"2024-04-25T09:12:15.231593+0000","last_unstale":"2024-04-25T09:12:16.195569+0000","last_undegraded":"2024-04-25T09:12:16.195569+0000","last_fullsized":"2024-04-25T09:12:16.195569+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.243098+0000","last_change":"2024-04-25T09:12:15.244463+0000","last_active":"2024-04-25T09:12:15.243098+0000","last_peered":"2024-04-25T09:12:15.243098+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.239187+0000","last_became_peered":"2024-04-25T09:12:15.239187+0000","last_unstale":"2024-04-25T09:12:15.243098+0000","last_undegraded":"2024-04-25T09:12:15.243098+0000","last_fullsized":"2024-04-25T09:12:15.243098+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:12:16.191915+0000","last_change":"2024-04-25T09:12:15.226592+0000","last_active":"2024-04-25T09:12:16.191915+0000","last_peered":"2024-04-25T09:12:16.191915+0000","last_clean":"2024-04-25T09:12:16.191915+0000","last_became_active":"2024-04-25T09:12:15.221443+0000","last_became_peered":"2024-04-25T09:12:15.221443+0000","last_unstale":"2024-04-25T09:12:16.191915+0000","last_undegraded":"2024-04-25T09:12:16.191915+0000","last_fullsized":"2024-04-25T09:12:16.191915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.241099+0000","last_change":"2024-04-25T09:12:15.242605+0000","last_active":"2024-04-25T09:12:15.241099+0000","last_peered":"2024-04-25T09:12:15.241099+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.236080+0000","last_became_peered":"2024-04-25T09:12:15.236080+0000","last_unstale":"2024-04-25T09:12:15.241099+0000","last_undegraded":"2024-04-25T09:12:15.241099+0000","last_fullsized":"2024-04-25T09:12:15.241099+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.243655+0000","last_change":"2024-04-25T09:12:15.245278+0000","last_active":"2024-04-25T09:12:15.243655+0000","last_peered":"2024-04-25T09:12:15.243655+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.239643+0000","last_became_peered":"2024-04-25T09:12:15.239643+0000","last_unstale":"2024-04-25T09:12:15.243655+0000","last_undegraded":"2024-04-25T09:12:15.243655+0000","last_fullsized":"2024-04-25T09:12:15.243655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.245920+0000","last_change":"2024-04-25T09:12:15.247151+0000","last_active":"2024-04-25T09:12:15.245920+0000","last_peered":"2024-04-25T09:12:15.245920+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.241282+0000","last_became_peered":"2024-04-25T09:12:15.241282+0000","last_unstale":"2024-04-25T09:12:15.245920+0000","last_undegraded":"2024-04-25T09:12:15.245920+0000","last_fullsized":"2024-04-25T09:12:15.245920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.256336+0000","last_change":"2024-04-25T09:12:15.257926+0000","last_active":"2024-04-25T09:12:15.256336+0000","last_peered":"2024-04-25T09:12:15.256336+0000","last_clean":"2024-04-25T09:12:14.173556+0000","last_became_active":"2024-04-25T09:12:15.252630+0000","last_became_peered":"2024-04-25T09:12:15.252630+0000","last_unstale":"2024-04-25T09:12:15.256336+0000","last_undegraded":"2024-04-25T09:12:15.256336+0000","last_fullsized":"2024-04-25T09:12:15.256336+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":144,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:12:15.191498+0000","last_change":"2024-04-25T09:12:12.208622+0000","last_active":"2024-04-25T09:12:15.191498+0000","last_peered":"2024-04-25T09:12:15.191498+0000","last_clean":"2024-04-25T09:12:15.191498+0000","last_became_active":"2024-04-25T09:12:12.203665+0000","last_became_peered":"2024-04-25T09:12:12.203665+0000","last_unstale":"2024-04-25T09:12:15.191498+0000","last_undegraded":"2024-04-25T09:12:15.191498+0000","last_fullsized":"2024-04-25T09:12:15.191498+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_clean_scrub_stamp":"2024-04-25T09:12:11.160311+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27836,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829764,"statfs":{"total":107374182400,"available":107345678336,"internally_reserved":0,"allocated":712704,"data_stored":620136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27068,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":118784,"data_stored":29768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27068,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830532,"statfs":{"total":107374182400,"available":107346464768,"internally_reserved":0,"allocated":118784,"data_stored":29768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27836,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829764,"statfs":{"total":107374182400,"available":107345678336,"internally_reserved":0,"allocated":712704,"data_stored":620136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:17.575 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:12:17.575 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T09:12:17.576 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T09:12:17.576 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:12:17.685 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.696+0000 7f55db554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:17.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.699+0000 7f55db554640 1 Processor -- start 2024-04-25T09:12:17.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.700+0000 7f55db554640 1 -- start start 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.701+0000 7f55db554640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55d409f6c0 0x7f55d409fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.701+0000 7f55db554640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d4070d80 con 0x7f55d40a0010 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.701+0000 7f55db554640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f55d40717b0 con 0x7f55d409f6c0 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.701+0000 7f55d92f0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f55d409f6c0 0x7f55d409fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.701+0000 7f55d8aef640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f55d40a0010 0x7f55d41329f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60440/0 (socket says 172.21.15.53:60440) 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.701+0000 7f55d8aef640 1 -- 172.21.15.53:0/2575296597 learned_addr learned my addr 172.21.15.53:0/2575296597 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.702+0000 7f55d92f0640 1 -- 172.21.15.53:0/2575296597 >> v1:172.21.15.53:6789/0 conn(0x7f55d40a0010 legacy=0x7f55d41329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.702+0000 7f55d92f0640 1 -- 172.21.15.53:0/2575296597 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d4072330 con 0x7f55d409f6c0 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.702+0000 7f55d92f0640 1 --2- 172.21.15.53:0/2575296597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 0x7f55d409fad0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3764d6231cba8b3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.702+0000 7f55d3fff640 1 -- 172.21.15.53:0/2575296597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55c400e040 con 0x7f55d409f6c0 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.702+0000 7f55d3fff640 1 -- 172.21.15.53:0/2575296597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f55c4007670 con 0x7f55d409f6c0 2024-04-25T09:12:17.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.702+0000 7f55d3fff640 1 -- 172.21.15.53:0/2575296597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55c4007910 con 0x7f55d409f6c0 2024-04-25T09:12:17.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.703+0000 7f55db554640 1 -- 172.21.15.53:0/2575296597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 msgr2=0x7f55d409fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.703+0000 7f55db554640 1 --2- 172.21.15.53:0/2575296597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 0x7f55d409fad0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.703+0000 7f55db554640 1 -- 172.21.15.53:0/2575296597 shutdown_connections 2024-04-25T09:12:17.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.703+0000 7f55db554640 1 --2- 172.21.15.53:0/2575296597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 0x7f55d409fad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.703+0000 7f55db554640 1 -- 172.21.15.53:0/2575296597 >> 172.21.15.53:0/2575296597 conn(0x7f55d40a1960 msgr2=0x7f55d40a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.703+0000 7f55db554640 1 -- 172.21.15.53:0/2575296597 shutdown_connections 2024-04-25T09:12:17.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.703+0000 7f55db554640 1 -- 172.21.15.53:0/2575296597 wait complete. 2024-04-25T09:12:17.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.703+0000 7f55db554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:12:17.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.705+0000 7f55db554640 1 Processor -- start 2024-04-25T09:12:17.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.705+0000 7f55db554640 1 -- start start 2024-04-25T09:12:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.706+0000 7f55db554640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 0x7f55d41c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.706+0000 7f55db554640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f55d41c3ee0 con 0x7f55d409f6c0 2024-04-25T09:12:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.706+0000 7f55d92f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 0x7f55d41c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.706+0000 7f55d92f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 0x7f55d41c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:55442/0 (socket says 172.21.15.53:55442) 2024-04-25T09:12:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.706+0000 7f55d92f0640 1 -- 172.21.15.53:0/4083518226 learned_addr learned my addr 172.21.15.53:0/4083518226 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:12:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.707+0000 7f55d92f0640 1 -- 172.21.15.53:0/4083518226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d411e570 con 0x7f55d409f6c0 2024-04-25T09:12:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.707+0000 7f55d92f0640 1 --2- 172.21.15.53:0/4083518226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 0x7f55d41c4490 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.707+0000 7f55d1ffb640 1 -- 172.21.15.53:0/4083518226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55c400e040 con 0x7f55d409f6c0 2024-04-25T09:12:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.707+0000 7f55d1ffb640 1 -- 172.21.15.53:0/4083518226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f55c4012a90 con 0x7f55d409f6c0 2024-04-25T09:12:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.707+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d41c4180 con 0x7f55d409f6c0 2024-04-25T09:12:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.707+0000 7f55d1ffb640 1 -- 172.21.15.53:0/4083518226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f55c4012d30 con 0x7f55d409f6c0 2024-04-25T09:12:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.707+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d411e970 con 0x7f55d409f6c0 2024-04-25T09:12:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.708+0000 7f55d1ffb640 1 -- 172.21.15.53:0/4083518226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f55c40153f0 con 0x7f55d409f6c0 2024-04-25T09:12:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.708+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d411e770 con 0x7f55d409f6c0 2024-04-25T09:12:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.708+0000 7f55d1ffb640 1 --2- 172.21.15.53:0/4083518226 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f55c0038980 0x7f55c003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.708+0000 7f55d1ffb640 1 -- 172.21.15.53:0/4083518226 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2672+0+0 (crc 0 0 0) 0x7f55c4049b10 con 0x7f55d409f6c0 2024-04-25T09:12:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.709+0000 7f55d8aef640 1 --2- 172.21.15.53:0/4083518226 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f55c0038980 0x7f55c003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.709+0000 7f55d8aef640 1 --2- 172.21.15.53:0/4083518226 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f55c0038980 0x7f55c003ae90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.713+0000 7f55d1ffb640 1 -- 172.21.15.53:0/4083518226 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f55c400fc40 con 0x7f55d409f6c0 2024-04-25T09:12:17.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.942+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f55d40692b0 con 0x7f55d409f6c0 2024-04-25T09:12:17.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.943+0000 7f55d1ffb640 1 -- 172.21.15.53:0/4083518226 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7f55c400fa60 con 0x7f55d409f6c0 2024-04-25T09:12:17.930 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:12:17.930 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:12:17.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f55c0038980 msgr2=0x7f55c003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 --2- 172.21.15.53:0/4083518226 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f55c0038980 0x7f55c003ae90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 msgr2=0x7f55d41c4490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 --2- 172.21.15.53:0/4083518226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 0x7f55d41c4490 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 shutdown_connections 2024-04-25T09:12:17.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 --2- 172.21.15.53:0/4083518226 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f55c0038980 0x7f55c003ae90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 --2- 172.21.15.53:0/4083518226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55d409f6c0 0x7f55d41c4490 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 >> 172.21.15.53:0/4083518226 conn(0x7f55d40a1960 msgr2=0x7f55d41bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 shutdown_connections 2024-04-25T09:12:17.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:12:17.945+0000 7f55db554640 1 -- 172.21.15.53:0/4083518226 wait complete. 2024-04-25T09:12:17.942 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T09:12:17.943 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T09:12:17.956 INFO:tasks.workunit:Pulling workunits from ref 472cc2b524a88306ef4535053d26658c5fd6e9db 2024-04-25T09:12:17.956 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T09:12:17.956 DEBUG:teuthology.orchestra.run.smithi053:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:17.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:12:17.971 INFO:teuthology.orchestra.run.smithi053.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T09:12:17.972 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:18.026 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:18.027 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-25T09:12:18.081 INFO:tasks.workunit:timeout=3h 2024-04-25T09:12:18.081 INFO:tasks.workunit:cleanup=True 2024-04-25T09:12:18.082 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 472cc2b524a88306ef4535053d26658c5fd6e9db 2024-04-25T09:12:18.137 INFO:tasks.workunit.client.0.smithi053.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr:Note: switching to '472cc2b524a88306ef4535053d26658c5fd6e9db'. 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr: git switch -c 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-25T09:13:02.422 INFO:tasks.workunit.client.0.smithi053.stderr:Or undo this operation with: 2024-04-25T09:13:02.423 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-25T09:13:02.423 INFO:tasks.workunit.client.0.smithi053.stderr: git switch - 2024-04-25T09:13:02.423 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-25T09:13:02.423 INFO:tasks.workunit.client.0.smithi053.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T09:13:02.423 INFO:tasks.workunit.client.0.smithi053.stderr: 2024-04-25T09:13:02.423 INFO:tasks.workunit.client.0.smithi053.stderr:HEAD is now at 472cc2b524a Merge pull request #56942 from Svelar/fix_tox_cephadm 2024-04-25T09:13:02.424 DEBUG:teuthology.orchestra.run.smithi053:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T09:13:02.489 INFO:tasks.workunit.client.0.smithi053.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T09:13:02.491 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T09:13:02.491 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T09:13:03.138 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T09:13:03.195 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T09:13:03.239 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T09:13:03.241 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T09:13:03.241 INFO:tasks.workunit.client.0.smithi053.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T09:13:03.284 INFO:tasks.workunit.client.0.smithi053.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T09:13:03.287 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-04-25T09:13:03.287 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T09:13:03.342 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-04-25T09:13:03.343 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-04-25T09:13:03.343 DEBUG:teuthology.orchestra.run.smithi053:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=472cc2b524a88306ef4535053d26658c5fd6e9db TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-04-25T09:13:03.402 INFO:tasks.workunit.client.0.smithi053.stderr:+ parallel=1 2024-04-25T09:13:03.402 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' --crimson = --serial ']' 2024-04-25T09:13:03.402 INFO:tasks.workunit.client.0.smithi053.stderr:+ crimson=0 2024-04-25T09:13:03.402 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' --crimson = --crimson ']' 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ parallel=0 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ crimson=1 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ color= 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' -t 1 ']' 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ declare -A pids 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:13:03.403 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_aio 2024-04-25T09:13:03.420 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:13:03.420 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 42 tests from 2 test suites. 2024-04-25T09:13:03.420 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:13:03.420 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 26 tests from LibRadosAio 2024-04-25T09:13:03.420 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.TooBig 2024-04-25T09:13:05.907 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.TooBig (2487 ms) 2024-04-25T09:13:05.907 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-04-25T09:13:08.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.SimpleWrite (3012 ms) 2024-04-25T09:13:08.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-04-25T09:13:11.932 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.WaitForSafe (3013 ms) 2024-04-25T09:13:11.932 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-04-25T09:13:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTrip (3012 ms) 2024-04-25T09:13:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-04-25T09:13:17.958 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTrip2 (3014 ms) 2024-04-25T09:13:17.958 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-04-25T09:13:20.969 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTrip3 (3011 ms) 2024-04-25T09:13:20.969 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-04-25T09:13:23.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripAppend (3011 ms) 2024-04-25T09:13:23.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-04-25T09:13:26.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RemoveTest (3013 ms) 2024-04-25T09:13:26.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-04-25T09:13:30.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3011 ms) 2024-04-25T09:13:30.005 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RmXattr 2024-04-25T09:13:33.014 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RmXattr (3010 ms) 2024-04-25T09:13:33.015 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.XattrIter 2024-04-25T09:13:36.029 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.XattrIter (3015 ms) 2024-04-25T09:13:36.029 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.IsComplete 2024-04-25T09:13:39.041 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.IsComplete (3012 ms) 2024-04-25T09:13:39.041 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.IsSafe 2024-04-25T09:13:42.056 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.IsSafe (3015 ms) 2024-04-25T09:13:42.056 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-04-25T09:13:45.066 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.ReturnValue (3010 ms) 2024-04-25T09:13:45.066 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.Flush 2024-04-25T09:13:48.078 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.Flush (3012 ms) 2024-04-25T09:13:48.079 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-04-25T09:13:51.088 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.FlushAsync (3010 ms) 2024-04-25T09:13:51.089 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-04-25T09:13:54.103 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3015 ms) 2024-04-25T09:13:54.103 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-04-25T09:13:57.119 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3016 ms) 2024-04-25T09:13:57.120 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-04-25T09:13:59.900 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.SimpleStat (2780 ms) 2024-04-25T09:13:59.900 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-04-25T09:14:02.909 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.OperateMtime (3009 ms) 2024-04-25T09:14:02.909 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-04-25T09:14:05.923 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.Operate2Mtime (3015 ms) 2024-04-25T09:14:05.924 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-04-25T09:14:08.934 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.SimpleStatNS (3010 ms) 2024-04-25T09:14:08.934 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.StatRemove 2024-04-25T09:14:11.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.StatRemove (3016 ms) 2024-04-25T09:14:11.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-04-25T09:14:14.959 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.ExecuteClass (3010 ms) 2024-04-25T09:14:14.960 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-04-25T09:14:17.902 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.MultiWrite (2943 ms) 2024-04-25T09:14:17.903 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-04-25T09:14:20.913 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.AioUnlock (3009 ms) 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 26 tests from LibRadosAio (77492 ms total) 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 16 tests from LibRadosAioEC 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1100: Skipped 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1132: Skipped 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.914 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1149: Skipped 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1182: Skipped 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1215: Skipped 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-04-25T09:14:20.915 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1286: Skipped 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1326: Skipped 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1366: Skipped 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.Flush 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1385: Skipped 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.916 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1415: Skipped 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1454: Skipped 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1498: Skipped 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1532: Skipped 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1593: Skipped 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1649: Skipped 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio.cc:1681: Skipped 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-04-25T09:14:20.918 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 42 tests from 2 test suites ran. (77492 ms total) 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 26 tests. 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 16 tests, listed below: 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-04-25T09:14:20.919 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-04-25T09:14:20.920 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-04-25T09:14:20.920 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-04-25T09:14:20.920 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-04-25T09:14:20.920 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-04-25T09:14:20.920 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-04-25T09:14:20.920 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-04-25T09:14:20.920 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:14:20.921 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:14:20.921 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_aio_pp 2024-04-25T09:14:20.937 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:14:20.937 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 57 tests from 4 test suites. 2024-04-25T09:14:20.937 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:14:20.937 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 32 tests from LibRadosAio 2024-04-25T09:14:20.937 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-04-25T09:14:23.924 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.TooBigPP (2986 ms) 2024-04-25T09:14:23.924 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-04-25T09:14:40.921 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.PoolQuotaPP (16997 ms) 2024-04-25T09:14:40.922 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-04-25T09:14:46.942 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.SimpleWritePP (6021 ms) 2024-04-25T09:14:46.942 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-04-25T09:14:49.955 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.WaitForSafePP (3013 ms) 2024-04-25T09:14:49.955 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-04-25T09:14:52.909 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripPP (2955 ms) 2024-04-25T09:14:52.910 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-04-25T09:14:55.922 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3012 ms) 2024-04-25T09:14:55.922 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-04-25T09:14:58.935 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripPP3 (3013 ms) 2024-04-25T09:14:58.935 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-04-25T09:15:01.948 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3013 ms) 2024-04-25T09:15:01.948 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-04-25T09:15:04.949 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.IsCompletePP (3001 ms) 2024-04-25T09:15:04.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-04-25T09:15:07.962 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.IsSafePP (3013 ms) 2024-04-25T09:15:07.962 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-04-25T09:15:10.973 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.ReturnValuePP (3011 ms) 2024-04-25T09:15:10.973 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.FlushPP 2024-04-25T09:15:13.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.FlushPP (3012 ms) 2024-04-25T09:15:13.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-04-25T09:15:16.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3010 ms) 2024-04-25T09:15:16.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-04-25T09:15:20.011 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3016 ms) 2024-04-25T09:15:20.011 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-04-25T09:15:22.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (2906 ms) 2024-04-25T09:15:22.917 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-04-25T09:15:25.926 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3009 ms) 2024-04-25T09:15:25.926 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-04-25T09:15:28.939 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (3013 ms) 2024-04-25T09:15:28.940 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-04-25T09:15:31.951 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3011 ms) 2024-04-25T09:15:31.951 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-04-25T09:15:34.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.SimpleStatPP (3003 ms) 2024-04-25T09:15:34.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-04-25T09:15:37.967 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.OperateMtime (3012 ms) 2024-04-25T09:15:37.967 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-04-25T09:15:40.978 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.OperateMtime2 (3012 ms) 2024-04-25T09:15:40.979 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-04-25T09:15:43.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.StatRemovePP (3010 ms) 2024-04-25T09:15:43.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-04-25T09:15:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3010 ms) 2024-04-25T09:15:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.OmapPP 2024-04-25T09:15:50.014 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.OmapPP (3016 ms) 2024-04-25T09:15:50.014 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-04-25T09:15:52.926 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.MultiWritePP (2912 ms) 2024-04-25T09:15:52.926 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-04-25T09:15:55.938 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.AioUnlockPP (3012 ms) 2024-04-25T09:15:55.938 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-04-25T09:15:58.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (3012 ms) 2024-04-25T09:15:58.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-04-25T09:16:01.964 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RacingRemovePP (3014 ms) 2024-04-25T09:16:01.964 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-04-25T09:16:04.965 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3002 ms) 2024-04-25T09:16:04.966 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-04-25T09:16:07.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3014 ms) 2024-04-25T09:16:07.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-04-25T09:16:10.484 INFO:tasks.workunit.client.0.smithi053.stdout:setting pool EIO 2024-04-25T09:16:20.165 INFO:tasks.workunit.client.0.smithi053.stdout:waiting for 784 2024-04-25T09:16:21.165 INFO:tasks.workunit.client.0.smithi053.stdout:waiting for 784 2024-04-25T09:16:22.165 INFO:tasks.workunit.client.0.smithi053.stdout:waiting for 784 2024-04-25T09:16:23.165 INFO:tasks.workunit.client.0.smithi053.stdout:max_success 216, min_failed 217 2024-04-25T09:16:23.229 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAio.PoolEIOFlag (15249 ms) 2024-04-25T09:16:23.229 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAio.MultiReads 2024-04-25T09:16:23.229 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:2427: Skipped 2024-04-25T09:16:23.229 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:23.229 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-04-25T09:16:23.229 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 32 tests from LibRadosAio (122291 ms total) 2024-04-25T09:16:23.229 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:16:23.229 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosAioPP 2024-04-25T09:16:23.229 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-04-25T09:16:26.241 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (3012 ms) 2024-04-25T09:16:26.241 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-04-25T09:16:34.955 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (8715 ms) 2024-04-25T09:16:34.956 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-04-25T09:16:49.941 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAioPP.RmXattrPP (14985 ms) 2024-04-25T09:16:49.941 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-04-25T09:16:52.952 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3012 ms) 2024-04-25T09:16:52.952 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosAioPP (29724 ms total) 2024-04-25T09:16:52.952 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:16:52.952 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosIoPP 2024-04-25T09:16:52.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-04-25T09:16:55.971 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.XattrListPP (3012 ms) 2024-04-25T09:16:55.972 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosIoPP (3012 ms total) 2024-04-25T09:16:55.972 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:16:55.972 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 20 tests from LibRadosAioEC 2024-04-25T09:16:55.972 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-04-25T09:16:55.973 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1384: Skipped 2024-04-25T09:16:55.973 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.973 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-04-25T09:16:55.973 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-04-25T09:16:55.973 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1419: Skipped 2024-04-25T09:16:55.973 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.973 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-04-25T09:16:55.974 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-04-25T09:16:55.974 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1436: Skipped 2024-04-25T09:16:55.975 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.975 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-04-25T09:16:55.975 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-04-25T09:16:55.975 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1467: Skipped 2024-04-25T09:16:55.975 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.975 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-04-25T09:16:55.976 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-04-25T09:16:55.976 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1500: Skipped 2024-04-25T09:16:55.976 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.976 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-04-25T09:16:55.977 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-25T09:16:55.977 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1605: Skipped 2024-04-25T09:16:55.977 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.977 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-04-25T09:16:55.977 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-04-25T09:16:55.977 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1637: Skipped 2024-04-25T09:16:55.978 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.978 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-04-25T09:16:55.978 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-04-25T09:16:55.978 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1705: Skipped 2024-04-25T09:16:55.978 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.978 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-04-25T09:16:55.978 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-04-25T09:16:55.979 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1742: Skipped 2024-04-25T09:16:55.979 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.979 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-04-25T09:16:55.979 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-04-25T09:16:55.979 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1780: Skipped 2024-04-25T09:16:55.979 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-04-25T09:16:55.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-04-25T09:16:55.980 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1796: Skipped 2024-04-25T09:16:55.980 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-04-25T09:16:55.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-04-25T09:16:55.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1824: Skipped 2024-04-25T09:16:55.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-04-25T09:16:55.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-25T09:16:55.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1859: Skipped 2024-04-25T09:16:55.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-04-25T09:16:55.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-04-25T09:16:55.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1904: Skipped 2024-04-25T09:16:55.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-04-25T09:16:55.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-04-25T09:16:55.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1946: Skipped 2024-04-25T09:16:55.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-04-25T09:16:55.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-04-25T09:16:55.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:1977: Skipped 2024-04-25T09:16:55.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-04-25T09:16:55.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-04-25T09:16:55.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:2008: Skipped 2024-04-25T09:16:55.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-04-25T09:16:55.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-04-25T09:16:55.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:2059: Skipped 2024-04-25T09:16:55.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-04-25T09:16:55.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-04-25T09:16:55.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:2089: Skipped 2024-04-25T09:16:55.986 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-04-25T09:16:55.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-04-25T09:16:55.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/aio_cxx.cc:2124: Skipped 2024-04-25T09:16:55.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:55.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-04-25T09:16:55.987 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-04-25T09:16:55.987 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:16:55.987 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:16:55.987 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 57 tests from 4 test suites ran. (155028 ms total) 2024-04-25T09:16:55.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 36 tests. 2024-04-25T09:16:55.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 21 tests, listed below: 2024-04-25T09:16:55.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-04-25T09:16:55.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-04-25T09:16:55.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-04-25T09:16:55.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-04-25T09:16:55.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-04-25T09:16:55.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-04-25T09:16:55.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-25T09:16:55.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-04-25T09:16:55.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-04-25T09:16:55.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-04-25T09:16:55.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-04-25T09:16:55.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-04-25T09:16:55.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-04-25T09:16:55.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-25T09:16:55.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-04-25T09:16:55.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-04-25T09:16:55.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-04-25T09:16:55.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-04-25T09:16:55.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-04-25T09:16:55.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-04-25T09:16:55.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-04-25T09:16:55.991 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:16:55.991 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:16:55.991 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_io 2024-04-25T09:16:55.992 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:16:55.992 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 24 tests from 2 test suites. 2024-04-25T09:16:55.992 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:16:55.992 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 14 tests from LibRadosIo 2024-04-25T09:16:57.936 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-04-25T09:16:58.315 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.SimpleWrite (379 ms) 2024-04-25T09:16:58.315 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.TooBig 2024-04-25T09:16:58.316 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-04-25T09:16:58.316 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-04-25T09:16:58.381 INFO:tasks.workunit.client.0.smithi053.stdout:no timeout :/ 2024-04-25T09:16:58.381 INFO:tasks.workunit.client.0.smithi053.stdout:no timeout :/ 2024-04-25T09:16:58.381 INFO:tasks.workunit.client.0.smithi053.stdout:no timeout :/ 2024-04-25T09:16:58.381 INFO:tasks.workunit.client.0.smithi053.stdout:no timeout :/ 2024-04-25T09:16:58.381 INFO:tasks.workunit.client.0.smithi053.stdout:no timeout :/ 2024-04-25T09:16:58.381 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.ReadTimeout (65 ms) 2024-04-25T09:16:58.381 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-04-25T09:16:58.413 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.RoundTrip (32 ms) 2024-04-25T09:16:58.413 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.Checksum 2024-04-25T09:16:58.437 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.Checksum (23 ms) 2024-04-25T09:16:58.438 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-04-25T09:16:58.461 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (26 ms) 2024-04-25T09:16:58.462 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-04-25T09:16:58.491 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (30 ms) 2024-04-25T09:16:58.491 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-04-25T09:16:58.518 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.AppendRoundTrip (26 ms) 2024-04-25T09:16:58.518 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-04-25T09:16:58.523 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.ZeroLenZero (5 ms) 2024-04-25T09:16:58.523 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.TruncTest 2024-04-25T09:16:58.549 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.TruncTest (26 ms) 2024-04-25T09:16:58.549 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-04-25T09:16:58.573 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.RemoveTest (24 ms) 2024-04-25T09:16:58.573 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-04-25T09:16:58.603 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (30 ms) 2024-04-25T09:16:58.603 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.RmXattr 2024-04-25T09:16:58.675 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.RmXattr (73 ms) 2024-04-25T09:16:58.675 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIo.XattrIter 2024-04-25T09:16:58.710 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIo.XattrIter (34 ms) 2024-04-25T09:16:58.979 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 14 tests from LibRadosIo (773 ms total) 2024-04-25T09:16:58.979 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:16:58.979 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 10 tests from LibRadosIoEC 2024-04-25T09:16:58.979 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:168: Skipped 2024-04-25T09:16:58.979 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.979 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-04-25T09:16:58.979 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.979 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.979 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:176: Skipped 2024-04-25T09:16:58.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 24 tests from 2 test suites ran. (2986 ms total) 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 14 tests. 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 10 tests, listed below: 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-04-25T09:16:58.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-04-25T09:16:58.985 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:16:58.985 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:16:58.985 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_io_pp 2024-04-25T09:16:58.997 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:16:58.997 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 38 tests from 2 test suites. 2024-04-25T09:16:58.997 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:16:58.997 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 21 tests from LibRadosIoPP 2024-04-25T09:16:58.997 INFO:tasks.workunit.client.0.smithi053.stdout:seed 31431 2024-04-25T09:17:00.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-04-25T09:17:00.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-04-25T09:17:00.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-04-25T09:17:01.401 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (415 ms) 2024-04-25T09:17:01.401 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-04-25T09:17:01.459 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.ReadOpPP (58 ms) 2024-04-25T09:17:01.459 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-04-25T09:17:01.484 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (24 ms) 2024-04-25T09:17:01.484 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-04-25T09:17:03.742 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2258 ms) 2024-04-25T09:17:03.742 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-04-25T09:17:03.759 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.RoundTripPP (18 ms) 2024-04-25T09:17:03.760 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-04-25T09:17:03.778 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (18 ms) 2024-04-25T09:17:03.778 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-04-25T09:17:03.794 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.Checksum (16 ms) 2024-04-25T09:17:03.794 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-04-25T09:17:03.809 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (15 ms) 2024-04-25T09:17:03.809 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-04-25T09:17:03.833 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (25 ms) 2024-04-25T09:17:03.833 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-04-25T09:17:03.858 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (25 ms) 2024-04-25T09:17:03.859 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-04-25T09:17:03.874 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (15 ms) 2024-04-25T09:17:03.874 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-04-25T09:17:03.901 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (28 ms) 2024-04-25T09:17:03.901 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-04-25T09:17:03.925 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.TruncTestPP (24 ms) 2024-04-25T09:17:03.925 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-04-25T09:17:03.949 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (24 ms) 2024-04-25T09:17:03.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-04-25T09:17:03.978 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (29 ms) 2024-04-25T09:17:03.979 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-04-25T09:17:04.053 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.RmXattrPP (74 ms) 2024-04-25T09:17:04.053 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-04-25T09:17:04.088 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.XattrListPP (36 ms) 2024-04-25T09:17:04.089 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-04-25T09:17:04.114 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.CmpExtPP (25 ms) 2024-04-25T09:17:04.114 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-04-25T09:17:04.130 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (16 ms) 2024-04-25T09:17:04.130 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-04-25T09:17:04.153 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (23 ms) 2024-04-25T09:17:04.995 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 21 tests from LibRadosIoPP (3168 ms total) 2024-04-25T09:17:04.995 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:04.995 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 17 tests from LibRadosIoECPP 2024-04-25T09:17:04.995 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-25T09:17:04.995 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-04-25T09:17:04.995 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:04.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:05.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-04-25T09:17:05.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 17 tests from LibRadosIoECPP (0 ms total) 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 38 tests from 2 test suites ran. (5996 ms total) 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 21 tests. 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 17 tests, listed below: 2024-04-25T09:17:05.003 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-04-25T09:17:05.004 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-04-25T09:17:05.005 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-04-25T09:17:05.005 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-25T09:17:05.005 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:17:05.005 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:17:05.005 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_asio 2024-04-25T09:17:05.032 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.045+0000 7f46bbe686c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:17:05.039 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.052+0000 7f46bbe686c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:17:05.039 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.052+0000 7f46bbe686c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:17:05.039 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 12 tests from 1 test suite. 2024-04-25T09:17:05.039 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:17:05.039 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 12 tests from AsioRados 2024-04-25T09:17:05.040 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.053+0000 7f46bbe686c0 1 Processor -- start 2024-04-25T09:17:05.040 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.053+0000 7f46bbe686c0 1 -- start start 2024-04-25T09:17:05.046 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.054+0000 7f46bbe686c0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf8cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:17:05.046 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.054+0000 7f46bbe686c0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0xe5d950 con 0xef8400 2024-04-25T09:17:05.046 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.055+0000 7f46affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf8cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:17:05.046 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.055+0000 7f46affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf8cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37228/0 (socket says 172.21.15.53:37228) 2024-04-25T09:17:05.047 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.055+0000 7f46affff640 1 -- 172.21.15.53:0/359471182 learned_addr learned my addr 172.21.15.53:0/359471182 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:17:05.047 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.055+0000 7f46affff640 1 -- 172.21.15.53:0/359471182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdfc1e0 con 0xef8400 2024-04-25T09:17:05.047 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.055+0000 7f46affff640 1 --2- 172.21.15.53:0/359471182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf8cc30 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4969f69c757bed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:17:05.047 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.055+0000 7f46ae7fc640 1 -- 172.21.15.53:0/359471182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46a400a170 con 0xef8400 2024-04-25T09:17:05.047 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.055+0000 7f46ae7fc640 1 -- 172.21.15.53:0/359471182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f46a400a2d0 con 0xef8400 2024-04-25T09:17:05.047 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.055+0000 7f46ae7fc640 1 -- 172.21.15.53:0/359471182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46a4006950 con 0xef8400 2024-04-25T09:17:05.048 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.056+0000 7f46bbe686c0 1 -- 172.21.15.53:0/359471182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 msgr2=0xf8cc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:17:05.048 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.056+0000 7f46bbe686c0 1 --2- 172.21.15.53:0/359471182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf8cc30 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:17:05.048 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.056+0000 7f46bbe686c0 1 -- 172.21.15.53:0/359471182 shutdown_connections 2024-04-25T09:17:05.048 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.056+0000 7f46bbe686c0 1 --2- 172.21.15.53:0/359471182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf8cc30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:17:05.048 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.056+0000 7f46bbe686c0 1 -- 172.21.15.53:0/359471182 >> 172.21.15.53:0/359471182 conn(0xe14960 msgr2=0xf90b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:17:05.049 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.057+0000 7f46bbe686c0 1 -- 172.21.15.53:0/359471182 shutdown_connections 2024-04-25T09:17:05.049 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.057+0000 7f46bbe686c0 1 -- 172.21.15.53:0/359471182 wait complete. 2024-04-25T09:17:05.049 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.058+0000 7f46bbe686c0 1 Processor -- start 2024-04-25T09:17:05.049 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.058+0000 7f46bbe686c0 1 -- start start 2024-04-25T09:17:05.054 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.061+0000 7f46bbe686c0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf77e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:17:05.055 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.061+0000 7f46bbe686c0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0xe5b3d0 con 0xef8400 2024-04-25T09:17:05.055 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.061+0000 7f46affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf77e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:17:05.055 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.061+0000 7f46affff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf77e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:37230/0 (socket says 172.21.15.53:37230) 2024-04-25T09:17:05.055 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.061+0000 7f46affff640 1 -- 172.21.15.53:0/3305694828 learned_addr learned my addr 172.21.15.53:0/3305694828 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:17:05.055 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.061+0000 7f46affff640 1 -- 172.21.15.53:0/3305694828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdeee30 con 0xef8400 2024-04-25T09:17:05.055 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.062+0000 7f46affff640 1 --2- 172.21.15.53:0/3305694828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf77e90 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:17:05.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.062+0000 7f46ad7fa640 1 -- 172.21.15.53:0/3305694828 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46a4037040 con 0xef8400 2024-04-25T09:17:05.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.062+0000 7f46ad7fa640 1 -- 172.21.15.53:0/3305694828 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f46a4029ab0 con 0xef8400 2024-04-25T09:17:05.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.062+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xdee890 con 0xef8400 2024-04-25T09:17:05.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.062+0000 7f46ad7fa640 1 -- 172.21.15.53:0/3305694828 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f46a4031a00 con 0xef8400 2024-04-25T09:17:05.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.062+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0xf793e0 con 0xef8400 2024-04-25T09:17:05.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.063+0000 7f46ad7fa640 1 -- 172.21.15.53:0/3305694828 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f46a403a040 con 0xef8400 2024-04-25T09:17:05.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.063+0000 7f46ad7fa640 1 --2- 172.21.15.53:0/3305694828 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f469c0371c0 0x7f469c0396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:17:05.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.063+0000 7f46ad7fa640 1 -- 172.21.15.53:0/3305694828 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 2672+0+0 (crc 0 0 0) 0x7f46a406aa80 con 0xef8400 2024-04-25T09:17:05.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.064+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0xe176a0 con 0xef8400 2024-04-25T09:17:05.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.064+0000 7f46af7fe640 1 --2- 172.21.15.53:0/3305694828 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f469c0371c0 0x7f469c0396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:17:05.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.064+0000 7f46ad7fa640 1 -- 172.21.15.53:0/3305694828 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (crc 0 0 0) 0x7f46a4032e70 con 0xef8400 2024-04-25T09:17:05.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.064+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0xe637b0 con 0xef8400 2024-04-25T09:17:05.058 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:05.064+0000 7f46af7fe640 1 --2- 172.21.15.53:0/3305694828 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f469c0371c0 0x7f469c0396d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:17:05.996 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:06.008+0000 7f46ad7fa640 1 -- 172.21.15.53:0/3305694828 <== mon.0 v2:172.21.15.53:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v236) ==== 43+0+0 (crc 0 0 0) 0x7f46a4038b30 con 0xef8400 2024-04-25T09:17:05.996 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:06.008+0000 7f46ad7fa640 1 -- 172.21.15.53:0/3305694828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=236}) -- 0x7f469c03bb40 con 0xef8400 2024-04-25T09:17:05.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:06.009+0000 7f46ad7fa640 1 -- 172.21.15.53:0/3305694828 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(236..236 src has 1..236) ==== 651+0+0 (crc 0 0 0) 0x7f46a4038d60 con 0xef8400 2024-04-25T09:17:05.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:06.009+0000 7f46bbe686c0 1 --2- 172.21.15.53:0/3305694828 >> v2:172.21.15.53:6805/3736905990 conn(0xef92a0 0x1027900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:17:05.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:06.009+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0xf7a510 con 0xef92a0 2024-04-25T09:17:06.000 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:06.013+0000 7f46b499b640 1 --2- 172.21.15.53:0/3305694828 >> v2:172.21.15.53:6805/3736905990 conn(0xef92a0 0x1027900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:17:06.097 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:06.109+0000 7f46b499b640 1 --2- 172.21.15.53:0/3305694828 >> v2:172.21.15.53:6805/3736905990 conn(0xef92a0 0x1027900 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:17:07.288 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-04-25T09:17:07.289 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.301+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(2 exist [writefull 0~5] v237'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.289 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.301+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x101f060 con 0xef92a0 2024-04-25T09:17:07.289 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.301+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x101f900 con 0xef92a0 2024-04-25T09:17:07.302 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.314+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.302 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.315+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.302 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncReadCallback (14 ms) 2024-04-25T09:17:07.303 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-04-25T09:17:07.303 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.315+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x101fce0 con 0xef92a0 2024-04-25T09:17:07.303 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.315+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1027e40 con 0xef92a0 2024-04-25T09:17:07.313 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.326+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.315 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.327+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.315 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncReadFuture (13 ms) 2024-04-25T09:17:07.315 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-04-25T09:17:07.316 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.327+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1022c10 con 0xef92a0 2024-04-25T09:17:07.316 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.327+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1068d60 con 0xef92a0 2024-04-25T09:17:07.328 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.341+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.329 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.342+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.329 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncReadYield (15 ms) 2024-04-25T09:17:07.330 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-04-25T09:17:07.330 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.342+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x101f580 con 0xef92a0 2024-04-25T09:17:07.344 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.357+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 8 ==== osd_op_reply(9 exist [write 0~5] v237'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.344 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncWriteCallback (15 ms) 2024-04-25T09:17:07.344 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-04-25T09:17:07.345 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.357+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x101f580 con 0xef92a0 2024-04-25T09:17:07.359 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.371+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 9 ==== osd_op_reply(10 exist [write 0~5] v237'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.359 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncWriteFuture (14 ms) 2024-04-25T09:17:07.359 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-04-25T09:17:07.360 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.372+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x104ba30 con 0xef92a0 2024-04-25T09:17:07.370 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.382+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 10 ==== osd_op_reply(11 exist [write 0~5] v237'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.370 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncWriteYield (11 ms) 2024-04-25T09:17:07.370 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-04-25T09:17:07.371 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.382+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1028650 con 0xef92a0 2024-04-25T09:17:07.371 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.382+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x104be70 con 0xef92a0 2024-04-25T09:17:07.376 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.389+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.376 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.389+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.377 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (7 ms) 2024-04-25T09:17:07.377 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-04-25T09:17:07.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.389+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x10281a0 con 0xef92a0 2024-04-25T09:17:07.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.389+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x104c320 con 0xef92a0 2024-04-25T09:17:07.382 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.394+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.383 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.395+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.383 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (6 ms) 2024-04-25T09:17:07.383 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-04-25T09:17:07.384 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.395+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x10281a0 con 0xef92a0 2024-04-25T09:17:07.384 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.395+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x104b3c0 con 0xef92a0 2024-04-25T09:17:07.389 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.402+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.389 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.402+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.390 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncReadOperationYield (7 ms) 2024-04-25T09:17:07.390 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-04-25T09:17:07.390 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.402+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x10281a0 con 0xef92a0 2024-04-25T09:17:07.399 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.412+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 17 ==== osd_op_reply(18 exist [writefull 0~5] v237'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.400 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (10 ms) 2024-04-25T09:17:07.400 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-04-25T09:17:07.400 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.412+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x10281a0 con 0xef92a0 2024-04-25T09:17:07.409 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.422+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 18 ==== osd_op_reply(19 exist [writefull 0~5] v237'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.410 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (10 ms) 2024-04-25T09:17:07.410 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-04-25T09:17:07.410 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.422+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x10281a0 con 0xef92a0 2024-04-25T09:17:07.419 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46b499b640 1 -- 172.21.15.53:0/3305694828 <== osd.1 v2:172.21.15.53:6805/3736905990 19 ==== osd_op_reply(20 exist [writefull 0~5] v237'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f46a800a430 con 0xef92a0 2024-04-25T09:17:07.420 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (10 ms) 2024-04-25T09:17:07.421 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 >> v2:172.21.15.53:6805/3736905990 conn(0xef92a0 msgr2=0x1027900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:17:07.421 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 --2- 172.21.15.53:0/3305694828 >> v2:172.21.15.53:6805/3736905990 conn(0xef92a0 0x1027900 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:17:07.421 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f469c0371c0 msgr2=0x7f469c0396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:17:07.421 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 --2- 172.21.15.53:0/3305694828 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f469c0371c0 0x7f469c0396d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:17:07.421 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 msgr2=0xf77e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:17:07.421 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 --2- 172.21.15.53:0/3305694828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf77e90 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:17:07.421 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 shutdown_connections 2024-04-25T09:17:07.421 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 --2- 172.21.15.53:0/3305694828 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f469c0371c0 0x7f469c0396d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:17:07.422 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 --2- 172.21.15.53:0/3305694828 >> v2:172.21.15.53:6805/3736905990 conn(0xef92a0 0x1027900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:17:07.422 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 --2- 172.21.15.53:0/3305694828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xef8400 0xf77e90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:17:07.422 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 >> 172.21.15.53:0/3305694828 conn(0xe14960 msgr2=0xf90b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:17:07.422 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 shutdown_connections 2024-04-25T09:17:07.422 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.432+0000 7f46bbe686c0 1 -- 172.21.15.53:0/3305694828 wait complete. 2024-04-25T09:17:07.422 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 12 tests from AsioRados (132 ms total) 2024-04-25T09:17:07.422 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:07.422 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:17:07.422 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 12 tests from 1 test suite ran. (2381 ms total) 2024-04-25T09:17:07.423 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 12 tests. 2024-04-25T09:17:07.423 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:17:07.423 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:17:07.423 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_list 2024-04-25T09:17:07.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.465+0000 7f910d06a9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:17:07.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.465+0000 7f910d06a9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:17:07.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:07.465+0000 7f910d06a9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:17:07.453 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 11 tests from 3 test suites. 2024-04-25T09:17:07.454 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:17:07.454 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 7 tests from LibRadosList 2024-04-25T09:17:08.940 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosList.ListObjects 2024-04-25T09:17:09.556 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosList.ListObjects (615 ms) 2024-04-25T09:17:09.556 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-04-25T09:17:09.754 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (198 ms) 2024-04-25T09:17:09.754 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-04-25T09:17:09.835 INFO:tasks.workunit.client.0.smithi053.stdout:myset foo1,foo2,foo3 2024-04-25T09:17:09.926 INFO:tasks.workunit.client.0.smithi053.stdout:foo1 2024-04-25T09:17:09.927 INFO:tasks.workunit.client.0.smithi053.stdout:foo2 2024-04-25T09:17:09.927 INFO:tasks.workunit.client.0.smithi053.stdout:foo3 2024-04-25T09:17:09.927 INFO:tasks.workunit.client.0.smithi053.stdout:myset foo1,foo4,foo5 2024-04-25T09:17:10.086 INFO:tasks.workunit.client.0.smithi053.stdout:foo4 2024-04-25T09:17:10.087 INFO:tasks.workunit.client.0.smithi053.stdout:foo5 2024-04-25T09:17:10.087 INFO:tasks.workunit.client.0.smithi053.stdout:foo1 2024-04-25T09:17:10.087 INFO:tasks.workunit.client.0.smithi053.stdout:myset foo6,foo7 2024-04-25T09:17:10.178 INFO:tasks.workunit.client.0.smithi053.stdout:foo7 2024-04-25T09:17:10.178 INFO:tasks.workunit.client.0.smithi053.stdout:foo6 2024-04-25T09:17:10.178 INFO:tasks.workunit.client.0.smithi053.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-25T09:17:10.270 INFO:tasks.workunit.client.0.smithi053.stdout:ns1:foo4 2024-04-25T09:17:10.270 INFO:tasks.workunit.client.0.smithi053.stdout:ns1:foo5 2024-04-25T09:17:10.270 INFO:tasks.workunit.client.0.smithi053.stdout:ns2:foo7 2024-04-25T09:17:10.270 INFO:tasks.workunit.client.0.smithi053.stdout:ns2:foo6 2024-04-25T09:17:10.270 INFO:tasks.workunit.client.0.smithi053.stdout:ns1:foo1 2024-04-25T09:17:10.270 INFO:tasks.workunit.client.0.smithi053.stdout::foo1 2024-04-25T09:17:10.270 INFO:tasks.workunit.client.0.smithi053.stdout::foo2 2024-04-25T09:17:10.270 INFO:tasks.workunit.client.0.smithi053.stdout::foo3 2024-04-25T09:17:10.433 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosList.ListObjectsNS (680 ms) 2024-04-25T09:17:10.434 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:1 0 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:10 0 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:13 0 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:7 0 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:14 0 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:0 0 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:15 0 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:11 0 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:5 0 2024-04-25T09:17:10.691 INFO:tasks.workunit.client.0.smithi053.stdout:8 0 2024-04-25T09:17:10.692 INFO:tasks.workunit.client.0.smithi053.stdout:6 0 2024-04-25T09:17:10.692 INFO:tasks.workunit.client.0.smithi053.stdout:3 0 2024-04-25T09:17:10.692 INFO:tasks.workunit.client.0.smithi053.stdout:4 0 2024-04-25T09:17:10.692 INFO:tasks.workunit.client.0.smithi053.stdout:12 0 2024-04-25T09:17:10.692 INFO:tasks.workunit.client.0.smithi053.stdout:9 0 2024-04-25T09:17:10.692 INFO:tasks.workunit.client.0.smithi053.stdout:2 0 2024-04-25T09:17:10.781 INFO:tasks.workunit.client.0.smithi053.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-25T09:17:11.029 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosList.ListObjectsStart (596 ms) 2024-04-25T09:17:11.029 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-04-25T09:17:11.196 INFO:tasks.workunit.client.0.smithi053.stdout:x cursor=MIN 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-04-25T09:17:11.432 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-04-25T09:17:11.433 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-04-25T09:17:11.433 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-04-25T09:17:11.433 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-04-25T09:17:11.433 INFO:tasks.workunit.client.0.smithi053.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-04-25T09:17:11.522 INFO:tasks.workunit.client.0.smithi053.stdout:FIRST> seek to MIN oid=1 2024-04-25T09:17:11.611 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-04-25T09:17:11.612 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:02547ec2:::1:head 2024-04-25T09:17:11.703 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:02547ec2:::1:head -> 1 2024-04-25T09:17:11.703 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-04-25T09:17:11.703 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:52ea6a34:::10:head 2024-04-25T09:17:11.764 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:52ea6a34:::10:head -> 10 2024-04-25T09:17:11.764 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-04-25T09:17:11.764 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:566253c9:::13:head 2024-04-25T09:17:11.825 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:566253c9:::13:head -> 13 2024-04-25T09:17:11.825 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-04-25T09:17:11.825 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:5c6b0b28:::7:head 2024-04-25T09:17:11.883 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:5c6b0b28:::7:head -> 7 2024-04-25T09:17:11.884 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-04-25T09:17:11.884 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:62a1935d:::14:head 2024-04-25T09:17:11.939 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:62a1935d:::14:head -> 14 2024-04-25T09:17:11.940 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-04-25T09:17:11.940 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:6cac518f:::0:head 2024-04-25T09:17:11.992 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:6cac518f:::0:head -> 0 2024-04-25T09:17:11.992 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-04-25T09:17:11.992 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:863748b0:::15:head 2024-04-25T09:17:12.038 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:863748b0:::15:head -> 15 2024-04-25T09:17:12.038 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-04-25T09:17:12.038 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:89d3ae78:::11:head 2024-04-25T09:17:12.080 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:89d3ae78:::11:head -> 11 2024-04-25T09:17:12.080 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-04-25T09:17:12.080 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:b29083e3:::5:head 2024-04-25T09:17:12.108 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:b29083e3:::5:head -> 5 2024-04-25T09:17:12.108 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-04-25T09:17:12.108 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:bd63b0f1:::8:head 2024-04-25T09:17:12.133 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:bd63b0f1:::8:head -> 8 2024-04-25T09:17:12.133 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-04-25T09:17:12.133 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:c4fdafeb:::6:head 2024-04-25T09:17:12.155 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:c4fdafeb:::6:head -> 6 2024-04-25T09:17:12.155 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-04-25T09:17:12.155 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:cfc208b3:::3:head 2024-04-25T09:17:12.175 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:cfc208b3:::3:head -> 3 2024-04-25T09:17:12.175 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-04-25T09:17:12.175 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:d83876eb:::4:head 2024-04-25T09:17:12.189 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:d83876eb:::4:head -> 4 2024-04-25T09:17:12.189 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-04-25T09:17:12.189 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:de5d7c5f:::12:head 2024-04-25T09:17:12.202 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:de5d7c5f:::12:head -> 12 2024-04-25T09:17:12.202 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-04-25T09:17:12.202 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:e960b815:::9:head 2024-04-25T09:17:12.210 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:e960b815:::9:head -> 9 2024-04-25T09:17:12.210 INFO:tasks.workunit.client.0.smithi053.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-04-25T09:17:12.210 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:f905c69b:::2:head 2024-04-25T09:17:12.213 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:f905c69b:::2:head -> 2 2024-04-25T09:17:12.213 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:f905c69b:::2:head 2024-04-25T09:17:12.213 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-04-25T09:17:12.215 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:f905c69b:::2:head -> 2 2024-04-25T09:17:12.215 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=2 expected=2 2024-04-25T09:17:12.215 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:cfc208b3:::3:head 2024-04-25T09:17:12.215 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-04-25T09:17:12.234 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:cfc208b3:::3:head -> 3 2024-04-25T09:17:12.235 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=3 expected=3 2024-04-25T09:17:12.235 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:c4fdafeb:::6:head 2024-04-25T09:17:12.235 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-04-25T09:17:12.257 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:c4fdafeb:::6:head -> 6 2024-04-25T09:17:12.257 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=6 expected=6 2024-04-25T09:17:12.257 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:52ea6a34:::10:head 2024-04-25T09:17:12.257 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-04-25T09:17:12.318 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:52ea6a34:::10:head -> 10 2024-04-25T09:17:12.318 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=10 expected=10 2024-04-25T09:17:12.318 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:02547ec2:::1:head 2024-04-25T09:17:12.318 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-04-25T09:17:12.410 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:02547ec2:::1:head -> 1 2024-04-25T09:17:12.410 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=1 expected=1 2024-04-25T09:17:12.410 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:62a1935d:::14:head 2024-04-25T09:17:12.411 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-04-25T09:17:12.467 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:62a1935d:::14:head -> 14 2024-04-25T09:17:12.467 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=14 expected=14 2024-04-25T09:17:12.467 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:e960b815:::9:head 2024-04-25T09:17:12.467 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-04-25T09:17:12.475 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:e960b815:::9:head -> 9 2024-04-25T09:17:12.475 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=9 expected=9 2024-04-25T09:17:12.475 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:de5d7c5f:::12:head 2024-04-25T09:17:12.476 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-04-25T09:17:12.489 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:de5d7c5f:::12:head -> 12 2024-04-25T09:17:12.489 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=12 expected=12 2024-04-25T09:17:12.489 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:d83876eb:::4:head 2024-04-25T09:17:12.489 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-04-25T09:17:12.502 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:d83876eb:::4:head -> 4 2024-04-25T09:17:12.502 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=4 expected=4 2024-04-25T09:17:12.502 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:566253c9:::13:head 2024-04-25T09:17:12.502 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-04-25T09:17:12.564 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:566253c9:::13:head -> 13 2024-04-25T09:17:12.564 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=13 expected=13 2024-04-25T09:17:12.565 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:bd63b0f1:::8:head 2024-04-25T09:17:12.565 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-04-25T09:17:12.590 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:bd63b0f1:::8:head -> 8 2024-04-25T09:17:12.590 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=8 expected=8 2024-04-25T09:17:12.590 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:b29083e3:::5:head 2024-04-25T09:17:12.590 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-04-25T09:17:12.617 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:b29083e3:::5:head -> 5 2024-04-25T09:17:12.618 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=5 expected=5 2024-04-25T09:17:12.618 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:89d3ae78:::11:head 2024-04-25T09:17:12.618 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-04-25T09:17:12.660 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:89d3ae78:::11:head -> 11 2024-04-25T09:17:12.660 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=11 expected=11 2024-04-25T09:17:12.660 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:863748b0:::15:head 2024-04-25T09:17:12.660 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-04-25T09:17:12.705 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:863748b0:::15:head -> 15 2024-04-25T09:17:12.705 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=15 expected=15 2024-04-25T09:17:12.705 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:6cac518f:::0:head 2024-04-25T09:17:12.705 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-04-25T09:17:12.758 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:6cac518f:::0:head -> 0 2024-04-25T09:17:12.758 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=0 expected=0 2024-04-25T09:17:12.758 INFO:tasks.workunit.client.0.smithi053.stdout:: seek to 76:5c6b0b28:::7:head 2024-04-25T09:17:12.758 INFO:tasks.workunit.client.0.smithi053.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-04-25T09:17:12.871 INFO:tasks.workunit.client.0.smithi053.stdout:> 76:5c6b0b28:::7:head -> 7 2024-04-25T09:17:12.871 INFO:tasks.workunit.client.0.smithi053.stdout:: entry=7 expected=7 2024-04-25T09:17:13.121 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosList.ListObjectsCursor (2092 ms) 2024-04-25T09:17:13.121 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-04-25T09:17:13.629 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosList.EnumerateObjects (507 ms) 2024-04-25T09:17:13.629 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-04-25T09:17:13.790 INFO:tasks.workunit.client.0.smithi053.stdout:split 0/5 -> MIN 76:33333333::::head 2024-04-25T09:17:13.811 INFO:tasks.workunit.client.0.smithi053.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-04-25T09:17:13.832 INFO:tasks.workunit.client.0.smithi053.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-04-25T09:17:13.856 INFO:tasks.workunit.client.0.smithi053.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-04-25T09:17:13.875 INFO:tasks.workunit.client.0.smithi053.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-04-25T09:17:14.144 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (516 ms) 2024-04-25T09:17:14.942 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 7 tests from LibRadosList (5205 ms total) 2024-04-25T09:17:14.942 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosListEC 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:70: Skipped 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:84: Skipped 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:96: Skipped 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:84: Skipped 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:96: Skipped 2024-04-25T09:17:14.943 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:84: Skipped 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:96: Skipped 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:78: Skipped 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosListNP 2024-04-25T09:17:14.944 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosListNP.ListObjectsError (3000 ms) 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosListNP (3000 ms total) 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 11 tests from 3 test suites ran. (10489 ms total) 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 8 tests. 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 3 tests, listed below: 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-04-25T09:17:17.942 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-04-25T09:17:17.945 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:17:17.946 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:17:17.946 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_lock 2024-04-25T09:17:17.968 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:17:17.968 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 16 tests from 2 test suites. 2024-04-25T09:17:17.968 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:17:17.968 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosLock 2024-04-25T09:17:19.965 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-04-25T09:17:20.333 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLock.LockExclusive (367 ms) 2024-04-25T09:17:20.333 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLock.LockShared 2024-04-25T09:17:20.354 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLock.LockShared (22 ms) 2024-04-25T09:17:20.355 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-04-25T09:17:21.391 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1036 ms) 2024-04-25T09:17:21.391 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-04-25T09:17:22.437 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLock.LockSharedDur (1046 ms) 2024-04-25T09:17:22.437 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-04-25T09:17:22.479 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLock.LockMayRenew (41 ms) 2024-04-25T09:17:22.479 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLock.Unlock 2024-04-25T09:17:22.518 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLock.Unlock (40 ms) 2024-04-25T09:17:22.518 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLock.ListLockers 2024-04-25T09:17:22.569 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLock.ListLockers (50 ms) 2024-04-25T09:17:22.569 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLock.BreakLock 2024-04-25T09:17:22.600 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLock.BreakLock (32 ms) 2024-04-25T09:17:22.944 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosLock (2636 ms total) 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosLockEC 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:168: Skipped 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-04-25T09:17:22.945 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-04-25T09:17:22.946 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:17:22.946 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.946 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:17:22.946 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.946 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-04-25T09:17:22.946 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-04-25T09:17:22.946 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:17:22.946 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.946 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:17:22.947 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.948 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:176: Skipped 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 16 tests from 2 test suites ran. (4976 ms total) 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 8 tests. 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 8 tests, listed below: 2024-04-25T09:17:22.949 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-04-25T09:17:22.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-04-25T09:17:22.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-04-25T09:17:22.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-04-25T09:17:22.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-04-25T09:17:22.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-04-25T09:17:22.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-04-25T09:17:22.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-04-25T09:17:22.950 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:17:22.951 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:17:22.951 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_lock_pp 2024-04-25T09:17:22.967 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:17:22.967 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 16 tests from 2 test suites. 2024-04-25T09:17:22.967 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:17:22.967 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosLockPP 2024-04-25T09:17:22.967 INFO:tasks.workunit.client.0.smithi053.stdout:seed 31546 2024-04-25T09:17:24.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-04-25T09:17:25.311 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (331 ms) 2024-04-25T09:17:25.311 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-04-25T09:17:25.337 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLockPP.LockSharedPP (27 ms) 2024-04-25T09:17:25.337 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-04-25T09:17:26.377 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1039 ms) 2024-04-25T09:17:26.377 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-04-25T09:17:27.411 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1035 ms) 2024-04-25T09:17:27.412 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-04-25T09:17:27.459 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (47 ms) 2024-04-25T09:17:27.459 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-04-25T09:17:27.497 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLockPP.UnlockPP (38 ms) 2024-04-25T09:17:27.497 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-04-25T09:17:27.552 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLockPP.ListLockersPP (56 ms) 2024-04-25T09:17:27.552 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-04-25T09:17:27.580 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosLockPP.BreakLockPP (28 ms) 2024-04-25T09:17:27.946 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosLockPP (2601 ms total) 2024-04-25T09:17:27.946 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosLockECPP 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.947 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:27.948 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.948 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-04-25T09:17:27.948 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-25T09:17:27.948 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:27.948 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.948 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.950 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-04-25T09:17:27.951 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 16 tests from 2 test suites ran. (4978 ms total) 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 8 tests. 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 8 tests, listed below: 2024-04-25T09:17:27.952 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-04-25T09:17:27.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-04-25T09:17:27.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-25T09:17:27.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-04-25T09:17:27.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-04-25T09:17:27.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-04-25T09:17:27.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-04-25T09:17:27.953 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-04-25T09:17:27.953 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:17:27.954 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:17:27.954 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_misc 2024-04-25T09:17:27.982 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:27.995+0000 7f2f6ecb36c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:17:27.982 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:27.996+0000 7f2f6ecb36c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:17:27.982 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:27.996+0000 7f2f6ecb36c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:17:27.983 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 12 tests from 4 test suites. 2024-04-25T09:17:27.983 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:17:27.983 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosMiscVersion 2024-04-25T09:17:27.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-04-25T09:17:27.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-04-25T09:17:27.983 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-25T09:17:27.983 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:27.983 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-04-25T09:17:27.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-04-25T09:17:28.018 INFO:tasks.workunit.client.0.smithi053.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-04-25T09:17:28.018 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:28.031+0000 7f2f6ecb36c0 -1 failed for service _ceph-mon._tcp 2024-04-25T09:17:28.018 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:17:28.031+0000 7f2f6ecb36c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-04-25T09:17:28.018 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (35 ms) 2024-04-25T09:17:28.018 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-04-25T09:17:30.025 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2006 ms) 2024-04-25T09:17:30.025 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (2042 ms total) 2024-04-25T09:17:30.025 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:30.025 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosMiscPool 2024-04-25T09:17:30.025 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-04-25T09:17:32.953 INFO:tasks.workunit.client.0.smithi053.stdout:started 0x7f2f34005d20 2024-04-25T09:17:33.953 INFO:tasks.workunit.client.0.smithi053.stdout:started 0x7f2f50005d20 2024-04-25T09:17:33.954 INFO:tasks.workunit.client.0.smithi053.stdout: started 2 aios 2024-04-25T09:17:33.954 INFO:tasks.workunit.client.0.smithi053.stdout:waiting 0x7f2f34005d20 2024-04-25T09:17:33.954 INFO:tasks.workunit.client.0.smithi053.stdout:waiting 0x7f2f50005d20 2024-04-25T09:17:33.959 INFO:tasks.workunit.client.0.smithi053.stdout:done. 2024-04-25T09:17:35.971 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (5947 ms) 2024-04-25T09:17:35.971 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosMiscPool (5947 ms total) 2024-04-25T09:17:35.972 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:17:35.972 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosMisc 2024-04-25T09:17:37.946 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-04-25T09:17:37.946 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-04-25T09:17:37.946 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMisc.Exec 2024-04-25T09:17:38.288 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMisc.Exec (343 ms) 2024-04-25T09:17:38.288 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-04-25T09:17:38.338 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMisc.WriteSame (50 ms) 2024-04-25T09:17:38.338 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-04-25T09:17:38.378 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMisc.CmpExt (38 ms) 2024-04-25T09:17:38.378 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMisc.Applications 2024-04-25T09:17:42.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMisc.Applications (4622 ms) 2024-04-25T09:17:42.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-04-25T09:17:42.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-04-25T09:17:42.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-04-25T09:17:42.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-04-25T09:17:42.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-04-25T09:18:11.232 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMisc.ShutdownRace (28233 ms) 2024-04-25T09:18:11.966 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 8 tests from LibRadosMisc (33286 ms total) 2024-04-25T09:18:11.966 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:11.966 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:18:11.966 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 12 tests from 4 test suites ran. (43984 ms total) 2024-04-25T09:18:11.966 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 12 tests. 2024-04-25T09:18:11.981 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:18:11.981 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:18:11.981 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_misc_pp 2024-04-25T09:18:12.025 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:18:12.038+0000 7f30a402b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:18:12.025 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:18:12.038+0000 7f30a402b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:18:12.025 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:18:12.038+0000 7f30a402b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:18:12.025 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 31 tests from 7 test suites. 2024-04-25T09:18:12.025 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:18:12.025 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosMiscVersion 2024-04-25T09:18:12.026 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-04-25T09:18:12.026 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-04-25T09:18:12.026 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-25T09:18:12.026 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:12.026 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 22 tests from LibRadosMiscPP 2024-04-25T09:18:12.026 INFO:tasks.workunit.client.0.smithi053.stdout:seed 93215 2024-04-25T09:18:13.957 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-04-25T09:18:13.957 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (1 ms) 2024-04-25T09:18:13.957 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-04-25T09:18:14.480 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.LongNamePP (522 ms) 2024-04-25T09:18:14.480 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-04-25T09:18:14.480 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/misc_cxx.cc:53: Skipped 2024-04-25T09:18:14.480 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:14.480 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-04-25T09:18:14.480 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-04-25T09:18:14.532 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (53 ms) 2024-04-25T09:18:14.533 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-04-25T09:18:14.577 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (44 ms) 2024-04-25T09:18:14.577 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-04-25T09:18:14.597 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.ExecPP (20 ms) 2024-04-25T09:18:14.597 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-04-25T09:18:14.611 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (15 ms) 2024-04-25T09:18:14.611 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-04-25T09:18:14.639 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.Operate1PP (28 ms) 2024-04-25T09:18:14.639 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-04-25T09:18:14.654 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.Operate2PP (15 ms) 2024-04-25T09:18:14.655 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-04-25T09:18:14.699 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (45 ms) 2024-04-25T09:18:14.700 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-04-25T09:18:14.715 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (16 ms) 2024-04-25T09:18:14.715 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-04-25T09:18:14.738 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (22 ms) 2024-04-25T09:18:14.738 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-04-25T09:18:14.782 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (44 ms) 2024-04-25T09:18:14.782 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-04-25T09:18:14.792 INFO:tasks.workunit.client.0.smithi053.stdout:osd_max_attr_size = 0 2024-04-25T09:18:14.793 INFO:tasks.workunit.client.0.smithi053.stdout:osd_max_attr_size == 0; skipping test 2024-04-25T09:18:32.448 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (17666 ms) 2024-04-25T09:18:32.449 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-04-25T09:18:32.449 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/misc_cxx.cc:387: Skipped 2024-04-25T09:18:32.449 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:32.449 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-04-25T09:18:32.449 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-04-25T09:18:32.449 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/misc_cxx.cc:550: Skipped 2024-04-25T09:18:32.449 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:32.449 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-04-25T09:18:32.449 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-04-25T09:18:32.487 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (40 ms) 2024-04-25T09:18:32.487 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-04-25T09:18:32.513 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (26 ms) 2024-04-25T09:18:32.514 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-04-25T09:18:37.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.Applications (4488 ms) 2024-04-25T09:18:37.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-04-25T09:18:37.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-04-25T09:18:37.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-04-25T09:18:37.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-04-25T09:18:37.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-04-25T09:18:37.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-04-25T09:18:37.959 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 22 tests from LibRadosMiscPP (23045 ms total) 2024-04-25T09:18:37.959 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:37.959 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-04-25T09:18:37.959 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/misc_cxx.cc:477: Skipped 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/misc_cxx.cc:499: Skipped 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/misc_cxx.cc:505: Skipped 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/misc_cxx.cc:492: Skipped 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:37.960 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-04-25T09:18:39.966 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-04-25T09:18:40.315 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosChecksum/0.Subset (348 ms) 2024-04-25T09:18:40.315 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-04-25T09:18:40.370 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosChecksum/0.Chunked (56 ms) 2024-04-25T09:18:40.967 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosChecksum/0 (404 ms total) 2024-04-25T09:18:40.967 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:40.967 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-04-25T09:18:42.978 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-04-25T09:18:43.347 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosChecksum/1.Subset (369 ms) 2024-04-25T09:18:43.347 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-04-25T09:18:43.429 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosChecksum/1.Chunked (82 ms) 2024-04-25T09:18:43.982 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosChecksum/1 (451 ms total) 2024-04-25T09:18:43.982 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:43.982 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-04-25T09:18:45.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-04-25T09:18:46.332 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosChecksum/2.Subset (342 ms) 2024-04-25T09:18:46.332 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-04-25T09:18:46.376 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosChecksum/2.Chunked (44 ms) 2024-04-25T09:18:46.996 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosChecksum/2 (386 ms total) 2024-04-25T09:18:46.996 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosMiscECPP 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-04-25T09:18:46.997 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:18:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 31 tests from 7 test suites ran. (34972 ms total) 2024-04-25T09:18:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 26 tests. 2024-04-25T09:18:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 5 tests, listed below: 2024-04-25T09:18:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-04-25T09:18:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-04-25T09:18:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-04-25T09:18:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-25T09:18:46.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-04-25T09:18:46.999 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:18:46.999 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:18:46.999 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_tier_pp 2024-04-25T09:18:47.044 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:18:47.057+0000 7fbcf3d289c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:18:47.044 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:18:47.057+0000 7fbcf3d289c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:18:47.045 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:18:47.057+0000 7fbcf3d289c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:18:47.045 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 77 tests from 4 test suites. 2024-04-25T09:18:47.045 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:18:47.045 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosTierPP 2024-04-25T09:18:47.045 INFO:tasks.workunit.client.0.smithi053.stdout:seed 93299 2024-04-25T09:18:48.962 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-04-25T09:18:48.962 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:287: Skipped 2024-04-25T09:18:48.963 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:48.963 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-04-25T09:18:48.963 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-04-25T09:18:48.963 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:2182: Skipped 2024-04-25T09:18:48.963 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:48.963 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-04-25T09:18:48.963 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-04-25T09:18:48.963 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:2561: Skipped 2024-04-25T09:18:48.963 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:48.964 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-04-25T09:18:49.965 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-04-25T09:18:49.965 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:49.965 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.979 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-04-25T09:18:51.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-25T09:18:51.980 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.980 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.980 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.980 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-04-25T09:18:51.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-04-25T09:18:51.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (1 ms) 2024-04-25T09:18:51.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-04-25T09:18:51.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-04-25T09:18:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-04-25T09:18:51.989 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.989 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-04-25T09:18:51.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.992 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-04-25T09:18:51.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.994 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.995 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-04-25T09:18:51.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-04-25T09:18:51.995 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.995 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.995 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.995 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-04-25T09:18:51.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-04-25T09:18:51.996 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.996 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-04-25T09:18:51.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-04-25T09:18:51.996 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.997 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.997 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-04-25T09:18:51.998 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:51.999 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-04-25T09:18:52.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:52.001 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.002 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:52.002 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-04-25T09:18:52.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-04-25T09:18:52.002 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-25T09:18:52.002 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.002 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-25T09:18:52.002 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-04-25T09:18:52.984 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-04-25T09:18:52.984 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:52.984 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosTierECPP 2024-04-25T09:18:52.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-25T09:18:52.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-04-25T09:18:52.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:18:52.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:18:52.985 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6267: Skipped 2024-04-25T09:18:52.986 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-04-25T09:18:52.987 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.988 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-04-25T09:18:52.989 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.990 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.991 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-04-25T09:18:52.992 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.993 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-04-25T09:18:52.994 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-25T09:18:52.995 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/tier_cxx.cc:6272: Skipped 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (0 ms total) 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 77 tests from 4 test suites ran. (5935 ms total) 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 0 tests. 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 77 tests, listed below: 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-04-25T09:18:52.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-04-25T09:18:52.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-04-25T09:18:52.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-04-25T09:18:52.999 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-04-25T09:18:53.000 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-04-25T09:18:53.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-04-25T09:18:53.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-04-25T09:18:53.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-04-25T09:18:53.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-04-25T09:18:53.002 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-04-25T09:18:53.002 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:18:53.002 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:18:53.002 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_pool 2024-04-25T09:18:53.003 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:18:53.003 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 9 tests from 1 test suite. 2024-04-25T09:18:53.003 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:18:53.003 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 9 tests from LibRadosPools 2024-04-25T09:18:53.003 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPools.PoolList 2024-04-25T09:18:55.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPools.PoolList (2989 ms) 2024-04-25T09:18:55.993 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-04-25T09:18:58.968 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPools.PoolLookup (2975 ms) 2024-04-25T09:18:58.969 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-04-25T09:19:01.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPools.PoolLookup2 (3012 ms) 2024-04-25T09:19:01.980 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-04-25T09:19:04.991 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3011 ms) 2024-04-25T09:19:04.992 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-04-25T09:19:07.965 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (2974 ms) 2024-04-25T09:19:07.965 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-04-25T09:19:12.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPools.PoolDelete (5016 ms) 2024-04-25T09:19:12.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-04-25T09:19:17.968 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPools.PoolCreateDelete (4987 ms) 2024-04-25T09:19:17.969 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-04-25T09:19:23.022 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (5053 ms) 2024-04-25T09:19:23.022 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-04-25T09:19:23.022 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/pool.cc:139: Skipped 2024-04-25T09:19:23.022 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:23.022 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-04-25T09:19:23.022 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 9 tests from LibRadosPools (30018 ms total) 2024-04-25T09:19:23.022 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:19:23.022 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:19:23.022 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 9 tests from 1 test suite ran. (30019 ms total) 2024-04-25T09:19:23.023 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 8 tests. 2024-04-25T09:19:23.023 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 1 test, listed below: 2024-04-25T09:19:23.023 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-04-25T09:19:23.024 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:19:23.024 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:19:23.024 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_snapshots 2024-04-25T09:19:23.049 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:19:23.049 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 13 tests from 4 test suites. 2024-04-25T09:19:23.049 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:19:23.049 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosSnapshots 2024-04-25T09:19:25.032 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-04-25T09:19:27.039 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshots.SnapList (2007 ms) 2024-04-25T09:19:27.040 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-04-25T09:19:28.969 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshots.SnapRemove (1930 ms) 2024-04-25T09:19:28.969 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-04-25T09:19:30.977 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshots.Rollback (2008 ms) 2024-04-25T09:19:30.977 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-04-25T09:19:32.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2007 ms) 2024-04-25T09:19:33.994 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosSnapshots (7952 ms total) 2024-04-25T09:19:33.994 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:19:33.994 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-04-25T09:19:36.001 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-04-25T09:19:40.138 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4137 ms) 2024-04-25T09:19:40.139 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-04-25T09:19:44.131 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (3993 ms) 2024-04-25T09:19:44.131 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-04-25T09:19:49.176 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5045 ms) 2024-04-25T09:19:49.980 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13175 ms total) 2024-04-25T09:19:49.980 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:168: Skipped 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (1 ms) 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:19:49.981 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-04-25T09:19:49.982 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:176: Skipped 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosSnapshotsEC (1 ms total) 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:168: Skipped 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:19:49.983 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:176: Skipped 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 13 tests from 4 test suites ran. (26930 ms total) 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 7 tests. 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 6 tests, listed below: 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-04-25T09:19:49.984 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-25T09:19:49.985 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-25T09:19:49.985 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:19:49.985 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:19:49.985 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_snapshots_pp 2024-04-25T09:19:50.004 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:19:50.004 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 21 tests from 5 test suites. 2024-04-25T09:19:50.004 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:19:50.004 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-04-25T09:19:50.004 INFO:tasks.workunit.client.0.smithi053.stdout:seed 93555 2024-04-25T09:19:51.988 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-04-25T09:19:53.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (2007 ms) 2024-04-25T09:19:53.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-04-25T09:19:56.003 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2008 ms) 2024-04-25T09:19:56.003 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-04-25T09:19:57.976 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (1972 ms) 2024-04-25T09:19:57.976 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-04-25T09:20:00.017 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2039 ms) 2024-04-25T09:20:00.018 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-04-25T09:20:04.029 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4015 ms) 2024-04-25T09:20:05.034 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 5 tests from LibRadosSnapshotsPP (12041 ms total) 2024-04-25T09:20:05.035 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:05.035 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-04-25T09:20:07.043 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-04-25T09:20:11.202 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4160 ms) 2024-04-25T09:20:11.203 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-25T09:20:11.203 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/snapshots_cxx.cc:156: Skipped 2024-04-25T09:20:11.203 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:11.203 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP (0 ms) 2024-04-25T09:20:11.203 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-25T09:20:11.203 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/snapshots_cxx.cc:242: Skipped 2024-04-25T09:20:11.203 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:11.203 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (0 ms) 2024-04-25T09:20:11.203 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-04-25T09:20:15.069 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3867 ms) 2024-04-25T09:20:15.070 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-04-25T09:20:17.258 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2188 ms) 2024-04-25T09:20:17.258 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-25T09:20:17.258 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-04-25T09:20:17.258 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:17.258 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-04-25T09:20:17.258 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-04-25T09:20:19.086 INFO:tasks.workunit.client.0.smithi053.stdout:deleting snap 9 in pool LibRadosSnapshotsSelfManagedPP_smithi053-93555-7 2024-04-25T09:20:20.085 INFO:tasks.workunit.client.0.smithi053.stdout:waiting for snaps to purge 2024-04-25T09:20:35.104 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17846 ms) 2024-04-25T09:20:35.990 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (28062 ms total) 2024-04-25T09:20:35.990 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:35.990 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-04-25T09:20:35.990 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-04-25T09:20:35.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (6 ms) 2024-04-25T09:20:35.996 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-04-25T09:20:41.056 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5058 ms) 2024-04-25T09:20:41.056 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5064 ms total) 2024-04-25T09:20:41.056 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:41.056 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-04-25T09:20:41.056 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-25T09:20:41.056 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.056 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-04-25T09:20:41.056 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-04-25T09:20:41.057 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-04-25T09:20:41.058 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.059 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 21 tests from 5 test suites ran. (51050 ms total) 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 11 tests. 2024-04-25T09:20:41.060 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 10 tests, listed below: 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-25T09:20:41.061 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-25T09:20:41.062 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:20:41.062 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:20:41.062 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_stat 2024-04-25T09:20:41.077 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:20:41.078 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 9 tests from 2 test suites. 2024-04-25T09:20:41.078 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:20:41.078 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 5 tests from LibRadosStat 2024-04-25T09:20:42.986 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStat.Stat 2024-04-25T09:20:43.288 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStat.Stat (302 ms) 2024-04-25T09:20:43.288 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStat.Stat2 2024-04-25T09:20:43.351 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStat.Stat2 (63 ms) 2024-04-25T09:20:43.351 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStat.StatNS 2024-04-25T09:20:43.412 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStat.StatNS (61 ms) 2024-04-25T09:20:43.413 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-04-25T09:20:43.413 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStat.ClusterStat (1 ms) 2024-04-25T09:20:43.413 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStat.PoolStat 2024-04-25T09:20:43.425 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStat.PoolStat (12 ms) 2024-04-25T09:20:44.021 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 5 tests from LibRadosStat (439 ms total) 2024-04-25T09:20:44.021 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:44.021 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosStatEC 2024-04-25T09:20:44.021 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:168: Skipped 2024-04-25T09:20:44.021 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatEC.Stat 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-04-25T09:20:44.022 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:176: Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:44.023 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:20:44.024 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 9 tests from 2 test suites ran. (2942 ms total) 2024-04-25T09:20:44.024 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 5 tests. 2024-04-25T09:20:44.024 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 4 tests, listed below: 2024-04-25T09:20:44.024 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-04-25T09:20:44.024 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-04-25T09:20:44.024 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-04-25T09:20:44.024 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-04-25T09:20:44.024 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:20:44.024 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:20:44.025 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_stat_pp 2024-04-25T09:20:44.047 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:20:44.047 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 9 tests from 2 test suites. 2024-04-25T09:20:44.047 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:20:44.047 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 5 tests from LibRadosStatPP 2024-04-25T09:20:44.047 INFO:tasks.workunit.client.0.smithi053.stdout:seed 93690 2024-04-25T09:20:46.028 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-04-25T09:20:46.457 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStatPP.StatPP (429 ms) 2024-04-25T09:20:46.457 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-04-25T09:20:46.485 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (27 ms) 2024-04-25T09:20:46.485 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-04-25T09:20:46.485 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (1 ms) 2024-04-25T09:20:46.485 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-04-25T09:20:46.496 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStatPP.PoolStatPP (11 ms) 2024-04-25T09:20:46.496 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-04-25T09:20:46.547 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosStatPP.StatPPNS (51 ms) 2024-04-25T09:20:47.031 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 5 tests from LibRadosStatPP (519 ms total) 2024-04-25T09:20:47.031 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:47.031 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosStatECPP 2024-04-25T09:20:47.031 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-25T09:20:47.031 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.031 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-04-25T09:20:47.031 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:47.031 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.031 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.032 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 9 tests from 2 test suites ran. (2982 ms total) 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 5 tests. 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 4 tests, listed below: 2024-04-25T09:20:47.033 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-04-25T09:20:47.034 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-04-25T09:20:47.034 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-04-25T09:20:47.034 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-04-25T09:20:47.034 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:20:47.034 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:20:47.034 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_watch_notify 2024-04-25T09:20:47.055 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:20:47.055 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 11 tests from 2 test suites. 2024-04-25T09:20:47.055 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:20:47.055 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-04-25T09:20:49.042 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-04-25T09:20:49.455 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify_test_cb 2024-04-25T09:20:49.476 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (434 ms) 2024-04-25T09:20:49.476 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-04-25T09:20:49.513 INFO:tasks.workunit.client.0.smithi053.stdout:waiting up to 300 for disconnect notification ... 2024-04-25T09:20:52.102 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_errcb cookie 41205264 err -107 2024-04-25T09:20:52.522 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3046 ms) 2024-04-25T09:20:52.523 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-04-25T09:20:52.562 INFO:tasks.workunit.client.0.smithi053.stdout:waiting up to 300 for disconnect notification ... 2024-04-25T09:20:57.103 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_errcb cookie 41221168 err -107 2024-04-25T09:20:57.571 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5049 ms) 2024-04-25T09:20:57.571 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-04-25T09:20:57.603 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_cb from 15602 notify_id 1692217114624 cookie 41221168 2024-04-25T09:20:57.624 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (53 ms) 2024-04-25T09:20:57.624 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-04-25T09:20:57.656 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_cb from 15602 notify_id 1692217114624 cookie 41243376 2024-04-25T09:20:57.676 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (52 ms) 2024-04-25T09:20:57.676 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-04-25T09:20:57.703 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_cb from 15602 notify_id 1692217114625 cookie 41240368 2024-04-25T09:20:57.724 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.AioNotify (48 ms) 2024-04-25T09:20:57.724 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-04-25T09:20:57.763 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_cb from 15602 notify_id 1692217114625 cookie 41240368 2024-04-25T09:20:57.764 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_cb from 15602 notify_id 1692217114625 cookie 41257440 2024-04-25T09:20:57.793 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (69 ms) 2024-04-25T09:20:57.793 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-04-25T09:20:57.819 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_cb from 15602 notify_id 1692217114626 cookie 41257440 2024-04-25T09:21:00.820 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_cb from 15602 notify_id 1692217114627 cookie 41257440 2024-04-25T09:21:00.844 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3051 ms) 2024-04-25T09:21:00.844 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-04-25T09:21:00.871 INFO:tasks.workunit.client.0.smithi053.stdout:waiting up to 1024 for osd to time us out ... 2024-04-25T09:21:04.880 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_errcb cookie 41257440 err -107 2024-04-25T09:21:05.904 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_cb from 15602 notify_id 1692217114629 cookie 41257440 2024-04-25T09:21:05.922 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5077 ms) 2024-04-25T09:21:05.922 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-04-25T09:21:05.963 INFO:tasks.workunit.client.0.smithi053.stdout:waiting up to 30 for disconnect notification ... 2024-04-25T09:21:07.104 INFO:tasks.workunit.client.0.smithi053.stdout:watch_notify2_test_errcb cookie 41240336 err -107 2024-04-25T09:21:07.973 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2051 ms) 2024-04-25T09:21:08.300 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 10 tests from LibRadosWatchNotify (18931 ms total) 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:168: Skipped 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:182: Skipped 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:196: Skipped 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/TestCase.cc:176: Skipped 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.301 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-04-25T09:21:08.302 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:08.302 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:21:08.302 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 11 tests from 2 test suites ran. (21245 ms total) 2024-04-25T09:21:08.302 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 10 tests. 2024-04-25T09:21:08.302 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 1 test, listed below: 2024-04-25T09:21:08.302 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-04-25T09:21:08.303 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:21:08.303 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:21:08.303 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-04-25T09:21:08.327 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:21:08.327 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 16 tests from 2 test suites. 2024-04-25T09:21:08.327 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-25T09:21:08.328 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.329 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-04-25T09:21:08.329 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-25T09:21:08.329 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:21:08.329 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-04-25T09:21:08.329 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:08.329 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-04-25T09:21:10.309 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-04-25T09:21:10.706 INFO:tasks.workunit.client.0.smithi053.stdout:notify 2024-04-25T09:21:10.723 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (414 ms) 2024-04-25T09:21:10.723 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-04-25T09:21:10.756 INFO:tasks.workunit.client.0.smithi053.stdout:notify 2024-04-25T09:21:10.769 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (46 ms) 2024-04-25T09:21:10.769 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-04-25T09:21:10.802 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (33 ms) 2024-04-25T09:21:10.802 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-04-25T09:21:10.833 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (31 ms) 2024-04-25T09:21:10.834 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-04-25T09:21:10.861 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28655120 notify_id 1705102016515 notifier_gid 15605 2024-04-25T09:21:10.875 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (42 ms) 2024-04-25T09:21:10.875 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-04-25T09:21:10.909 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28655120 notify_id 1705102016512 notifier_gid 15605 2024-04-25T09:21:10.923 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (48 ms) 2024-04-25T09:21:10.923 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-04-25T09:21:10.952 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28655120 notify_id 1705102016513 notifier_gid 15605 2024-04-25T09:21:10.966 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (43 ms) 2024-04-25T09:21:10.966 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-04-25T09:21:10.995 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28668576 notify_id 1705102016516 notifier_gid 15605 2024-04-25T09:21:11.008 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (42 ms) 2024-04-25T09:21:11.008 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-04-25T09:21:11.039 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28670256 notify_id 1705102016514 notifier_gid 15605 2024-04-25T09:21:11.054 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (45 ms) 2024-04-25T09:21:11.054 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-04-25T09:21:11.083 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28670256 notify_id 1705102016515 notifier_gid 15605 2024-04-25T09:21:11.098 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (44 ms) 2024-04-25T09:21:11.098 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-04-25T09:21:11.123 INFO:tasks.workunit.client.0.smithi053.stdout: trying... 2024-04-25T09:21:11.127 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28670256 notify_id 1705102016517 notifier_gid 15605 2024-04-25T09:21:12.127 INFO:tasks.workunit.client.0.smithi053.stdout: timed out 2024-04-25T09:21:12.138 INFO:tasks.workunit.client.0.smithi053.stdout: flushing 2024-04-25T09:21:14.127 INFO:tasks.workunit.client.0.smithi053.stdout: flushed 2024-04-25T09:21:14.128 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3029 ms) 2024-04-25T09:21:14.128 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-04-25T09:21:14.164 INFO:tasks.workunit.client.0.smithi053.stdout: trying... 2024-04-25T09:21:14.169 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28671472 notify_id 1705102016518 notifier_gid 15605 2024-04-25T09:21:15.167 INFO:tasks.workunit.client.0.smithi053.stdout: timed out 2024-04-25T09:21:15.181 INFO:tasks.workunit.client.0.smithi053.stdout: flushing 2024-04-25T09:21:17.170 INFO:tasks.workunit.client.0.smithi053.stdout: flushed 2024-04-25T09:21:17.170 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3042 ms) 2024-04-25T09:21:17.170 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-04-25T09:21:17.203 INFO:tasks.workunit.client.0.smithi053.stdout:List watches 2024-04-25T09:21:17.203 INFO:tasks.workunit.client.0.smithi053.stdout:notify2 2024-04-25T09:21:17.207 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28671472 notify_id 1705102016514 notifier_gid 15605 2024-04-25T09:21:20.214 INFO:tasks.workunit.client.0.smithi053.stdout:notify2 done 2024-04-25T09:21:20.214 INFO:tasks.workunit.client.0.smithi053.stdout:watch_check 2024-04-25T09:21:20.214 INFO:tasks.workunit.client.0.smithi053.stdout:unwatch2 2024-04-25T09:21:20.228 INFO:tasks.workunit.client.0.smithi053.stdout: flushing 2024-04-25T09:21:20.228 INFO:tasks.workunit.client.0.smithi053.stdout:done 2024-04-25T09:21:20.229 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3059 ms) 2024-04-25T09:21:20.229 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-04-25T09:21:20.259 INFO:tasks.workunit.client.0.smithi053.stdout:List watches 2024-04-25T09:21:20.260 INFO:tasks.workunit.client.0.smithi053.stdout:notify2 2024-04-25T09:21:20.264 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 28671472 notify_id 1709396983811 notifier_gid 15605 2024-04-25T09:21:23.271 INFO:tasks.workunit.client.0.smithi053.stdout:notify2 done 2024-04-25T09:21:23.271 INFO:tasks.workunit.client.0.smithi053.stdout:watch_check 2024-04-25T09:21:23.271 INFO:tasks.workunit.client.0.smithi053.stdout:unwatch2 2024-04-25T09:21:23.284 INFO:tasks.workunit.client.0.smithi053.stdout: flushing 2024-04-25T09:21:23.284 INFO:tasks.workunit.client.0.smithi053.stdout:done 2024-04-25T09:21:23.284 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3056 ms) 2024-04-25T09:21:24.007 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12975 ms total) 2024-04-25T09:21:24.007 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:24.007 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:21:24.007 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 16 tests from 2 test suites ran. (15680 ms total) 2024-04-25T09:21:24.007 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 14 tests. 2024-04-25T09:21:24.007 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 2 tests, listed below: 2024-04-25T09:21:24.007 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-25T09:21:24.007 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-25T09:21:24.009 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:21:24.009 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:21:24.009 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_cmd 2024-04-25T09:21:24.030 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:21:24.031 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-25T09:21:24.031 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:21:24.031 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosCmd 2024-04-25T09:21:24.031 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-04-25T09:21:24.070 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCmd.MonDescribe (39 ms) 2024-04-25T09:21:24.070 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-04-25T09:21:24.104 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCmd.OSDCmd (34 ms) 2024-04-25T09:21:24.104 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-04-25T09:21:27.017 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCmd.PGCmd (2913 ms) 2024-04-25T09:21:27.017 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-04-25T09:21:27.043 INFO:tasks.workunit.client.0.smithi053.stdout:got: 2024-04-25T09:21:26.023375+0000 mon.a [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T09:21:27.044 INFO:tasks.workunit.client.0.smithi053.stdout:got: 2024-04-25T09:21:26.027130+0000 mon.a [INF] from='client.? 172.21.15.53:0/694789283' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi053-93747-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-25T09:21:28.019 INFO:tasks.workunit.client.0.smithi053.stdout:got: 2024-04-25T09:21:27.058758+0000 client.admin [INF] onexx 2024-04-25T09:21:28.019 INFO:tasks.workunit.client.0.smithi053.stdout:got: 2024-04-25T09:21:27.058891+0000 mon.a [INF] from='client.? 172.21.15.53:0/3961921771' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-25T09:21:29.020 INFO:tasks.workunit.client.0.smithi053.stdout:got: 2024-04-25T09:21:28.033791+0000 mon.a [INF] from='client.? 172.21.15.53:0/3961921771' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-04-25T09:21:32.023 INFO:tasks.workunit.client.0.smithi053.stdout:got: 2024-04-25T09:21:30.037964+0000 mon.a [INF] from='client.? 172.21.15.53:0/3961921771' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-25T09:21:33.028 INFO:tasks.workunit.client.0.smithi053.stdout:got: 2024-04-25T09:21:32.038597+0000 client.admin [INF] threexx 2024-04-25T09:21:33.029 INFO:tasks.workunit.client.0.smithi053.stdout:got: 2024-04-25T09:21:32.039225+0000 mon.a [INF] from='client.? 172.21.15.53:0/3961921771' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-25T09:21:33.029 INFO:tasks.workunit.client.0.smithi053.stdout:got: 2024-04-25T09:21:33.004990+0000 mon.a [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-25T09:21:37.034 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCmd.WatchLog (10017 ms) 2024-04-25T09:21:37.035 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosCmd (13003 ms total) 2024-04-25T09:21:37.035 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:37.035 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:21:37.035 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 4 tests from 1 test suite ran. (13003 ms total) 2024-04-25T09:21:37.035 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 4 tests. 2024-04-25T09:21:37.036 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:21:37.036 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:21:37.036 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_cmd_pp 2024-04-25T09:21:37.058 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:21:37.058 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 3 tests from 1 test suite. 2024-04-25T09:21:37.058 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:21:37.058 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosCmd 2024-04-25T09:21:37.058 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-04-25T09:21:37.094 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCmd.MonDescribePP (36 ms) 2024-04-25T09:21:37.094 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-04-25T09:21:37.130 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCmd.OSDCmdPP (36 ms) 2024-04-25T09:21:37.130 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-04-25T09:21:38.997 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCmd.PGCmdPP (1867 ms) 2024-04-25T09:21:38.998 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from LibRadosCmd (1939 ms total) 2024-04-25T09:21:38.998 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:38.998 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:21:38.998 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 3 tests from 1 test suite ran. (1939 ms total) 2024-04-25T09:21:38.998 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 3 tests. 2024-04-25T09:21:38.999 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:21:38.999 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:21:39.000 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_service 2024-04-25T09:21:39.037 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:21:39.051+0000 7f4bd702b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:21:39.037 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:21:39.051+0000 7f4bd702b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:21:39.037 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:21:39.051+0000 7f4bd702b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:21:39.038 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-25T09:21:39.038 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:21:39.038 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosService 2024-04-25T09:21:39.038 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-04-25T09:21:44.074 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosService.RegisterEarly (5037 ms) 2024-04-25T09:21:44.075 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosService.RegisterLate 2024-04-25T09:21:44.104 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosService.RegisterLate (30 ms) 2024-04-25T09:21:44.104 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosService.StatusFormat 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: cluster: 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: id: 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: health: HEALTH_WARN 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: 1 pool(s) do not have an application enabled 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: services: 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: mon: 1 daemons, quorum a (age 9m) 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: mgr: x(active, since 9m) 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 9m) 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: laundry: 1 daemon active (1 hosts) 2024-04-25T09:21:44.265 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:44.266 INFO:tasks.workunit.client.0.smithi053.stdout: data: 2024-04-25T09:21:44.266 INFO:tasks.workunit.client.0.smithi053.stdout: pools: 3 pools, 41 pgs 2024-04-25T09:21:44.266 INFO:tasks.workunit.client.0.smithi053.stdout: objects: 3 objects, 577 KiB 2024-04-25T09:21:44.266 INFO:tasks.workunit.client.0.smithi053.stdout: usage: 168 MiB used, 400 GiB / 400 GiB avail 2024-04-25T09:21:44.266 INFO:tasks.workunit.client.0.smithi053.stdout: pgs: 41 active+clean 2024-04-25T09:21:44.266 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:44.266 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:46.295 INFO:tasks.workunit.client.0.smithi053.stdout: cluster: 2024-04-25T09:21:46.295 INFO:tasks.workunit.client.0.smithi053.stdout: id: 12417946-fe70-462a-890a-9259fe1aeb83 2024-04-25T09:21:46.295 INFO:tasks.workunit.client.0.smithi053.stdout: health: HEALTH_WARN 2024-04-25T09:21:46.295 INFO:tasks.workunit.client.0.smithi053.stdout: 1 pool(s) do not have an application enabled 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: services: 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: mon: 1 daemons, quorum a (age 9m) 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: mgr: x(active, since 9m) 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: osd: 4 osds: 4 up (since 9m), 4 in (since 9m) 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: data: 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: pools: 3 pools, 41 pgs 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: objects: 3 objects, 577 KiB 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: usage: 172 MiB used, 400 GiB / 400 GiB avail 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: pgs: 41 active+clean 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:46.296 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:21:46.321 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosService.StatusFormat (2217 ms) 2024-04-25T09:21:46.321 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosService.Status 2024-04-25T09:22:06.352 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosService.Status (20031 ms) 2024-04-25T09:22:06.353 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosService (27316 ms total) 2024-04-25T09:22:06.353 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:22:06.353 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:22:06.353 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 4 tests from 1 test suite ran. (27316 ms total) 2024-04-25T09:22:06.353 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 4 tests. 2024-04-25T09:22:06.358 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:22:06.358 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:22:06.358 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_service_pp 2024-04-25T09:22:06.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:22:06.407+0000 7fcf8ab19840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:22:06.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:22:06.408+0000 7fcf8ab19840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:22:06.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:22:06.408+0000 7fcf8ab19840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:22:06.395 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-25T09:22:06.395 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:22:06.395 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosServicePP 2024-04-25T09:22:06.395 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-04-25T09:22:11.424 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5029 ms) 2024-04-25T09:22:11.424 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-04-25T09:22:11.472 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosServicePP.RegisterLate (48 ms) 2024-04-25T09:22:11.472 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosServicePP.Status 2024-04-25T09:22:31.507 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosServicePP.Status (20035 ms) 2024-04-25T09:22:31.508 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosServicePP.Close 2024-04-25T09:22:31.508 INFO:tasks.workunit.client.0.smithi053.stdout:attempt 0 of 20 2024-04-25T09:22:36.568 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosServicePP.Close (5061 ms) 2024-04-25T09:22:36.568 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 4 tests from LibRadosServicePP (30173 ms total) 2024-04-25T09:22:36.568 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:22:36.568 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:22:36.568 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 4 tests from 1 test suite ran. (30173 ms total) 2024-04-25T09:22:36.568 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 4 tests. 2024-04-25T09:22:36.570 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:22:36.570 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:22:36.570 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_c_write_operations 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 8 tests from 2 test suites. 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibradosCWriteOps 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-04-25T09:22:36.592 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-04-25T09:22:39.329 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCWriteOps.assertExists (2737 ms) 2024-04-25T09:22:39.330 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-04-25T09:22:42.341 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3012 ms) 2024-04-25T09:22:42.341 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-04-25T09:22:45.354 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3013 ms) 2024-04-25T09:22:45.354 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-04-25T09:22:48.366 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCWriteOps.Write (3012 ms) 2024-04-25T09:22:48.366 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-04-25T09:22:51.380 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCWriteOps.Exec (3014 ms) 2024-04-25T09:22:51.380 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-04-25T09:22:54.019 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCWriteOps.WriteSame (2639 ms) 2024-04-25T09:22:54.019 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-04-25T09:23:04.331 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] LibRadosCWriteOps.CmpExt (10312 ms) 2024-04-25T09:23:04.331 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 7 tests from LibRadosCWriteOps (27739 ms total) 2024-04-25T09:23:04.331 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:23:04.331 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:23:04.331 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 8 tests from 2 test suites ran. (27739 ms total) 2024-04-25T09:23:04.331 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 8 tests. 2024-04-25T09:23:04.333 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:23:04.333 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:23:04.333 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_c_read_operations 2024-04-25T09:23:04.354 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:23:04.354 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 17 tests from 1 test suite. 2024-04-25T09:23:04.354 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:23:04.355 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 17 tests from CReadOpsTest 2024-04-25T09:23:06.338 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-04-25T09:23:06.338 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-04-25T09:23:06.339 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-04-25T09:23:06.767 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.SetOpFlags (430 ms) 2024-04-25T09:23:06.768 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-04-25T09:23:06.799 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.AssertExists (31 ms) 2024-04-25T09:23:06.799 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-04-25T09:23:06.848 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.AssertVersion (49 ms) 2024-04-25T09:23:06.848 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-04-25T09:23:07.028 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.CmpXattr (180 ms) 2024-04-25T09:23:07.028 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.Read 2024-04-25T09:23:07.076 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.Read (49 ms) 2024-04-25T09:23:07.077 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.Checksum 2024-04-25T09:23:07.115 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.Checksum (38 ms) 2024-04-25T09:23:07.115 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-04-25T09:23:07.140 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.RWOrderedRead (25 ms) 2024-04-25T09:23:07.140 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-04-25T09:23:07.179 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.ShortRead (38 ms) 2024-04-25T09:23:07.179 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.Exec 2024-04-25T09:23:07.208 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.Exec (30 ms) 2024-04-25T09:23:07.208 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-04-25T09:23:07.244 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.ExecUserBuf (35 ms) 2024-04-25T09:23:07.244 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.Stat 2024-04-25T09:23:07.280 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.Stat (36 ms) 2024-04-25T09:23:07.280 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.Stat2 2024-04-25T09:23:07.315 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.Stat2 (36 ms) 2024-04-25T09:23:07.316 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.Omap 2024-04-25T09:23:07.415 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.Omap (99 ms) 2024-04-25T09:23:07.415 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-04-25T09:23:07.505 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.OmapNuls (90 ms) 2024-04-25T09:23:07.505 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-04-25T09:23:07.680 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.GetXattrs (175 ms) 2024-04-25T09:23:07.680 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-04-25T09:23:07.726 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] CReadOpsTest.CmpExt (46 ms) 2024-04-25T09:23:08.346 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 17 tests from CReadOpsTest (1388 ms total) 2024-04-25T09:23:08.346 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:23:08.346 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:23:08.346 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 17 tests from 1 test suite ran. (3992 ms total) 2024-04-25T09:23:08.346 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 17 tests. 2024-04-25T09:23:08.348 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:23:08.348 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:23:08.348 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_api_cls_remote_reads 2024-04-25T09:23:08.386 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:23:08.400+0000 7f71c026e6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:23:08.387 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:23:08.401+0000 7f71c026e6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:23:08.387 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:23:08.401+0000 7f71c026e6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:23:08.387 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 1 test from 1 test suite. 2024-04-25T09:23:08.387 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:23:08.387 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from ClsTestRemoteReads 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] ClsTestRemoteReads.TestGather 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3194-ga126334d/rpm/el9/BUILD/ceph-19.0.0-3194-ga126334d/src/test/librados/cls_remote_reads.cc:13: Skipped 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:Not supported by crimson yet. Skipped 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] ClsTestRemoteReads.TestGather (0 ms) 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from ClsTestRemoteReads (0 ms total) 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 1 test from 1 test suite ran. (0 ms total) 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 0 tests. 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] 1 test, listed below: 2024-04-25T09:23:08.388 INFO:tasks.workunit.client.0.smithi053.stdout:[ SKIPPED ] ClsTestRemoteReads.TestGather 2024-04-25T09:23:08.389 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:23:08.389 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:23:08.389 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_list_parallel 2024-04-25T09:23:11.275 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94430]: starting. 2024-04-25T09:23:11.275 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94430]: creating pool ceph_test_rados_list_parallel.smithi053-94429 2024-04-25T09:23:11.275 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94430]: created object 0... 2024-04-25T09:23:11.275 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94430]: created object 25... 2024-04-25T09:23:11.275 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94430]: created object 49... 2024-04-25T09:23:11.275 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94430]: finishing. 2024-04-25T09:23:11.275 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94430]: shutting down. 2024-04-25T09:23:11.473 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94431]: starting. 2024-04-25T09:23:11.473 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94431]: listing objects. 2024-04-25T09:23:11.473 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94431]: listed object 0... 2024-04-25T09:23:11.473 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94431]: listed object 25... 2024-04-25T09:23:11.473 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94431]: saw 50 objects 2024-04-25T09:23:11.473 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94431]: shutting down. 2024-04-25T09:23:12.194 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:12.194 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94466]: starting. 2024-04-25T09:23:12.194 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94466]: creating pool ceph_test_rados_list_parallel.smithi053-94429 2024-04-25T09:23:12.194 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94466]: created object 0... 2024-04-25T09:23:12.194 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94466]: created object 25... 2024-04-25T09:23:12.194 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94466]: created object 49... 2024-04-25T09:23:12.195 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94466]: finishing. 2024-04-25T09:23:12.195 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94466]: shutting down. 2024-04-25T09:23:12.466 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:12.466 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94467]: starting. 2024-04-25T09:23:12.466 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94467]: listing objects. 2024-04-25T09:23:12.466 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94467]: listed object 0... 2024-04-25T09:23:12.466 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94467]: listed object 25... 2024-04-25T09:23:12.466 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94467]: saw 44 objects 2024-04-25T09:23:12.466 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94467]: shutting down. 2024-04-25T09:23:12.712 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:12.713 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94468]: starting. 2024-04-25T09:23:12.713 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94468]: removed 25 objects... 2024-04-25T09:23:12.713 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94468]: removed half of the objects 2024-04-25T09:23:12.713 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94468]: removed 50 objects... 2024-04-25T09:23:12.713 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94468]: removed 50 objects 2024-04-25T09:23:12.713 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94468]: shutting down. 2024-04-25T09:23:13.276 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:13.276 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:13.276 INFO:tasks.workunit.client.0.smithi053.stdout:process_6_[94517]: starting. 2024-04-25T09:23:13.277 INFO:tasks.workunit.client.0.smithi053.stdout:process_6_[94517]: creating pool ceph_test_rados_list_parallel.smithi053-94429 2024-04-25T09:23:13.277 INFO:tasks.workunit.client.0.smithi053.stdout:process_6_[94517]: created object 0... 2024-04-25T09:23:13.277 INFO:tasks.workunit.client.0.smithi053.stdout:process_6_[94517]: created object 25... 2024-04-25T09:23:13.277 INFO:tasks.workunit.client.0.smithi053.stdout:process_6_[94517]: created object 49... 2024-04-25T09:23:13.277 INFO:tasks.workunit.client.0.smithi053.stdout:process_6_[94517]: finishing. 2024-04-25T09:23:13.277 INFO:tasks.workunit.client.0.smithi053.stdout:process_6_[94517]: shutting down. 2024-04-25T09:23:13.570 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:13.570 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:13.571 INFO:tasks.workunit.client.0.smithi053.stdout:process_7_[94518]: starting. 2024-04-25T09:23:13.571 INFO:tasks.workunit.client.0.smithi053.stdout:process_7_[94518]: listing objects. 2024-04-25T09:23:13.571 INFO:tasks.workunit.client.0.smithi053.stdout:process_7_[94518]: listed object 0... 2024-04-25T09:23:13.571 INFO:tasks.workunit.client.0.smithi053.stdout:process_7_[94518]: listed object 25... 2024-04-25T09:23:13.571 INFO:tasks.workunit.client.0.smithi053.stdout:process_7_[94518]: listed object 50... 2024-04-25T09:23:13.571 INFO:tasks.workunit.client.0.smithi053.stdout:process_7_[94518]: saw 56 objects 2024-04-25T09:23:13.571 INFO:tasks.workunit.client.0.smithi053.stdout:process_7_[94518]: shutting down. 2024-04-25T09:23:13.841 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:13.841 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:13.841 INFO:tasks.workunit.client.0.smithi053.stdout:process_8_[94519]: starting. 2024-04-25T09:23:13.841 INFO:tasks.workunit.client.0.smithi053.stdout:process_8_[94519]: added 25 objects... 2024-04-25T09:23:13.841 INFO:tasks.workunit.client.0.smithi053.stdout:process_8_[94519]: added half of the objects 2024-04-25T09:23:13.841 INFO:tasks.workunit.client.0.smithi053.stdout:process_8_[94519]: added 50 objects... 2024-04-25T09:23:13.841 INFO:tasks.workunit.client.0.smithi053.stdout:process_8_[94519]: added 50 objects 2024-04-25T09:23:13.841 INFO:tasks.workunit.client.0.smithi053.stdout:process_8_[94519]: shutting down. 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:process_9_[94568]: starting. 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:process_9_[94568]: creating pool ceph_test_rados_list_parallel.smithi053-94429 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:process_9_[94568]: created object 0... 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:process_9_[94568]: created object 25... 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:process_9_[94568]: created object 49... 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:process_9_[94568]: finishing. 2024-04-25T09:23:14.451 INFO:tasks.workunit.client.0.smithi053.stdout:process_9_[94568]: shutting down. 2024-04-25T09:23:14.791 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:14.791 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:14.791 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:14.791 INFO:tasks.workunit.client.0.smithi053.stdout:process_10_[94569]: starting. 2024-04-25T09:23:14.791 INFO:tasks.workunit.client.0.smithi053.stdout:process_10_[94569]: listing objects. 2024-04-25T09:23:14.792 INFO:tasks.workunit.client.0.smithi053.stdout:process_10_[94569]: listed object 0... 2024-04-25T09:23:14.792 INFO:tasks.workunit.client.0.smithi053.stdout:process_10_[94569]: listed object 25... 2024-04-25T09:23:14.792 INFO:tasks.workunit.client.0.smithi053.stdout:process_10_[94569]: listed object 50... 2024-04-25T09:23:14.792 INFO:tasks.workunit.client.0.smithi053.stdout:process_10_[94569]: listed object 75... 2024-04-25T09:23:14.792 INFO:tasks.workunit.client.0.smithi053.stdout:process_10_[94569]: saw 97 objects 2024-04-25T09:23:14.792 INFO:tasks.workunit.client.0.smithi053.stdout:process_10_[94569]: shutting down. 2024-04-25T09:23:15.089 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.090 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.090 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.090 INFO:tasks.workunit.client.0.smithi053.stdout:process_13_[94572]: starting. 2024-04-25T09:23:15.090 INFO:tasks.workunit.client.0.smithi053.stdout:process_13_[94572]: removed 25 objects... 2024-04-25T09:23:15.090 INFO:tasks.workunit.client.0.smithi053.stdout:process_13_[94572]: removed half of the objects 2024-04-25T09:23:15.090 INFO:tasks.workunit.client.0.smithi053.stdout:process_13_[94572]: removed 50 objects... 2024-04-25T09:23:15.090 INFO:tasks.workunit.client.0.smithi053.stdout:process_13_[94572]: removed 50 objects 2024-04-25T09:23:15.090 INFO:tasks.workunit.client.0.smithi053.stdout:process_13_[94572]: shutting down. 2024-04-25T09:23:15.130 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.131 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.131 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.131 INFO:tasks.workunit.client.0.smithi053.stdout:process_11_[94570]: starting. 2024-04-25T09:23:15.131 INFO:tasks.workunit.client.0.smithi053.stdout:process_11_[94570]: added 25 objects... 2024-04-25T09:23:15.131 INFO:tasks.workunit.client.0.smithi053.stdout:process_11_[94570]: added half of the objects 2024-04-25T09:23:15.131 INFO:tasks.workunit.client.0.smithi053.stdout:process_11_[94570]: added 50 objects... 2024-04-25T09:23:15.131 INFO:tasks.workunit.client.0.smithi053.stdout:process_11_[94570]: added 50 objects 2024-04-25T09:23:15.131 INFO:tasks.workunit.client.0.smithi053.stdout:process_11_[94570]: shutting down. 2024-04-25T09:23:15.164 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.164 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.164 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.164 INFO:tasks.workunit.client.0.smithi053.stdout:process_12_[94571]: starting. 2024-04-25T09:23:15.164 INFO:tasks.workunit.client.0.smithi053.stdout:process_12_[94571]: added 25 objects... 2024-04-25T09:23:15.164 INFO:tasks.workunit.client.0.smithi053.stdout:process_12_[94571]: added half of the objects 2024-04-25T09:23:15.165 INFO:tasks.workunit.client.0.smithi053.stdout:process_12_[94571]: added 50 objects... 2024-04-25T09:23:15.165 INFO:tasks.workunit.client.0.smithi053.stdout:process_12_[94571]: added 50 objects 2024-04-25T09:23:15.165 INFO:tasks.workunit.client.0.smithi053.stdout:process_12_[94571]: shutting down. 2024-04-25T09:23:15.754 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:process_14_[94653]: starting. 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:process_14_[94653]: creating pool ceph_test_rados_list_parallel.smithi053-94429 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:process_14_[94653]: created object 0... 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:process_14_[94653]: created object 25... 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:process_14_[94653]: created object 49... 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:process_14_[94653]: finishing. 2024-04-25T09:23:15.755 INFO:tasks.workunit.client.0.smithi053.stdout:process_14_[94653]: shutting down. 2024-04-25T09:23:16.041 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:16.041 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:16.041 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:16.042 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:16.042 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: starting. 2024-04-25T09:23:16.042 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: listing objects. 2024-04-25T09:23:16.042 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: listed object 0... 2024-04-25T09:23:16.042 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: listed object 25... 2024-04-25T09:23:16.042 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: listed object 50... 2024-04-25T09:23:16.042 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: listed object 75... 2024-04-25T09:23:16.043 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: listed object 100... 2024-04-25T09:23:16.043 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: listed object 125... 2024-04-25T09:23:16.043 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: saw 150 objects 2024-04-25T09:23:16.043 INFO:tasks.workunit.client.0.smithi053.stdout:process_15_[94654]: shutting down. 2024-04-25T09:23:16.296 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:16.297 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:16.297 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:16.297 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:16.297 INFO:tasks.workunit.client.0.smithi053.stdout:process_16_[94655]: starting. 2024-04-25T09:23:16.297 INFO:tasks.workunit.client.0.smithi053.stdout:process_16_[94655]: added 25 objects... 2024-04-25T09:23:16.297 INFO:tasks.workunit.client.0.smithi053.stdout:process_16_[94655]: added half of the objects 2024-04-25T09:23:16.297 INFO:tasks.workunit.client.0.smithi053.stdout:process_16_[94655]: added 50 objects... 2024-04-25T09:23:16.297 INFO:tasks.workunit.client.0.smithi053.stdout:process_16_[94655]: added 50 objects 2024-04-25T09:23:16.297 INFO:tasks.workunit.client.0.smithi053.stdout:process_16_[94655]: shutting down. 2024-04-25T09:23:17.021 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:17.021 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:17.021 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:17.021 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:17.021 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:17.021 INFO:tasks.workunit.client.0.smithi053.stdout:******* SUCCESS ********** 2024-04-25T09:23:17.022 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:23:17.022 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:23:17.022 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_open_pools_parallel 2024-04-25T09:23:19.959 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94721]: starting. 2024-04-25T09:23:19.959 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94721]: creating pool ceph_test_rados_open_pools_parallel.smithi053-94720 2024-04-25T09:23:19.959 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94721]: created object 0... 2024-04-25T09:23:19.959 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94721]: created object 25... 2024-04-25T09:23:19.959 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94721]: created object 49... 2024-04-25T09:23:19.959 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94721]: finishing. 2024-04-25T09:23:19.960 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94721]: shutting down. 2024-04-25T09:23:20.035 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94722]: starting. 2024-04-25T09:23:20.036 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94722]: rados_pool_create. 2024-04-25T09:23:20.036 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94722]: rados_ioctx_create. 2024-04-25T09:23:20.036 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94722]: shutting down. 2024-04-25T09:23:22.951 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:22.951 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94757]: starting. 2024-04-25T09:23:22.951 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94757]: creating pool ceph_test_rados_open_pools_parallel.smithi053-94720 2024-04-25T09:23:22.951 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94757]: created object 0... 2024-04-25T09:23:22.951 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94757]: created object 25... 2024-04-25T09:23:22.952 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94757]: created object 49... 2024-04-25T09:23:22.952 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94757]: finishing. 2024-04-25T09:23:22.952 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94757]: shutting down. 2024-04-25T09:23:23.045 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:23.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94758]: starting. 2024-04-25T09:23:23.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94758]: rados_pool_create. 2024-04-25T09:23:23.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94758]: rados_ioctx_create. 2024-04-25T09:23:23.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94758]: shutting down. 2024-04-25T09:23:23.047 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:23.048 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:23.048 INFO:tasks.workunit.client.0.smithi053.stdout:******* SUCCESS ********** 2024-04-25T09:23:23.049 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-25T09:23:23.049 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:23:23.050 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_rados_delete_pools_parallel 2024-04-25T09:23:25.980 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94794]: starting. 2024-04-25T09:23:25.980 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94794]: creating pool ceph_test_rados_delete_pools_parallel.smithi053-94793 2024-04-25T09:23:25.980 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94794]: created object 0... 2024-04-25T09:23:25.980 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94794]: created object 25... 2024-04-25T09:23:25.980 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94794]: created object 49... 2024-04-25T09:23:25.981 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94794]: finishing. 2024-04-25T09:23:25.981 INFO:tasks.workunit.client.0.smithi053.stdout:process_1_[94794]: shutting down. 2024-04-25T09:23:26.059 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94795]: starting. 2024-04-25T09:23:26.059 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94795]: deleting pool ceph_test_rados_delete_pools_parallel.smithi053-94793 2024-04-25T09:23:26.059 INFO:tasks.workunit.client.0.smithi053.stdout:process_2_[94795]: shutting down. 2024-04-25T09:23:28.927 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:28.927 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94830]: starting. 2024-04-25T09:23:28.927 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94830]: creating pool ceph_test_rados_delete_pools_parallel.smithi053-94793 2024-04-25T09:23:28.927 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94830]: created object 0... 2024-04-25T09:23:28.927 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94830]: created object 25... 2024-04-25T09:23:28.927 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94830]: created object 49... 2024-04-25T09:23:28.927 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94830]: finishing. 2024-04-25T09:23:28.927 INFO:tasks.workunit.client.0.smithi053.stdout:process_3_[94830]: shutting down. 2024-04-25T09:23:29.045 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:29.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94832]: starting. 2024-04-25T09:23:29.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94832]: listing objects. 2024-04-25T09:23:29.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94832]: listed object 0... 2024-04-25T09:23:29.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94832]: listed object 25... 2024-04-25T09:23:29.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94832]: saw 50 objects 2024-04-25T09:23:29.046 INFO:tasks.workunit.client.0.smithi053.stdout:process_5_[94832]: shutting down. 2024-04-25T09:23:29.069 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:29.069 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94831]: starting. 2024-04-25T09:23:29.069 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94831]: deleting pool ceph_test_rados_delete_pools_parallel.smithi053-94793 2024-04-25T09:23:29.069 INFO:tasks.workunit.client.0.smithi053.stdout:process_4_[94831]: shutting down. 2024-04-25T09:23:29.070 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:29.070 INFO:tasks.workunit.client.0.smithi053.stdout:******************************* 2024-04-25T09:23:29.070 INFO:tasks.workunit.client.0.smithi053.stdout:******* SUCCESS ********** 2024-04-25T09:23:29.071 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:23:29.072 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:23:29.072 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:23:29.072 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' cls = ec_io ']' 2024-04-25T09:23:29.072 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' cls = ec_list ']' 2024-04-25T09:23:29.072 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_cls 2024-04-25T09:23:29.091 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:23:29.091 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 2 tests from 1 test suite. 2024-04-25T09:23:29.091 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:23:29.091 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from NeoRadosCls 2024-04-25T09:23:29.091 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosCls.DNE 2024-04-25T09:23:32.080 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosCls.DNE (2989 ms) 2024-04-25T09:23:32.080 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosCls.RemoteReads 2024-04-25T09:23:33.083 INFO:tasks.workunit.client.0.smithi053.stderr:Not supported by crimson yet. Skipped 2024-04-25T09:23:34.089 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosCls.RemoteReads (2009 ms) 2024-04-25T09:23:34.089 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from NeoRadosCls (4998 ms total) 2024-04-25T09:23:34.089 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:23:34.089 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:23:34.089 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 2 tests from 1 test suite ran. (4998 ms total) 2024-04-25T09:23:34.089 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 2 tests. 2024-04-25T09:23:34.092 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:23:34.092 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:23:34.092 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:23:34.092 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' cmd = ec_io ']' 2024-04-25T09:23:34.092 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' cmd = ec_list ']' 2024-04-25T09:23:34.093 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_cmd 2024-04-25T09:23:34.119 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:23:34.119 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 3 tests from 1 test suite. 2024-04-25T09:23:34.119 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:23:34.119 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from NeoRadosCmd 2024-04-25T09:23:34.119 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-04-25T09:23:36.097 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosCmd.MonDescribe (1978 ms) 2024-04-25T09:23:36.097 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-04-25T09:23:38.106 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosCmd.OSDCmd (2009 ms) 2024-04-25T09:23:38.107 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-04-25T09:23:41.119 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosCmd.PGCmd (3011 ms) 2024-04-25T09:23:41.119 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from NeoRadosCmd (6998 ms total) 2024-04-25T09:23:41.119 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:23:41.119 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:23:41.119 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 3 tests from 1 test suite ran. (6998 ms total) 2024-04-25T09:23:41.119 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 3 tests. 2024-04-25T09:23:41.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:23:41.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:23:41.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:23:41.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' handler_error = ec_io ']' 2024-04-25T09:23:41.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' handler_error = ec_list ']' 2024-04-25T09:23:41.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_handler_error 2024-04-25T09:23:41.138 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:23:41.138 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 1 test from 1 test suite. 2024-04-25T09:23:41.138 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:23:41.138 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from neocls_handler_error 2024-04-25T09:23:41.138 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-04-25T09:23:44.131 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] neocls_handler_error.test_handler_error (2993 ms) 2024-04-25T09:23:44.131 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 1 test from neocls_handler_error (2993 ms total) 2024-04-25T09:23:44.131 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:23:44.131 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:23:44.131 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 1 test from 1 test suite ran. (2993 ms total) 2024-04-25T09:23:44.132 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 1 test. 2024-04-25T09:23:44.133 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:23:44.133 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:23:44.133 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:23:44.133 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' io = ec_io ']' 2024-04-25T09:23:44.133 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' io = ec_list ']' 2024-04-25T09:23:44.133 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_io 2024-04-25T09:23:44.154 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:23:44.154 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 14 tests from 1 test suite. 2024-04-25T09:23:44.154 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:23:44.155 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 14 tests from NeoRadosIo 2024-04-25T09:23:44.155 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.Limits 2024-04-25T09:23:45.135 INFO:tasks.workunit.client.0.smithi053.stderr:Not supported by crimson yet. Skipped 2024-04-25T09:23:46.141 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.Limits (1986 ms) 2024-04-25T09:23:46.141 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-04-25T09:23:49.151 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.SimpleWrite (3010 ms) 2024-04-25T09:23:49.151 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-04-25T09:23:52.167 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.ReadOp (3016 ms) 2024-04-25T09:23:52.167 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-04-25T09:23:55.176 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.SparseRead (3010 ms) 2024-04-25T09:23:55.176 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-04-25T09:23:58.189 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.RoundTrip (3013 ms) 2024-04-25T09:23:58.189 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-04-25T09:24:01.202 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3012 ms) 2024-04-25T09:24:01.202 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-04-25T09:24:04.212 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3011 ms) 2024-04-25T09:24:04.213 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-04-25T09:24:07.226 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3014 ms) 2024-04-25T09:24:07.227 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-04-25T09:24:10.240 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3013 ms) 2024-04-25T09:24:10.240 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.Trunc 2024-04-25T09:24:13.033 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.Trunc (2793 ms) 2024-04-25T09:24:13.033 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.Remove 2024-04-25T09:24:16.044 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.Remove (3011 ms) 2024-04-25T09:24:16.044 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-04-25T09:24:19.056 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3012 ms) 2024-04-25T09:24:19.056 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-04-25T09:24:22.069 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.RmXattr (3013 ms) 2024-04-25T09:24:22.070 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-04-25T09:24:25.074 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosIo.GetXattrs (3005 ms) 2024-04-25T09:24:25.075 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 14 tests from NeoRadosIo (40920 ms total) 2024-04-25T09:24:25.075 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:24:25.075 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:24:25.075 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 14 tests from 1 test suite ran. (40920 ms total) 2024-04-25T09:24:25.075 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 14 tests. 2024-04-25T09:24:25.079 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:24:25.079 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:24:25.079 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:24:25.079 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' ec_io = ec_io ']' 2024-04-25T09:24:25.079 INFO:tasks.workunit.client.0.smithi053.stdout:Skipping EC with Crimson 2024-04-25T09:24:25.080 INFO:tasks.workunit.client.0.smithi053.stderr:+ echo 'Skipping EC with Crimson' 2024-04-25T09:24:25.080 INFO:tasks.workunit.client.0.smithi053.stderr:+ continue 2024-04-25T09:24:25.080 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:24:25.080 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:24:25.080 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:24:25.080 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' list = ec_io ']' 2024-04-25T09:24:25.080 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' list = ec_list ']' 2024-04-25T09:24:25.080 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_list 2024-04-25T09:24:25.103 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:24:25.104 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 3 tests from 1 test suite. 2024-04-25T09:24:25.104 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:24:25.104 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from NeoradosList 2024-04-25T09:24:25.104 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoradosList.ListObjects 2024-04-25T09:24:28.088 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoradosList.ListObjects (2985 ms) 2024-04-25T09:24:28.089 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-04-25T09:24:31.100 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoradosList.ListObjectsNS (3011 ms) 2024-04-25T09:24:31.100 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-04-25T09:24:40.348 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoradosList.ListObjectsMany (9248 ms) 2024-04-25T09:24:40.348 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 3 tests from NeoradosList (15244 ms total) 2024-04-25T09:24:40.348 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:24:40.348 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:24:40.348 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 3 tests from 1 test suite ran. (15244 ms total) 2024-04-25T09:24:40.349 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 3 tests. 2024-04-25T09:24:40.351 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:24:40.351 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:24:40.351 INFO:tasks.workunit.client.0.smithi053.stdout:Skipping EC with Crimson 2024-04-25T09:24:40.351 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:24:40.351 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' ec_list = ec_io ']' 2024-04-25T09:24:40.352 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' ec_list = ec_list ']' 2024-04-25T09:24:40.352 INFO:tasks.workunit.client.0.smithi053.stderr:+ echo 'Skipping EC with Crimson' 2024-04-25T09:24:40.352 INFO:tasks.workunit.client.0.smithi053.stderr:+ continue 2024-04-25T09:24:40.352 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:24:40.352 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:24:40.352 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:24:40.352 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' misc = ec_io ']' 2024-04-25T09:24:40.352 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' misc = ec_list ']' 2024-04-25T09:24:40.352 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_misc 2024-04-25T09:24:40.373 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:24:40.373 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 12 tests from 1 test suite. 2024-04-25T09:24:40.373 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:24:40.373 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 12 tests from NeoRadosMisc 2024-04-25T09:24:40.373 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.Version 2024-04-25T09:24:42.358 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.Version (1985 ms) 2024-04-25T09:24:42.358 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-04-25T09:24:44.047 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (1689 ms) 2024-04-25T09:24:44.047 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.LongName 2024-04-25T09:24:47.056 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.LongName (3010 ms) 2024-04-25T09:24:47.056 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-04-25T09:24:48.061 INFO:tasks.workunit.client.0.smithi053.stderr:Not supported by crimson yet. Skipped 2024-04-25T09:24:49.067 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.LongLocator (2010 ms) 2024-04-25T09:24:49.067 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-04-25T09:24:52.079 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.LongNamespace (3013 ms) 2024-04-25T09:24:52.080 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-04-25T09:24:55.088 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.LongAttrName (3008 ms) 2024-04-25T09:24:55.088 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.Exec 2024-04-25T09:24:58.101 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.Exec (3013 ms) 2024-04-25T09:24:58.101 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-04-25T09:25:01.113 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.Operate1 (3012 ms) 2024-04-25T09:25:01.113 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-04-25T09:25:04.122 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.Operate2 (3009 ms) 2024-04-25T09:25:04.122 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-04-25T09:25:07.132 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.BigObject (3011 ms) 2024-04-25T09:25:07.133 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-04-25T09:25:09.144 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.BigAttr (2011 ms) 2024-04-25T09:25:09.144 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-04-25T09:25:10.148 INFO:tasks.workunit.client.0.smithi053.stderr:Not supported by crimson yet. Skipped 2024-04-25T09:25:11.153 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosMisc.WriteSame (2009 ms) 2024-04-25T09:25:11.153 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 12 tests from NeoRadosMisc (30780 ms total) 2024-04-25T09:25:11.153 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:25:11.153 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:25:11.153 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 12 tests from 1 test suite ran. (30780 ms total) 2024-04-25T09:25:11.153 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 12 tests. 2024-04-25T09:25:11.156 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:25:11.156 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:25:11.156 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:25:11.156 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' pool = ec_io ']' 2024-04-25T09:25:11.156 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' pool = ec_list ']' 2024-04-25T09:25:11.156 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_pool 2024-04-25T09:25:11.183 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:25:11.183 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 6 tests from 1 test suite. 2024-04-25T09:25:11.183 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:25:11.183 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 6 tests from NeoRadosPools 2024-04-25T09:25:11.183 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosPools.PoolList 2024-04-25T09:25:13.047 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosPools.PoolList (1864 ms) 2024-04-25T09:25:13.048 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-04-25T09:25:15.057 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosPools.PoolLookup (2009 ms) 2024-04-25T09:25:15.057 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-04-25T09:25:17.065 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2008 ms) 2024-04-25T09:25:17.065 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-04-25T09:25:21.079 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosPools.PoolDelete (4015 ms) 2024-04-25T09:25:21.080 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-04-25T09:25:23.051 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (1971 ms) 2024-04-25T09:25:23.051 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-04-25T09:25:25.101 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2051 ms) 2024-04-25T09:25:25.102 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 6 tests from NeoRadosPools (13918 ms total) 2024-04-25T09:25:25.102 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:25:25.102 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:25:25.102 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 6 tests from 1 test suite ran. (13918 ms total) 2024-04-25T09:25:25.102 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 6 tests. 2024-04-25T09:25:25.104 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:25:25.104 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:25:25.104 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:25:25.104 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' read_operations = ec_io ']' 2024-04-25T09:25:25.105 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' read_operations = ec_list ']' 2024-04-25T09:25:25.105 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_read_operations 2024-04-25T09:25:25.131 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:25:25.131 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 14 tests from 1 test suite. 2024-04-25T09:25:25.131 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:25:25.131 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 14 tests from NeoRadosReadOps 2024-04-25T09:25:25.131 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-04-25T09:25:28.112 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2982 ms) 2024-04-25T09:25:28.113 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-04-25T09:25:31.126 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.AssertExists (3013 ms) 2024-04-25T09:25:31.126 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-04-25T09:25:34.134 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3008 ms) 2024-04-25T09:25:34.134 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-04-25T09:25:37.146 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3013 ms) 2024-04-25T09:25:37.147 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.Read 2024-04-25T09:25:40.157 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.Read (3011 ms) 2024-04-25T09:25:40.158 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-04-25T09:25:43.058 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.Checksum (2901 ms) 2024-04-25T09:25:43.058 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-04-25T09:25:46.171 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3112 ms) 2024-04-25T09:25:46.171 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-04-25T09:25:49.183 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.ShortRead (3012 ms) 2024-04-25T09:25:49.183 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-04-25T09:25:52.197 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.Exec (3015 ms) 2024-04-25T09:25:52.198 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-04-25T09:25:55.205 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.Stat (3008 ms) 2024-04-25T09:25:55.205 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-04-25T09:25:58.217 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.Omap (3012 ms) 2024-04-25T09:25:58.218 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-04-25T09:26:01.231 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3013 ms) 2024-04-25T09:26:01.231 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-04-25T09:26:04.237 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3007 ms) 2024-04-25T09:26:04.238 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-04-25T09:26:07.253 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosReadOps.CmpExt (3016 ms) 2024-04-25T09:26:07.253 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 14 tests from NeoRadosReadOps (42123 ms total) 2024-04-25T09:26:07.254 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:26:07.254 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:26:07.254 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 14 tests from 1 test suite ran. (42123 ms total) 2024-04-25T09:26:07.254 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 14 tests. 2024-04-25T09:26:07.257 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:26:07.257 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:26:07.257 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:26:07.257 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' snapshots = ec_io ']' 2024-04-25T09:26:07.257 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' snapshots = ec_list ']' 2024-04-25T09:26:07.257 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_snapshots 2024-04-25T09:26:07.277 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:26:07.277 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 11 tests from 2 test suites. 2024-04-25T09:26:07.278 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:26:07.278 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-04-25T09:26:07.278 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-04-25T09:26:12.274 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSnapshots.SnapList (4996 ms) 2024-04-25T09:26:12.274 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-04-25T09:26:17.292 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (5019 ms) 2024-04-25T09:26:17.292 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-04-25T09:26:21.309 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSnapshots.Rollback (4016 ms) 2024-04-25T09:26:21.309 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-04-25T09:26:26.326 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5017 ms) 2024-04-25T09:26:26.326 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-04-25T09:26:33.068 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (6743 ms) 2024-04-25T09:26:33.069 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 5 tests from NeoRadosSnapshots (25791 ms total) 2024-04-25T09:26:33.069 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:26:33.069 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-04-25T09:26:33.069 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-04-25T09:26:38.088 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5019 ms) 2024-04-25T09:26:38.088 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-04-25T09:26:39.091 INFO:tasks.workunit.client.0.smithi053.stderr:Not supported by crimson yet. Skipped 2024-04-25T09:26:40.096 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2009 ms) 2024-04-25T09:26:40.096 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-04-25T09:26:41.100 INFO:tasks.workunit.client.0.smithi053.stderr:Not supported by crimson yet. Skipped 2024-04-25T09:26:42.105 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2009 ms) 2024-04-25T09:26:42.105 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-04-25T09:26:48.123 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6017 ms) 2024-04-25T09:26:48.123 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-04-25T09:26:52.138 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4016 ms) 2024-04-25T09:26:52.139 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-04-25T09:26:55.146 INFO:tasks.workunit.client.0.smithi053.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi053-95739-11. 2024-04-25T09:26:56.148 INFO:tasks.workunit.client.0.smithi053.stdout:Waiting for snaps to purge. 2024-04-25T09:27:11.387 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19248 ms) 2024-04-25T09:27:11.388 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (38318 ms total) 2024-04-25T09:27:11.388 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:27:11.388 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:27:11.388 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 11 tests from 2 test suites ran. (64109 ms total) 2024-04-25T09:27:11.388 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 11 tests. 2024-04-25T09:27:11.391 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:27:11.391 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:27:11.391 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:27:11.391 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' watch_notify = ec_io ']' 2024-04-25T09:27:11.391 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' watch_notify = ec_list ']' 2024-04-25T09:27:11.391 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_watch_notify 2024-04-25T09:27:11.413 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:27:11.414 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 2 tests from 1 test suite. 2024-04-25T09:27:11.414 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:27:11.414 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-04-25T09:27:11.414 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-04-25T09:27:13.903 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 12943568 notify_id 2808908611590 notifier_gid 16004 2024-04-25T09:27:14.396 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2982 ms) 2024-04-25T09:27:14.396 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-04-25T09:27:16.873 INFO:tasks.workunit.client.0.smithi053.stdout:Trying... 2024-04-25T09:27:16.876 INFO:tasks.workunit.client.0.smithi053.stdout:handle_notify cookie 25535568 notify_id 2821793513476 notifier_gid 16007 2024-04-25T09:27:16.877 INFO:tasks.workunit.client.0.smithi053.stdout:Waiting for 3.000000000s 2024-04-25T09:27:17.877 INFO:tasks.workunit.client.0.smithi053.stdout:Timed out. 2024-04-25T09:27:17.889 INFO:tasks.workunit.client.0.smithi053.stdout:Flushing... 2024-04-25T09:27:17.889 INFO:tasks.workunit.client.0.smithi053.stdout:Flushed... 2024-04-25T09:27:21.418 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7023 ms) 2024-04-25T09:27:21.418 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 2 tests from NeoRadosWatchNotify (10005 ms total) 2024-04-25T09:27:21.418 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:27:21.418 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:27:21.419 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 2 tests from 1 test suite ran. (10005 ms total) 2024-04-25T09:27:21.419 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 2 tests. 2024-04-25T09:27:21.421 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-25T09:27:21.421 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:27:21.421 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 1 -eq 1 ']' 2024-04-25T09:27:21.421 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' write_operations = ec_io ']' 2024-04-25T09:27:21.421 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' write_operations = ec_list ']' 2024-04-25T09:27:21.421 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph_test_neorados_write_operations 2024-04-25T09:27:21.442 INFO:tasks.workunit.client.0.smithi053.stdout:Running main() from gmock_main.cc 2024-04-25T09:27:21.443 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] Running 7 tests from 1 test suite. 2024-04-25T09:27:21.443 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment set-up. 2024-04-25T09:27:21.443 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-04-25T09:27:21.443 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-04-25T09:27:24.429 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2987 ms) 2024-04-25T09:27:24.429 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-04-25T09:27:27.441 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3012 ms) 2024-04-25T09:27:27.441 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-04-25T09:27:30.086 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosWriteOps.Xattrs (2645 ms) 2024-04-25T09:27:30.086 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-04-25T09:27:33.098 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosWriteOps.Write (3012 ms) 2024-04-25T09:27:33.099 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-04-25T09:27:36.111 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosWriteOps.Exec (3013 ms) 2024-04-25T09:27:36.111 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-04-25T09:27:39.120 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3009 ms) 2024-04-25T09:27:39.121 INFO:tasks.workunit.client.0.smithi053.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-04-25T09:27:49.391 INFO:tasks.workunit.client.0.smithi053.stdout:[ OK ] NeoRadosWriteOps.CmpExt (10271 ms) 2024-04-25T09:27:49.391 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] 7 tests from NeoRadosWriteOps (27949 ms total) 2024-04-25T09:27:49.391 INFO:tasks.workunit.client.0.smithi053.stdout: 2024-04-25T09:27:49.391 INFO:tasks.workunit.client.0.smithi053.stdout:[----------] Global test environment tear-down 2024-04-25T09:27:49.392 INFO:tasks.workunit.client.0.smithi053.stdout:[==========] 7 tests from 1 test suite ran. (27949 ms total) 2024-04-25T09:27:49.392 INFO:tasks.workunit.client.0.smithi053.stdout:[ PASSED ] 7 tests. 2024-04-25T09:27:49.394 INFO:tasks.workunit.client.0.smithi053.stderr:+ ret=0 2024-04-25T09:27:49.394 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -eq 1 ']' 2024-04-25T09:27:49.394 INFO:tasks.workunit.client.0.smithi053.stderr:+ exit 0 2024-04-25T09:27:49.394 INFO:tasks.workunit.client.0.smithi053.stderr:+ cleanup 2024-04-25T09:27:49.394 INFO:tasks.workunit.client.0.smithi053.stderr:+ pkill -P 30153 2024-04-25T09:27:49.417 INFO:tasks.workunit.client.0.smithi053.stderr:+ true 2024-04-25T09:27:49.417 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T09:27:49.417 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T09:27:49.487 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-04-25T09:27:49.488 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-04-25T09:27:49.488 DEBUG:teuthology.orchestra.run.smithi053:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=472cc2b524a88306ef4535053d26658c5fd6e9db TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-04-25T09:27:49.549 INFO:tasks.workunit.client.0.smithi053.stderr:++ uuidgen 2024-04-25T09:27:49.565 INFO:tasks.workunit.client.0.smithi053.stderr:+ p=c50b9a0b-a761-4651-b0e1-76fe43e4a63b 2024-04-25T09:27:49.565 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool create c50b9a0b-a761-4651-b0e1-76fe43e4a63b 12 2024-04-25T09:27:49.666 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.674+0000 7f079375d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:49.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.682+0000 7f079375d640 1 Processor -- start 2024-04-25T09:27:49.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.682+0000 7f079375d640 1 -- start start 2024-04-25T09:27:49.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.684+0000 7f079375d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f078c12f890 0x7f078c12fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:49.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.684+0000 7f079375d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078c09d440 con 0x7f078c06bb90 2024-04-25T09:27:49.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.684+0000 7f079375d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f078c0a2c40 con 0x7f078c12f890 2024-04-25T09:27:49.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.684+0000 7f07914f9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f078c12f890 0x7f078c12fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:49.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.684+0000 7f0790cf8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f078c06bb90 0x7f078c06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49126/0 (socket says 172.21.15.53:49126) 2024-04-25T09:27:49.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.684+0000 7f0790cf8640 1 -- 172.21.15.53:0/3376088369 learned_addr learned my addr 172.21.15.53:0/3376088369 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:27:49.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.685+0000 7f07914f9640 1 -- 172.21.15.53:0/3376088369 >> v1:172.21.15.53:6789/0 conn(0x7f078c06bb90 legacy=0x7f078c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:49.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.685+0000 7f07914f9640 1 -- 172.21.15.53:0/3376088369 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c09d7a0 con 0x7f078c12f890 2024-04-25T09:27:49.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.685+0000 7f07914f9640 1 --2- 172.21.15.53:0/3376088369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c12f890 0x7f078c12fca0 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f21fedba5400a3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:49.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.685+0000 7f078bfff640 1 -- 172.21.15.53:0/3376088369 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f077c00e040 con 0x7f078c12f890 2024-04-25T09:27:49.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.685+0000 7f078bfff640 1 -- 172.21.15.53:0/3376088369 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f077c007670 con 0x7f078c12f890 2024-04-25T09:27:49.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.685+0000 7f078bfff640 1 -- 172.21.15.53:0/3376088369 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f077c007910 con 0x7f078c12f890 2024-04-25T09:27:49.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.686+0000 7f079375d640 1 -- 172.21.15.53:0/3376088369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c12f890 msgr2=0x7f078c12fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:49.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.686+0000 7f079375d640 1 --2- 172.21.15.53:0/3376088369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c12f890 0x7f078c12fca0 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:49.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.686+0000 7f079375d640 1 -- 172.21.15.53:0/3376088369 shutdown_connections 2024-04-25T09:27:49.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.686+0000 7f079375d640 1 --2- 172.21.15.53:0/3376088369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c12f890 0x7f078c12fca0 unknown :-1 s=CLOSED pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:49.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.686+0000 7f079375d640 1 -- 172.21.15.53:0/3376088369 >> 172.21.15.53:0/3376088369 conn(0x7f078c0a04d0 msgr2=0x7f078c0a08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:49.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.686+0000 7f079375d640 1 -- 172.21.15.53:0/3376088369 shutdown_connections 2024-04-25T09:27:49.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.686+0000 7f079375d640 1 -- 172.21.15.53:0/3376088369 wait complete. 2024-04-25T09:27:49.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.686+0000 7f079375d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:49.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.688+0000 7f079375d640 1 Processor -- start 2024-04-25T09:27:49.674 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.688+0000 7f079375d640 1 -- start start 2024-04-25T09:27:49.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.689+0000 7f079375d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c06bb90 0x7f078c119e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:49.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.689+0000 7f079375d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f078c132750 con 0x7f078c06bb90 2024-04-25T09:27:49.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.689+0000 7f07914f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c06bb90 0x7f078c119e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:49.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.689+0000 7f07914f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c06bb90 0x7f078c119e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35004/0 (socket says 172.21.15.53:35004) 2024-04-25T09:27:49.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.689+0000 7f07914f9640 1 -- 172.21.15.53:0/2334766496 learned_addr learned my addr 172.21.15.53:0/2334766496 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:49.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.690+0000 7f07914f9640 1 -- 172.21.15.53:0/2334766496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c133240 con 0x7f078c06bb90 2024-04-25T09:27:49.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.690+0000 7f07914f9640 1 --2- 172.21.15.53:0/2334766496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c06bb90 0x7f078c119e80 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:49.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.690+0000 7f0789ffb640 1 -- 172.21.15.53:0/2334766496 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f077c00e040 con 0x7f078c06bb90 2024-04-25T09:27:49.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.690+0000 7f0789ffb640 1 -- 172.21.15.53:0/2334766496 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f077c012a80 con 0x7f078c06bb90 2024-04-25T09:27:49.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.690+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078c11cce0 con 0x7f078c06bb90 2024-04-25T09:27:49.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.690+0000 7f0789ffb640 1 -- 172.21.15.53:0/2334766496 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f077c012d20 con 0x7f078c06bb90 2024-04-25T09:27:49.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.690+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078c11c0d0 con 0x7f078c06bb90 2024-04-25T09:27:49.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.691+0000 7f0789ffb640 1 -- 172.21.15.53:0/2334766496 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f077c0153f0 con 0x7f078c06bb90 2024-04-25T09:27:49.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.691+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078c0697f0 con 0x7f078c06bb90 2024-04-25T09:27:49.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.691+0000 7f0789ffb640 1 --2- 172.21.15.53:0/2334766496 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0778038930 0x7f077803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:49.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.691+0000 7f0789ffb640 1 -- 172.21.15.53:0/2334766496 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(683..683 src has 401..683) ==== 3403+0+0 (crc 0 0 0) 0x7f077c049cf0 con 0x7f078c06bb90 2024-04-25T09:27:49.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.691+0000 7f0790cf8640 1 --2- 172.21.15.53:0/2334766496 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0778038930 0x7f077803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:49.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.692+0000 7f0790cf8640 1 --2- 172.21.15.53:0/2334766496 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0778038930 0x7f077803ae40 crc :-1 s=READY pgs=3752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:49.682 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.697+0000 7f0789ffb640 1 -- 172.21.15.53:0/2334766496 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f077c00fc80 con 0x7f078c06bb90 2024-04-25T09:27:49.869 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:49.884+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "pg_num": 12} v 0) -- 0x7f078c0733b0 con 0x7f078c06bb90 2024-04-25T09:27:50.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.409+0000 7f0789ffb640 1 -- 172.21.15.53:0/2334766496 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "pg_num": 12}]=0 pool 'c50b9a0b-a761-4651-b0e1-76fe43e4a63b' created v684) ==== 176+0+0 (crc 0 0 0) 0x7f077c00faa0 con 0x7f078c06bb90 2024-04-25T09:27:50.582 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.596+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "pg_num": 12} v 0) -- 0x7f078c0008d0 con 0x7f078c06bb90 2024-04-25T09:27:50.583 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.597+0000 7f0789ffb640 1 -- 172.21.15.53:0/2334766496 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "pg_num": 12}]=0 pool 'c50b9a0b-a761-4651-b0e1-76fe43e4a63b' already exists v684) ==== 183+0+0 (crc 0 0 0) 0x7f077c04c040 con 0x7f078c06bb90 2024-04-25T09:27:50.583 INFO:tasks.workunit.client.0.smithi053.stderr:pool 'c50b9a0b-a761-4651-b0e1-76fe43e4a63b' already exists 2024-04-25T09:27:50.586 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.600+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0778038930 msgr2=0x7f077803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:50.586 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.600+0000 7f079375d640 1 --2- 172.21.15.53:0/2334766496 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0778038930 0x7f077803ae40 crc :-1 s=READY pgs=3752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:50.586 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.601+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c06bb90 msgr2=0x7f078c119e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:50.586 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.601+0000 7f079375d640 1 --2- 172.21.15.53:0/2334766496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c06bb90 0x7f078c119e80 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:50.586 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.601+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 shutdown_connections 2024-04-25T09:27:50.586 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.601+0000 7f079375d640 1 --2- 172.21.15.53:0/2334766496 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0778038930 0x7f077803ae40 unknown :-1 s=CLOSED pgs=3752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:50.586 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.601+0000 7f079375d640 1 --2- 172.21.15.53:0/2334766496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f078c06bb90 0x7f078c119e80 unknown :-1 s=CLOSED pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:50.587 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.601+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 >> 172.21.15.53:0/2334766496 conn(0x7f078c0a04d0 msgr2=0x7f078c12d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:50.587 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.601+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 shutdown_connections 2024-04-25T09:27:50.587 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.601+0000 7f079375d640 1 -- 172.21.15.53:0/2334766496 wait complete. 2024-04-25T09:27:50.606 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool set-quota c50b9a0b-a761-4651-b0e1-76fe43e4a63b max_objects 10 2024-04-25T09:27:50.763 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.766+0000 7f5d3b19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:50.764 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.779+0000 7f5d3b19d640 1 Processor -- start 2024-04-25T09:27:50.764 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.779+0000 7f5d3b19d640 1 -- start start 2024-04-25T09:27:50.766 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.781+0000 7f5d3b19d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5d341356a0 0x7f5d34139e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:50.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.781+0000 7f5d3b19d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d34134c80 con 0x7f5d3409b460 2024-04-25T09:27:50.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.781+0000 7f5d3b19d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5d3409bf20 con 0x7f5d341356a0 2024-04-25T09:27:50.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.781+0000 7f5d38f39640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5d3409b460 0x7f5d34134f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49134/0 (socket says 172.21.15.53:49134) 2024-04-25T09:27:50.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.781+0000 7f5d38f39640 1 -- 172.21.15.53:0/1126986198 learned_addr learned my addr 172.21.15.53:0/1126986198 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:27:50.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.782+0000 7f5d33fff640 1 --2- 172.21.15.53:0/1126986198 >> v2:172.21.15.53:3300/0 conn(0x7f5d341356a0 0x7f5d34139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:50.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.782+0000 7f5d337fe640 1 -- 172.21.15.53:0/1126986198 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234359083 0 0) 0x7f5d34134c80 con 0x7f5d3409b460 2024-04-25T09:27:50.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.782+0000 7f5d337fe640 1 -- 172.21.15.53:0/1126986198 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d24003580 con 0x7f5d3409b460 2024-04-25T09:27:50.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.782+0000 7f5d33fff640 1 -- 172.21.15.53:0/1126986198 >> v1:172.21.15.53:6789/0 conn(0x7f5d3409b460 legacy=0x7f5d34134f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:50.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.782+0000 7f5d33fff640 1 -- 172.21.15.53:0/1126986198 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3409c8d0 con 0x7f5d341356a0 2024-04-25T09:27:50.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.782+0000 7f5d33fff640 1 --2- 172.21.15.53:0/1126986198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341356a0 0x7f5d34139e80 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3067a25507d4b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:50.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.783+0000 7f5d337fe640 1 -- 172.21.15.53:0/1126986198 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d20009d90 con 0x7f5d341356a0 2024-04-25T09:27:50.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.783+0000 7f5d337fe640 1 -- 172.21.15.53:0/1126986198 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d2000e230 con 0x7f5d341356a0 2024-04-25T09:27:50.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.783+0000 7f5d337fe640 1 -- 172.21.15.53:0/1126986198 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d2000e4d0 con 0x7f5d341356a0 2024-04-25T09:27:50.769 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.784+0000 7f5d3b19d640 1 -- 172.21.15.53:0/1126986198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341356a0 msgr2=0x7f5d34139e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:50.770 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.784+0000 7f5d3b19d640 1 --2- 172.21.15.53:0/1126986198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341356a0 0x7f5d34139e80 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:50.770 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.784+0000 7f5d3b19d640 1 -- 172.21.15.53:0/1126986198 shutdown_connections 2024-04-25T09:27:50.770 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.784+0000 7f5d3b19d640 1 --2- 172.21.15.53:0/1126986198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341356a0 0x7f5d34139e80 unknown :-1 s=CLOSED pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:50.770 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.784+0000 7f5d3b19d640 1 -- 172.21.15.53:0/1126986198 >> 172.21.15.53:0/1126986198 conn(0x7f5d340a3c00 msgr2=0x7f5d340a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:50.770 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.785+0000 7f5d3b19d640 1 -- 172.21.15.53:0/1126986198 shutdown_connections 2024-04-25T09:27:50.770 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.785+0000 7f5d3b19d640 1 -- 172.21.15.53:0/1126986198 wait complete. 2024-04-25T09:27:50.770 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.786+0000 7f5d3b19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:50.774 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.789+0000 7f5d3b19d640 1 Processor -- start 2024-04-25T09:27:50.774 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.789+0000 7f5d3b19d640 1 -- start start 2024-04-25T09:27:50.776 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.791+0000 7f5d3b19d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341c9720 0x7f5d341c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:50.776 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.791+0000 7f5d3b19d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f5d34132400 con 0x7f5d341c9720 2024-04-25T09:27:50.776 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.791+0000 7f5d38f39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341c9720 0x7f5d341c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:50.776 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.791+0000 7f5d38f39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341c9720 0x7f5d341c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35024/0 (socket says 172.21.15.53:35024) 2024-04-25T09:27:50.776 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.791+0000 7f5d38f39640 1 -- 172.21.15.53:0/3253864682 learned_addr learned my addr 172.21.15.53:0/3253864682 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:50.777 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.792+0000 7f5d38f39640 1 -- 172.21.15.53:0/3253864682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d341bf2f0 con 0x7f5d341c9720 2024-04-25T09:27:50.777 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.792+0000 7f5d38f39640 1 --2- 172.21.15.53:0/3253864682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341c9720 0x7f5d341c9b30 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:50.777 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.792+0000 7f5d317fa640 1 -- 172.21.15.53:0/3253864682 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d28005a60 con 0x7f5d341c9720 2024-04-25T09:27:50.778 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.793+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d34120930 con 0x7f5d341c9720 2024-04-25T09:27:50.778 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.793+0000 7f5d317fa640 1 -- 172.21.15.53:0/3253864682 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d28005bc0 con 0x7f5d341c9720 2024-04-25T09:27:50.778 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.793+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d341ca070 con 0x7f5d341c9720 2024-04-25T09:27:50.779 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.794+0000 7f5d317fa640 1 -- 172.21.15.53:0/3253864682 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d28005a60 con 0x7f5d341c9720 2024-04-25T09:27:50.779 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.794+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d140050f0 con 0x7f5d341c9720 2024-04-25T09:27:50.780 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.795+0000 7f5d317fa640 1 -- 172.21.15.53:0/3253864682 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f5d2800c7a0 con 0x7f5d341c9720 2024-04-25T09:27:50.780 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.795+0000 7f5d317fa640 1 --2- 172.21.15.53:0/3253864682 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d18038970 0x7f5d1803ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:50.780 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.795+0000 7f5d317fa640 1 -- 172.21.15.53:0/3253864682 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(684..684 src has 401..684) ==== 3778+0+0 (crc 0 0 0) 0x7f5d28048420 con 0x7f5d341c9720 2024-04-25T09:27:50.781 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.796+0000 7f5d33fff640 1 --2- 172.21.15.53:0/3253864682 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d18038970 0x7f5d1803ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:50.782 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.797+0000 7f5d33fff640 1 --2- 172.21.15.53:0/3253864682 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d18038970 0x7f5d1803ae80 crc :-1 s=READY pgs=3753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:50.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:50.802+0000 7f5d317fa640 1 -- 172.21.15.53:0/3253864682 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f5d2800d540 con 0x7f5d341c9720 2024-04-25T09:27:51.044 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:51.059+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "10"} v 0) -- 0x7f5d140053a0 con 0x7f5d341c9720 2024-04-25T09:27:51.397 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:51.412+0000 7f5d317fa640 1 -- 172.21.15.53:0/3253864682 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v685) ==== 223+0+0 (crc 0 0 0) 0x7f5d2800d540 con 0x7f5d341c9720 2024-04-25T09:27:51.562 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:51.577+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "10"} v 0) -- 0x7f5d14002360 con 0x7f5d341c9720 2024-04-25T09:27:52.401 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.416+0000 7f5d317fa640 1 -- 172.21.15.53:0/3253864682 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v686) ==== 223+0+0 (crc 0 0 0) 0x7f5d2800d150 con 0x7f5d341c9720 2024-04-25T09:27:52.402 INFO:tasks.workunit.client.0.smithi053.stderr:set-quota max_objects = 10 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b 2024-04-25T09:27:52.404 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d18038970 msgr2=0x7f5d1803ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:52.404 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 --2- 172.21.15.53:0/3253864682 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d18038970 0x7f5d1803ae80 crc :-1 s=READY pgs=3753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:52.404 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341c9720 msgr2=0x7f5d341c9b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:52.404 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 --2- 172.21.15.53:0/3253864682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341c9720 0x7f5d341c9b30 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:52.404 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 shutdown_connections 2024-04-25T09:27:52.405 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 --2- 172.21.15.53:0/3253864682 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d18038970 0x7f5d1803ae80 unknown :-1 s=CLOSED pgs=3753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:52.405 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 --2- 172.21.15.53:0/3253864682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d341c9720 0x7f5d341c9b30 unknown :-1 s=CLOSED pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:52.405 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 >> 172.21.15.53:0/3253864682 conn(0x7f5d340a3c00 msgr2=0x7f5d340a4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:52.405 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 shutdown_connections 2024-04-25T09:27:52.405 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.419+0000 7f5d3b19d640 1 -- 172.21.15.53:0/3253864682 wait complete. 2024-04-25T09:27:52.417 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool application enable c50b9a0b-a761-4651-b0e1-76fe43e4a63b rados 2024-04-25T09:27:52.524 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.530+0000 7f49278ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:52.526 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.541+0000 7f49278ad640 1 Processor -- start 2024-04-25T09:27:52.526 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.541+0000 7f49278ad640 1 -- start start 2024-04-25T09:27:52.528 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.542+0000 7f49278ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4920070ec0 0x7f4920135070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:52.528 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.542+0000 7f49278ad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492006e140 con 0x7f49201355b0 2024-04-25T09:27:52.528 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.542+0000 7f49278ad640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f49201359c0 con 0x7f4920070ec0 2024-04-25T09:27:52.529 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.543+0000 7f4925649640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4920070ec0 0x7f4920135070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:52.529 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.543+0000 7f4924e48640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f49201355b0 0x7f4920131550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:49144/0 (socket says 172.21.15.53:49144) 2024-04-25T09:27:52.529 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.543+0000 7f4924e48640 1 -- 172.21.15.53:0/408131571 learned_addr learned my addr 172.21.15.53:0/408131571 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:27:52.529 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.543+0000 7f4925649640 1 -- 172.21.15.53:0/408131571 >> v1:172.21.15.53:6789/0 conn(0x7f49201355b0 legacy=0x7f4920131550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:52.529 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.543+0000 7f4925649640 1 -- 172.21.15.53:0/408131571 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49200712d0 con 0x7f4920070ec0 2024-04-25T09:27:52.529 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.543+0000 7f4925649640 1 --2- 172.21.15.53:0/408131571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 0x7f4920135070 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1d83551abed0d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:52.529 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.543+0000 7f4917fff640 1 -- 172.21.15.53:0/408131571 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f491c009d90 con 0x7f4920070ec0 2024-04-25T09:27:52.529 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.543+0000 7f4917fff640 1 -- 172.21.15.53:0/408131571 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f491c00e230 con 0x7f4920070ec0 2024-04-25T09:27:52.529 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.543+0000 7f4917fff640 1 -- 172.21.15.53:0/408131571 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f491c00e4d0 con 0x7f4920070ec0 2024-04-25T09:27:52.530 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.545+0000 7f49278ad640 1 -- 172.21.15.53:0/408131571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 msgr2=0x7f4920135070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:52.530 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.545+0000 7f49278ad640 1 --2- 172.21.15.53:0/408131571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 0x7f4920135070 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:52.530 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.545+0000 7f49278ad640 1 -- 172.21.15.53:0/408131571 shutdown_connections 2024-04-25T09:27:52.530 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.545+0000 7f49278ad640 1 --2- 172.21.15.53:0/408131571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 0x7f4920135070 unknown :-1 s=CLOSED pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:52.531 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.545+0000 7f49278ad640 1 -- 172.21.15.53:0/408131571 >> 172.21.15.53:0/408131571 conn(0x7f492009f3b0 msgr2=0x7f492009f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:52.531 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.545+0000 7f49278ad640 1 -- 172.21.15.53:0/408131571 shutdown_connections 2024-04-25T09:27:52.531 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.545+0000 7f49278ad640 1 -- 172.21.15.53:0/408131571 wait complete. 2024-04-25T09:27:52.531 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.545+0000 7f49278ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:52.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.549+0000 7f49278ad640 1 Processor -- start 2024-04-25T09:27:52.534 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.549+0000 7f49278ad640 1 -- start start 2024-04-25T09:27:52.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.551+0000 7f49278ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 0x7f492011af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:52.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.551+0000 7f49278ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f492011ee00 con 0x7f4920070ec0 2024-04-25T09:27:52.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.551+0000 7f4925649640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 0x7f492011af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:52.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.551+0000 7f4925649640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 0x7f492011af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35034/0 (socket says 172.21.15.53:35034) 2024-04-25T09:27:52.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.551+0000 7f4925649640 1 -- 172.21.15.53:0/3585842749 learned_addr learned my addr 172.21.15.53:0/3585842749 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:52.537 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.552+0000 7f4925649640 1 -- 172.21.15.53:0/3585842749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492011deb0 con 0x7f4920070ec0 2024-04-25T09:27:52.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.552+0000 7f4925649640 1 --2- 172.21.15.53:0/3585842749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 0x7f492011af90 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:52.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.552+0000 7f4915ffb640 1 -- 172.21.15.53:0/3585842749 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f491c014620 con 0x7f4920070ec0 2024-04-25T09:27:52.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.552+0000 7f4915ffb640 1 -- 172.21.15.53:0/3585842749 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f491c014780 con 0x7f4920070ec0 2024-04-25T09:27:52.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.552+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492006f0f0 con 0x7f4920070ec0 2024-04-25T09:27:52.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.552+0000 7f4915ffb640 1 -- 172.21.15.53:0/3585842749 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f491c014a20 con 0x7f4920070ec0 2024-04-25T09:27:52.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.552+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492011c8f0 con 0x7f4920070ec0 2024-04-25T09:27:52.539 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.553+0000 7f4915ffb640 1 -- 172.21.15.53:0/3585842749 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f491c014bd0 con 0x7f4920070ec0 2024-04-25T09:27:52.539 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.554+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492011d310 con 0x7f4920070ec0 2024-04-25T09:27:52.539 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.554+0000 7f4915ffb640 1 --2- 172.21.15.53:0/3585842749 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4904038980 0x7f490403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:52.539 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.554+0000 7f4915ffb640 1 -- 172.21.15.53:0/3585842749 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(686..686 src has 401..686) ==== 3778+0+0 (crc 0 0 0) 0x7f491c019040 con 0x7f4920070ec0 2024-04-25T09:27:52.539 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.554+0000 7f4924e48640 1 --2- 172.21.15.53:0/3585842749 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4904038980 0x7f490403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:52.540 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.555+0000 7f4924e48640 1 --2- 172.21.15.53:0/3585842749 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4904038980 0x7f490403ae90 crc :-1 s=READY pgs=3754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:52.544 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.559+0000 7f4915ffb640 1 -- 172.21.15.53:0/3585842749 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f492011d310 con 0x7f4920070ec0 2024-04-25T09:27:52.753 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:52.768+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "app": "rados"} v 0) -- 0x7f4920073980 con 0x7f4920070ec0 2024-04-25T09:27:53.403 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:53.417+0000 7f4915ffb640 1 -- 172.21.15.53:0/3585842749 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "app": "rados"}]=0 enabled application 'rados' on pool 'c50b9a0b-a761-4651-b0e1-76fe43e4a63b' v687) ==== 213+0+0 (crc 0 0 0) 0x7f491c018190 con 0x7f4920070ec0 2024-04-25T09:27:53.566 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:53.581+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "app": "rados"} v 0) -- 0x7f492011d310 con 0x7f4920070ec0 2024-04-25T09:27:54.408 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.422+0000 7f4915ffb640 1 -- 172.21.15.53:0/3585842749 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "app": "rados"}]=0 enabled application 'rados' on pool 'c50b9a0b-a761-4651-b0e1-76fe43e4a63b' v688) ==== 213+0+0 (crc 0 0 0) 0x7f492011d310 con 0x7f4920070ec0 2024-04-25T09:27:54.451 INFO:tasks.workunit.client.0.smithi053.stderr:enabled application 'rados' on pool 'c50b9a0b-a761-4651-b0e1-76fe43e4a63b' 2024-04-25T09:27:54.452 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4904038980 msgr2=0x7f490403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 --2- 172.21.15.53:0/3585842749 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4904038980 0x7f490403ae90 crc :-1 s=READY pgs=3754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 msgr2=0x7f492011af90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 --2- 172.21.15.53:0/3585842749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 0x7f492011af90 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 shutdown_connections 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 --2- 172.21.15.53:0/3585842749 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4904038980 0x7f490403ae90 unknown :-1 s=CLOSED pgs=3754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 --2- 172.21.15.53:0/3585842749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4920070ec0 0x7f492011af90 unknown :-1 s=CLOSED pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 >> 172.21.15.53:0/3585842749 conn(0x7f492009f3b0 msgr2=0x7f49200a3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 shutdown_connections 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.425+0000 7f49278ad640 1 -- 172.21.15.53:0/3585842749 wait complete. 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:++ seq 1 10 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:54.453 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj1 /etc/passwd 2024-04-25T09:27:54.479 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.494+0000 7f00bbe3eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.485 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.500+0000 7f00bbe3eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.485 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.500+0000 7f00bbe3eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.486 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.501+0000 7f00bbe3eec0 1 Processor -- start 2024-04-25T09:27:54.486 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.501+0000 7f00bbe3eec0 1 -- start start 2024-04-25T09:27:54.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.502+0000 7f00bbe3eec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x23de410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:54.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.502+0000 7f00bbe3eec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x2348950 con 0x23e1ed0 2024-04-25T09:27:54.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.502+0000 7f00aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x23de410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:54.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.502+0000 7f00aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x23de410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35058/0 (socket says 172.21.15.53:35058) 2024-04-25T09:27:54.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.502+0000 7f00aeffd640 1 -- 172.21.15.53:0/133188233 learned_addr learned my addr 172.21.15.53:0/133188233 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:54.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.503+0000 7f00aeffd640 1 -- 172.21.15.53:0/133188233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x22e71e0 con 0x23e1ed0 2024-04-25T09:27:54.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.503+0000 7f00aeffd640 1 --2- 172.21.15.53:0/133188233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x23de410 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b949eb0662c8b3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:54.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.503+0000 7f00ad7fa640 1 -- 172.21.15.53:0/133188233 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f00a000b5d0 con 0x23e1ed0 2024-04-25T09:27:54.489 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.503+0000 7f00ad7fa640 1 -- 172.21.15.53:0/133188233 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f00a000b730 con 0x23e1ed0 2024-04-25T09:27:54.489 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.503+0000 7f00ad7fa640 1 -- 172.21.15.53:0/133188233 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f00a000b9d0 con 0x23e1ed0 2024-04-25T09:27:54.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.504+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/133188233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 msgr2=0x23de410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:54.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.504+0000 7f00bbe3eec0 1 --2- 172.21.15.53:0/133188233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x23de410 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.504+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/133188233 shutdown_connections 2024-04-25T09:27:54.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.504+0000 7f00bbe3eec0 1 --2- 172.21.15.53:0/133188233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x23de410 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.504+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/133188233 >> 172.21.15.53:0/133188233 conn(0x22ff960 msgr2=0x24766e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:54.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.504+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/133188233 shutdown_connections 2024-04-25T09:27:54.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.504+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/133188233 wait complete. 2024-04-25T09:27:54.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.505+0000 7f00bbe3eec0 1 Processor -- start 2024-04-25T09:27:54.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.505+0000 7f00bbe3eec0 1 -- start start 2024-04-25T09:27:54.492 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.506+0000 7f00bbe3eec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x2461430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:54.492 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.506+0000 7f00bbe3eec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x23463d0 con 0x23e1ed0 2024-04-25T09:27:54.492 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.506+0000 7f00aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x2461430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:54.492 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.507+0000 7f00aeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x2461430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35066/0 (socket says 172.21.15.53:35066) 2024-04-25T09:27:54.492 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.507+0000 7f00aeffd640 1 -- 172.21.15.53:0/2046437750 learned_addr learned my addr 172.21.15.53:0/2046437750 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:54.493 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.507+0000 7f00aeffd640 1 -- 172.21.15.53:0/2046437750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x22d9e30 con 0x23e1ed0 2024-04-25T09:27:54.493 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.507+0000 7f00aeffd640 1 --2- 172.21.15.53:0/2046437750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x2461430 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:54.493 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.507+0000 7f0097fff640 1 -- 172.21.15.53:0/2046437750 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f00a0012910 con 0x23e1ed0 2024-04-25T09:27:54.493 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.507+0000 7f0097fff640 1 -- 172.21.15.53:0/2046437750 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f00a0005040 con 0x23e1ed0 2024-04-25T09:27:54.493 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.507+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x22d9890 con 0x23e1ed0 2024-04-25T09:27:54.493 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.507+0000 7f0097fff640 1 -- 172.21.15.53:0/2046437750 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f00a0012ba0 con 0x23e1ed0 2024-04-25T09:27:54.493 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.507+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x24647f0 con 0x23e1ed0 2024-04-25T09:27:54.494 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.508+0000 7f0097fff640 1 -- 172.21.15.53:0/2046437750 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f00a000d040 con 0x23e1ed0 2024-04-25T09:27:54.494 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.508+0000 7f0097fff640 1 --2- 172.21.15.53:0/2046437750 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f009c037210 0x7f009c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:54.494 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.508+0000 7f0097fff640 1 -- 172.21.15.53:0/2046437750 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7f00a000a040 con 0x23e1ed0 2024-04-25T09:27:54.494 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.509+0000 7f00bbe3eec0 1 --2- 172.21.15.53:0/2046437750 >> v2:172.21.15.151:6806/46311736 conn(0x24786f0 0x24727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:54.494 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.509+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 --> v2:172.21.15.151:6806/46311736 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x2464f90 con 0x24786f0 2024-04-25T09:27:54.495 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.509+0000 7f00ae7fc640 1 --2- 172.21.15.53:0/2046437750 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f009c037210 0x7f009c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:54.495 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.509+0000 7f00ae7fc640 1 --2- 172.21.15.53:0/2046437750 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f009c037210 0x7f009c039720 crc :-1 s=READY pgs=3755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:54.495 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.509+0000 7f00af7fe640 1 --2- 172.21.15.53:0/2046437750 >> v2:172.21.15.151:6806/46311736 conn(0x24786f0 0x24727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:54.497 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.512+0000 7f00af7fe640 1 --2- 172.21.15.53:0/2046437750 >> v2:172.21.15.151:6806/46311736 conn(0x24786f0 0x24727e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:54.929 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00af7fe640 1 -- 172.21.15.53:0/2046437750 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== osd_op_reply(1 obj1 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f00a800a430 con 0x24786f0 2024-04-25T09:27:54.929 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 >> v2:172.21.15.151:6806/46311736 conn(0x24786f0 msgr2=0x24727e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:54.929 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 --2- 172.21.15.53:0/2046437750 >> v2:172.21.15.151:6806/46311736 conn(0x24786f0 0x24727e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f009c037210 msgr2=0x7f009c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 --2- 172.21.15.53:0/2046437750 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f009c037210 0x7f009c039720 crc :-1 s=READY pgs=3755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 msgr2=0x2461430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 --2- 172.21.15.53:0/2046437750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x2461430 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 shutdown_connections 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 --2- 172.21.15.53:0/2046437750 >> v2:172.21.15.151:6806/46311736 conn(0x24786f0 0x24727e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 --2- 172.21.15.53:0/2046437750 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f009c037210 0x7f009c039720 unknown :-1 s=CLOSED pgs=3755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 --2- 172.21.15.53:0/2046437750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23e1ed0 0x2461430 unknown :-1 s=CLOSED pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 >> 172.21.15.53:0/2046437750 conn(0x22ff960 msgr2=0x24766e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 shutdown_connections 2024-04-25T09:27:54.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.944+0000 7f00bbe3eec0 1 -- 172.21.15.53:0/2046437750 wait complete. 2024-04-25T09:27:54.932 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:54.932 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj2 /etc/passwd 2024-04-25T09:27:54.974 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.989+0000 7f200f8d6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.980 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.995+0000 7f200f8d6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.981 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.996+0000 7f200f8d6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.981 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.997+0000 7f200f8d6ec0 1 Processor -- start 2024-04-25T09:27:54.981 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.997+0000 7f200f8d6ec0 1 -- start start 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.998+0000 7f200f8d6ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x11ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.998+0000 7f200f8d6ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1038950 con 0x10b7740 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.998+0000 7f2002ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x11ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.998+0000 7f2002ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x11ec3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35094/0 (socket says 172.21.15.53:35094) 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.998+0000 7f2002ffd640 1 -- 172.21.15.53:0/3389778948 learned_addr learned my addr 172.21.15.53:0/3389778948 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.999+0000 7f2002ffd640 1 -- 172.21.15.53:0/3389778948 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xfd71e0 con 0x10b7740 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.999+0000 7f2002ffd640 1 --2- 172.21.15.53:0/3389778948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x11ec3b0 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895bd668b345cc25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.999+0000 7f2001ffb640 1 -- 172.21.15.53:0/3389778948 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1ff402c590 con 0x10b7740 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.999+0000 7f2001ffb640 1 -- 172.21.15.53:0/3389778948 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1ff400a040 con 0x10b7740 2024-04-25T09:27:54.984 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:54.999+0000 7f2001ffb640 1 -- 172.21.15.53:0/3389778948 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1ff400a2e0 con 0x10b7740 2024-04-25T09:27:54.985 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.000+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/3389778948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 msgr2=0x11ec3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:54.985 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.000+0000 7f200f8d6ec0 1 --2- 172.21.15.53:0/3389778948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x11ec3b0 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.986 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.000+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/3389778948 shutdown_connections 2024-04-25T09:27:54.986 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.000+0000 7f200f8d6ec0 1 --2- 172.21.15.53:0/3389778948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x11ec3b0 unknown :-1 s=CLOSED pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:54.986 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.000+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/3389778948 >> 172.21.15.53:0/3389778948 conn(0xfef960 msgr2=0x115fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:54.986 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.000+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/3389778948 shutdown_connections 2024-04-25T09:27:54.986 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.000+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/3389778948 wait complete. 2024-04-25T09:27:54.986 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.001+0000 7f200f8d6ec0 1 Processor -- start 2024-04-25T09:27:54.986 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.001+0000 7f200f8d6ec0 1 -- start start 2024-04-25T09:27:54.988 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.002+0000 7f200f8d6ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x115e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:54.988 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.002+0000 7f200f8d6ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x10363d0 con 0x10b7740 2024-04-25T09:27:54.988 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.002+0000 7f2002ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x115e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:54.988 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.002+0000 7f2002ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x115e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35098/0 (socket says 172.21.15.53:35098) 2024-04-25T09:27:54.988 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.002+0000 7f2002ffd640 1 -- 172.21.15.53:0/2232552843 learned_addr learned my addr 172.21.15.53:0/2232552843 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:54.988 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.003+0000 7f2002ffd640 1 -- 172.21.15.53:0/2232552843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xfc9e30 con 0x10b7740 2024-04-25T09:27:54.989 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.003+0000 7f2002ffd640 1 --2- 172.21.15.53:0/2232552843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x115e190 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:54.989 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.003+0000 7f2000ff9640 1 -- 172.21.15.53:0/2232552843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1ff4038570 con 0x10b7740 2024-04-25T09:27:54.989 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.003+0000 7f2000ff9640 1 -- 172.21.15.53:0/2232552843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1ff40386d0 con 0x10b7740 2024-04-25T09:27:54.989 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.003+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xfc9890 con 0x10b7740 2024-04-25T09:27:54.989 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.003+0000 7f2000ff9640 1 -- 172.21.15.53:0/2232552843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1ff4038970 con 0x10b7740 2024-04-25T09:27:54.989 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.003+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x114d980 con 0x10b7740 2024-04-25T09:27:54.990 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.004+0000 7f2000ff9640 1 -- 172.21.15.53:0/2232552843 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1ff4035040 con 0x10b7740 2024-04-25T09:27:54.990 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.004+0000 7f2000ff9640 1 --2- 172.21.15.53:0/2232552843 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1fe4037210 0x7f1fe4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:54.990 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.004+0000 7f2000ff9640 1 -- 172.21.15.53:0/2232552843 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7f1ff4032040 con 0x10b7740 2024-04-25T09:27:54.990 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.004+0000 7f200f8d6ec0 1 --2- 172.21.15.53:0/2232552843 >> v2:172.21.15.151:6806/46311736 conn(0x1162940 0x10cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:54.990 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.005+0000 7f1ffbfff640 1 --2- 172.21.15.53:0/2232552843 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1fe4037210 0x7f1fe4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:54.990 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.005+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 --> v2:172.21.15.151:6806/46311736 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x114df00 con 0x1162940 2024-04-25T09:27:54.991 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.005+0000 7f1ffbfff640 1 --2- 172.21.15.53:0/2232552843 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1fe4037210 0x7f1fe4039720 crc :-1 s=READY pgs=3756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:54.991 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.005+0000 7f20037fe640 1 --2- 172.21.15.53:0/2232552843 >> v2:172.21.15.151:6806/46311736 conn(0x1162940 0x10cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:54.993 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.008+0000 7f20037fe640 1 --2- 172.21.15.53:0/2232552843 >> v2:172.21.15.151:6806/46311736 conn(0x1162940 0x10cb580 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.004 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f20037fe640 1 -- 172.21.15.53:0/2232552843 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== osd_op_reply(1 obj2 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f1ffc00a430 con 0x1162940 2024-04-25T09:27:55.004 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 >> v2:172.21.15.151:6806/46311736 conn(0x1162940 msgr2=0x10cb580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 --2- 172.21.15.53:0/2232552843 >> v2:172.21.15.151:6806/46311736 conn(0x1162940 0x10cb580 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1fe4037210 msgr2=0x7f1fe4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 --2- 172.21.15.53:0/2232552843 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1fe4037210 0x7f1fe4039720 crc :-1 s=READY pgs=3756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 msgr2=0x115e190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 --2- 172.21.15.53:0/2232552843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x115e190 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 shutdown_connections 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 --2- 172.21.15.53:0/2232552843 >> v2:172.21.15.151:6806/46311736 conn(0x1162940 0x10cb580 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 --2- 172.21.15.53:0/2232552843 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1fe4037210 0x7f1fe4039720 unknown :-1 s=CLOSED pgs=3756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 --2- 172.21.15.53:0/2232552843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x10b7740 0x115e190 unknown :-1 s=CLOSED pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 >> 172.21.15.53:0/2232552843 conn(0xfef960 msgr2=0x10d5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 shutdown_connections 2024-04-25T09:27:55.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.019+0000 7f200f8d6ec0 1 -- 172.21.15.53:0/2232552843 wait complete. 2024-04-25T09:27:55.006 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:55.007 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj3 /etc/passwd 2024-04-25T09:27:55.045 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.060+0000 7f0bd9ee3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.051 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.066+0000 7f0bd9ee3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.051 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.066+0000 7f0bd9ee3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.052 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.067+0000 7f0bd9ee3ec0 1 Processor -- start 2024-04-25T09:27:55.052 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.067+0000 7f0bd9ee3ec0 1 -- start start 2024-04-25T09:27:55.055 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bd9ee3ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x1864090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.055 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bd9ee3ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x174e950 con 0x17e9450 2024-04-25T09:27:55.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bd1b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x1864090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bd1b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x1864090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35118/0 (socket says 172.21.15.53:35118) 2024-04-25T09:27:55.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bd1b9a640 1 -- 172.21.15.53:0/1865557411 learned_addr learned my addr 172.21.15.53:0/1865557411 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bd1b9a640 1 -- 172.21.15.53:0/1865557411 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x16ed1e0 con 0x17e9450 2024-04-25T09:27:55.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bd1b9a640 1 --2- 172.21.15.53:0/1865557411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x1864090 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e6b61f2fe3ce35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bcbfff640 1 -- 172.21.15.53:0/1865557411 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bc402ea10 con 0x17e9450 2024-04-25T09:27:55.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bcbfff640 1 -- 172.21.15.53:0/1865557411 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0bc402eb70 con 0x17e9450 2024-04-25T09:27:55.056 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.069+0000 7f0bcbfff640 1 -- 172.21.15.53:0/1865557411 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bc402ee10 con 0x17e9450 2024-04-25T09:27:55.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.070+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/1865557411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 msgr2=0x1864090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.070+0000 7f0bd9ee3ec0 1 --2- 172.21.15.53:0/1865557411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x1864090 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.070+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/1865557411 shutdown_connections 2024-04-25T09:27:55.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.070+0000 7f0bd9ee3ec0 1 --2- 172.21.15.53:0/1865557411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x1864090 unknown :-1 s=CLOSED pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.070+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/1865557411 >> 172.21.15.53:0/1865557411 conn(0x1705960 msgr2=0x17e2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.070+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/1865557411 shutdown_connections 2024-04-25T09:27:55.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.070+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/1865557411 wait complete. 2024-04-25T09:27:55.060 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.071+0000 7f0bd9ee3ec0 1 Processor -- start 2024-04-25T09:27:55.061 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.071+0000 7f0bd9ee3ec0 1 -- start start 2024-04-25T09:27:55.061 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.072+0000 7f0bd9ee3ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x17e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.061 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.072+0000 7f0bd9ee3ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x174c3d0 con 0x17e9450 2024-04-25T09:27:55.061 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bd1b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x17e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.061 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bd1b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x17e4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35134/0 (socket says 172.21.15.53:35134) 2024-04-25T09:27:55.061 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bd1b9a640 1 -- 172.21.15.53:0/741249216 learned_addr learned my addr 172.21.15.53:0/741249216 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.061 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bd1b9a640 1 -- 172.21.15.53:0/741249216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x16dfe30 con 0x17e9450 2024-04-25T09:27:55.061 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bd1b9a640 1 --2- 172.21.15.53:0/741249216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x17e4f40 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bcaffd640 1 -- 172.21.15.53:0/741249216 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bc402e840 con 0x17e9450 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bcaffd640 1 -- 172.21.15.53:0/741249216 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0bc4032a80 con 0x17e9450 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x16df890 con 0x17e9450 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bcaffd640 1 -- 172.21.15.53:0/741249216 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0bc4032d20 con 0x17e9450 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.073+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x186d390 con 0x17e9450 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.074+0000 7f0bcaffd640 1 -- 172.21.15.53:0/741249216 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0bc403b040 con 0x17e9450 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.074+0000 7f0bcaffd640 1 --2- 172.21.15.53:0/741249216 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0bb8037260 0x7f0bb8039770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.075+0000 7f0bcaffd640 1 -- 172.21.15.53:0/741249216 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7f0bc4038040 con 0x17e9450 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.075+0000 7f0bd9ee3ec0 1 --2- 172.21.15.53:0/741249216 >> v2:172.21.15.53:6805/3736905990 conn(0x187b9c0 0x17e5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.075+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1d17650 con 0x187b9c0 2024-04-25T09:27:55.062 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.075+0000 7f0bd1399640 1 --2- 172.21.15.53:0/741249216 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0bb8037260 0x7f0bb8039770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.063 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.075+0000 7f0bd1399640 1 --2- 172.21.15.53:0/741249216 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0bb8037260 0x7f0bb8039770 crc :-1 s=READY pgs=3757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.063 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.076+0000 7f0bd239b640 1 --2- 172.21.15.53:0/741249216 >> v2:172.21.15.53:6805/3736905990 conn(0x187b9c0 0x17e5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:55.064 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.079+0000 7f0bd239b640 1 --2- 172.21.15.53:0/741249216 >> v2:172.21.15.53:6805/3736905990 conn(0x187b9c0 0x17e5990 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.266+0000 7f0bd239b640 1 -- 172.21.15.53:0/741249216 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(1 obj3 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0bbc00c430 con 0x187b9c0 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.266+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 >> v2:172.21.15.53:6805/3736905990 conn(0x187b9c0 msgr2=0x17e5990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 --2- 172.21.15.53:0/741249216 >> v2:172.21.15.53:6805/3736905990 conn(0x187b9c0 0x17e5990 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0bb8037260 msgr2=0x7f0bb8039770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 --2- 172.21.15.53:0/741249216 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0bb8037260 0x7f0bb8039770 crc :-1 s=READY pgs=3757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 msgr2=0x17e4f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 --2- 172.21.15.53:0/741249216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x17e4f40 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 shutdown_connections 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 --2- 172.21.15.53:0/741249216 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f0bb8037260 0x7f0bb8039770 unknown :-1 s=CLOSED pgs=3757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 --2- 172.21.15.53:0/741249216 >> v2:172.21.15.53:6805/3736905990 conn(0x187b9c0 0x17e5990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 --2- 172.21.15.53:0/741249216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x17e9450 0x17e4f40 unknown :-1 s=CLOSED pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 >> 172.21.15.53:0/741249216 conn(0x1705960 msgr2=0x17e2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 shutdown_connections 2024-04-25T09:27:55.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.267+0000 7f0bd9ee3ec0 1 -- 172.21.15.53:0/741249216 wait complete. 2024-04-25T09:27:55.254 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:55.255 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj4 /etc/passwd 2024-04-25T09:27:55.295 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.310+0000 7f795d4dfec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.301 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.316+0000 7f795d4dfec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.301 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.316+0000 7f795d4dfec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.302 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.317+0000 7f795d4dfec0 1 Processor -- start 2024-04-25T09:27:55.302 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.317+0000 7f795d4dfec0 1 -- start start 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.319+0000 7f795d4dfec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x2166550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.319+0000 7f795d4dfec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x203b950 con 0x20d5a40 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.319+0000 7f795599b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x2166550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.319+0000 7f795599b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x2166550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35150/0 (socket says 172.21.15.53:35150) 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.319+0000 7f795599b640 1 -- 172.21.15.53:0/2661704086 learned_addr learned my addr 172.21.15.53:0/2661704086 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.319+0000 7f795599b640 1 -- 172.21.15.53:0/2661704086 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1fda1e0 con 0x20d5a40 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.319+0000 7f795599b640 1 --2- 172.21.15.53:0/2661704086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x2166550 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6af78c739ae01a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f794f7fe640 1 -- 172.21.15.53:0/2661704086 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f794000a040 con 0x20d5a40 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f794f7fe640 1 -- 172.21.15.53:0/2661704086 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f794000a1a0 con 0x20d5a40 2024-04-25T09:27:55.305 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f794f7fe640 1 -- 172.21.15.53:0/2661704086 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7940006820 con 0x20d5a40 2024-04-25T09:27:55.307 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2661704086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 msgr2=0x2166550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.307 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f795d4dfec0 1 --2- 172.21.15.53:0/2661704086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x2166550 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.307 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2661704086 shutdown_connections 2024-04-25T09:27:55.307 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f795d4dfec0 1 --2- 172.21.15.53:0/2661704086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x2166550 unknown :-1 s=CLOSED pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.307 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2661704086 >> 172.21.15.53:0/2661704086 conn(0x1ff2960 msgr2=0x20cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.307 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2661704086 shutdown_connections 2024-04-25T09:27:55.307 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.320+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2661704086 wait complete. 2024-04-25T09:27:55.307 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.321+0000 7f795d4dfec0 1 Processor -- start 2024-04-25T09:27:55.307 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.321+0000 7f795d4dfec0 1 -- start start 2024-04-25T09:27:55.309 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.323+0000 7f795d4dfec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x21f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.309 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.323+0000 7f795d4dfec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x20393d0 con 0x20d5a40 2024-04-25T09:27:55.309 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.323+0000 7f795599b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x21f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.309 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.323+0000 7f795599b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x21f6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35156/0 (socket says 172.21.15.53:35156) 2024-04-25T09:27:55.309 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.323+0000 7f795599b640 1 -- 172.21.15.53:0/2530182173 learned_addr learned my addr 172.21.15.53:0/2530182173 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.309 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.323+0000 7f795599b640 1 -- 172.21.15.53:0/2530182173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1fcce30 con 0x20d5a40 2024-04-25T09:27:55.309 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.323+0000 7f795599b640 1 --2- 172.21.15.53:0/2530182173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x21f6af0 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.309 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.324+0000 7f794e7fc640 1 -- 172.21.15.53:0/2530182173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7940035520 con 0x20d5a40 2024-04-25T09:27:55.310 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.324+0000 7f794e7fc640 1 -- 172.21.15.53:0/2530182173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7940035680 con 0x20d5a40 2024-04-25T09:27:55.310 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.324+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1fcc890 con 0x20d5a40 2024-04-25T09:27:55.310 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.324+0000 7f794e7fc640 1 -- 172.21.15.53:0/2530182173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7940035920 con 0x20d5a40 2024-04-25T09:27:55.310 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.324+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2151e70 con 0x20d5a40 2024-04-25T09:27:55.311 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.325+0000 7f794e7fc640 1 -- 172.21.15.53:0/2530182173 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f7940035ad0 con 0x20d5a40 2024-04-25T09:27:55.311 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.325+0000 7f794e7fc640 1 --2- 172.21.15.53:0/2530182173 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7930037210 0x7f7930039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.311 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.325+0000 7f794e7fc640 1 -- 172.21.15.53:0/2530182173 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7f794002e040 con 0x20d5a40 2024-04-25T09:27:55.311 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.325+0000 7f795d4dfec0 1 --2- 172.21.15.53:0/2530182173 >> v2:172.21.15.151:6806/46311736 conn(0x2167aa0 0x21fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.311 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.325+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 --> v2:172.21.15.151:6806/46311736 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x21ff330 con 0x2167aa0 2024-04-25T09:27:55.311 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.325+0000 7f795519a640 1 --2- 172.21.15.53:0/2530182173 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7930037210 0x7f7930039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.311 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.326+0000 7f795519a640 1 --2- 172.21.15.53:0/2530182173 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7930037210 0x7f7930039720 crc :-1 s=READY pgs=3758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.311 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.326+0000 7f795619c640 1 --2- 172.21.15.53:0/2530182173 >> v2:172.21.15.151:6806/46311736 conn(0x2167aa0 0x21fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:55.314 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.330+0000 7f795619c640 1 --2- 172.21.15.53:0/2530182173 >> v2:172.21.15.151:6806/46311736 conn(0x2167aa0 0x21fedf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.327 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795619c640 1 -- 172.21.15.53:0/2530182173 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== osd_op_reply(1 obj4 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f794800a430 con 0x2167aa0 2024-04-25T09:27:55.327 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 >> v2:172.21.15.151:6806/46311736 conn(0x2167aa0 msgr2=0x21fedf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.327 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 --2- 172.21.15.53:0/2530182173 >> v2:172.21.15.151:6806/46311736 conn(0x2167aa0 0x21fedf0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.327 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7930037210 msgr2=0x7f7930039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.327 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 --2- 172.21.15.53:0/2530182173 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7930037210 0x7f7930039720 crc :-1 s=READY pgs=3758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.327 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 msgr2=0x21f6af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.327 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 --2- 172.21.15.53:0/2530182173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x21f6af0 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.328 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 shutdown_connections 2024-04-25T09:27:55.328 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 --2- 172.21.15.53:0/2530182173 >> v2:172.21.15.151:6806/46311736 conn(0x2167aa0 0x21fedf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.328 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 --2- 172.21.15.53:0/2530182173 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f7930037210 0x7f7930039720 unknown :-1 s=CLOSED pgs=3758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.328 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 --2- 172.21.15.53:0/2530182173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x20d5a40 0x21f6af0 unknown :-1 s=CLOSED pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.328 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 >> 172.21.15.53:0/2530182173 conn(0x1ff2960 msgr2=0x20cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.328 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 shutdown_connections 2024-04-25T09:27:55.328 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.341+0000 7f795d4dfec0 1 -- 172.21.15.53:0/2530182173 wait complete. 2024-04-25T09:27:55.329 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:55.329 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj5 /etc/passwd 2024-04-25T09:27:55.365 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.380+0000 7f9c7163eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.371 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.386+0000 7f9c7163eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.371 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.386+0000 7f9c7163eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.372 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.387+0000 7f9c7163eec0 1 Processor -- start 2024-04-25T09:27:55.372 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.387+0000 7f9c7163eec0 1 -- start start 2024-04-25T09:27:55.374 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.388+0000 7f9c7163eec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xb68270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.388+0000 7f9c7163eec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0xad4950 con 0xc019c0 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.388+0000 7f9c6979b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xb68270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.388+0000 7f9c6979b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xb68270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35170/0 (socket says 172.21.15.53:35170) 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.388+0000 7f9c6979b640 1 -- 172.21.15.53:0/4264270028 learned_addr learned my addr 172.21.15.53:0/4264270028 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c6979b640 1 -- 172.21.15.53:0/4264270028 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa731e0 con 0xc019c0 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c6979b640 1 --2- 172.21.15.53:0/4264270028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xb68270 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f299a78741288ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c62ffd640 1 -- 172.21.15.53:0/4264270028 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9c5400b500 con 0xc019c0 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c62ffd640 1 -- 172.21.15.53:0/4264270028 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9c5400b660 con 0xc019c0 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c62ffd640 1 -- 172.21.15.53:0/4264270028 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9c5400b900 con 0xc019c0 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c7163eec0 1 -- 172.21.15.53:0/4264270028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 msgr2=0xb68270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c7163eec0 1 --2- 172.21.15.53:0/4264270028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xb68270 crc :-1 s=READY pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c7163eec0 1 -- 172.21.15.53:0/4264270028 shutdown_connections 2024-04-25T09:27:55.376 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c7163eec0 1 --2- 172.21.15.53:0/4264270028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xb68270 unknown :-1 s=CLOSED pgs=12874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.376 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.389+0000 7f9c7163eec0 1 -- 172.21.15.53:0/4264270028 >> 172.21.15.53:0/4264270028 conn(0xa8b960 msgr2=0xbff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.376 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.390+0000 7f9c7163eec0 1 -- 172.21.15.53:0/4264270028 shutdown_connections 2024-04-25T09:27:55.376 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.390+0000 7f9c7163eec0 1 -- 172.21.15.53:0/4264270028 wait complete. 2024-04-25T09:27:55.376 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.390+0000 7f9c7163eec0 1 Processor -- start 2024-04-25T09:27:55.376 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.391+0000 7f9c7163eec0 1 -- start start 2024-04-25T09:27:55.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.392+0000 7f9c7163eec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xbec190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.392+0000 7f9c7163eec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0xad23d0 con 0xc019c0 2024-04-25T09:27:55.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.392+0000 7f9c6979b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xbec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.392+0000 7f9c6979b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xbec190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35184/0 (socket says 172.21.15.53:35184) 2024-04-25T09:27:55.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.392+0000 7f9c6979b640 1 -- 172.21.15.53:0/358087316 learned_addr learned my addr 172.21.15.53:0/358087316 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.392+0000 7f9c6979b640 1 -- 172.21.15.53:0/358087316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa65e30 con 0xc019c0 2024-04-25T09:27:55.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.392+0000 7f9c6979b640 1 --2- 172.21.15.53:0/358087316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xbec190 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.378 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.393+0000 7f9c61ffb640 1 -- 172.21.15.53:0/358087316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9c540111e0 con 0xc019c0 2024-04-25T09:27:55.379 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.393+0000 7f9c61ffb640 1 -- 172.21.15.53:0/358087316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9c54011ab0 con 0xc019c0 2024-04-25T09:27:55.379 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.393+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xa65890 con 0xc019c0 2024-04-25T09:27:55.379 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.393+0000 7f9c61ffb640 1 -- 172.21.15.53:0/358087316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9c54011c20 con 0xc019c0 2024-04-25T09:27:55.379 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.393+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0xbef600 con 0xc019c0 2024-04-25T09:27:55.380 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.394+0000 7f9c61ffb640 1 -- 172.21.15.53:0/358087316 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9c5400f450 con 0xc019c0 2024-04-25T09:27:55.380 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.394+0000 7f9c61ffb640 1 --2- 172.21.15.53:0/358087316 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9c500371c0 0x7f9c500396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.380 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.394+0000 7f9c61ffb640 1 -- 172.21.15.53:0/358087316 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7f9c54048c50 con 0xc019c0 2024-04-25T09:27:55.380 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.394+0000 7f9c7163eec0 1 --2- 172.21.15.53:0/358087316 >> v2:172.21.15.151:6806/46311736 conn(0xc04800 0x109aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.380 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.394+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 --> v2:172.21.15.151:6806/46311736 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0xbefd10 con 0xc04800 2024-04-25T09:27:55.380 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.394+0000 7f9c68f9a640 1 --2- 172.21.15.53:0/358087316 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9c500371c0 0x7f9c500396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.380 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.395+0000 7f9c68f9a640 1 --2- 172.21.15.53:0/358087316 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9c500371c0 0x7f9c500396d0 crc :-1 s=READY pgs=3759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.380 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.395+0000 7f9c69f9c640 1 --2- 172.21.15.53:0/358087316 >> v2:172.21.15.151:6806/46311736 conn(0xc04800 0x109aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:55.382 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.398+0000 7f9c69f9c640 1 --2- 172.21.15.53:0/358087316 >> v2:172.21.15.151:6806/46311736 conn(0xc04800 0x109aa20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c69f9c640 1 -- 172.21.15.53:0/358087316 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== osd_op_reply(1 obj5 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9c5c00a430 con 0xc04800 2024-04-25T09:27:55.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 >> v2:172.21.15.151:6806/46311736 conn(0xc04800 msgr2=0x109aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 --2- 172.21.15.53:0/358087316 >> v2:172.21.15.151:6806/46311736 conn(0xc04800 0x109aa20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9c500371c0 msgr2=0x7f9c500396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 --2- 172.21.15.53:0/358087316 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9c500371c0 0x7f9c500396d0 crc :-1 s=READY pgs=3759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 msgr2=0xbec190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 --2- 172.21.15.53:0/358087316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xbec190 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 shutdown_connections 2024-04-25T09:27:55.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 --2- 172.21.15.53:0/358087316 >> v2:172.21.15.151:6806/46311736 conn(0xc04800 0x109aa20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 --2- 172.21.15.53:0/358087316 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9c500371c0 0x7f9c500396d0 unknown :-1 s=CLOSED pgs=3759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 --2- 172.21.15.53:0/358087316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xc019c0 0xbec190 unknown :-1 s=CLOSED pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 >> 172.21.15.53:0/358087316 conn(0xa8b960 msgr2=0xb6a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 shutdown_connections 2024-04-25T09:27:55.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.408+0000 7f9c7163eec0 1 -- 172.21.15.53:0/358087316 wait complete. 2024-04-25T09:27:55.395 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:55.396 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj6 /etc/passwd 2024-04-25T09:27:55.433 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.448+0000 7fa6e223bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.438 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.454+0000 7fa6e223bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.439 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.454+0000 7fa6e223bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.439 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.455+0000 7fa6e223bec0 1 Processor -- start 2024-04-25T09:27:55.440 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.455+0000 7fa6e223bec0 1 -- start start 2024-04-25T09:27:55.442 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.456+0000 7fa6e223bec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.442 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.456+0000 7fa6e223bec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x10a5950 con 0x113dcb0 2024-04-25T09:27:55.442 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.456+0000 7fa6da39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.442 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.456+0000 7fa6da39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35196/0 (socket says 172.21.15.53:35196) 2024-04-25T09:27:55.442 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.456+0000 7fa6da39b640 1 -- 172.21.15.53:0/2474539964 learned_addr learned my addr 172.21.15.53:0/2474539964 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.442 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.456+0000 7fa6da39b640 1 -- 172.21.15.53:0/2474539964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x10441e0 con 0x113dcb0 2024-04-25T09:27:55.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6da39b640 1 --2- 172.21.15.53:0/2474539964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11d1c70 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc85897773f54552 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6d8b98640 1 -- 172.21.15.53:0/2474539964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa6c400c490 con 0x113dcb0 2024-04-25T09:27:55.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6d8b98640 1 -- 172.21.15.53:0/2474539964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa6c400c5f0 con 0x113dcb0 2024-04-25T09:27:55.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6d8b98640 1 -- 172.21.15.53:0/2474539964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa6c400c890 con 0x113dcb0 2024-04-25T09:27:55.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2474539964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 msgr2=0x11d1c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6e223bec0 1 --2- 172.21.15.53:0/2474539964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11d1c70 crc :-1 s=READY pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2474539964 shutdown_connections 2024-04-25T09:27:55.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6e223bec0 1 --2- 172.21.15.53:0/2474539964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11d1c70 unknown :-1 s=CLOSED pgs=12878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2474539964 >> 172.21.15.53:0/2474539964 conn(0x105c960 msgr2=0x1142e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2474539964 shutdown_connections 2024-04-25T09:27:55.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.457+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2474539964 wait complete. 2024-04-25T09:27:55.445 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.458+0000 7fa6e223bec0 1 Processor -- start 2024-04-25T09:27:55.445 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.458+0000 7fa6e223bec0 1 -- start start 2024-04-25T09:27:55.446 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.460+0000 7fa6e223bec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11baf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.446 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.460+0000 7fa6e223bec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x10a33d0 con 0x113dcb0 2024-04-25T09:27:55.446 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.460+0000 7fa6da39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.446 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.460+0000 7fa6da39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11baf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35210/0 (socket says 172.21.15.53:35210) 2024-04-25T09:27:55.447 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.460+0000 7fa6da39b640 1 -- 172.21.15.53:0/2730515321 learned_addr learned my addr 172.21.15.53:0/2730515321 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.447 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.460+0000 7fa6da39b640 1 -- 172.21.15.53:0/2730515321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1036e30 con 0x113dcb0 2024-04-25T09:27:55.447 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.460+0000 7fa6da39b640 1 --2- 172.21.15.53:0/2730515321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11baf10 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.447 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.461+0000 7fa6d2ffd640 1 -- 172.21.15.53:0/2730515321 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa6c4016040 con 0x113dcb0 2024-04-25T09:27:55.447 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.461+0000 7fa6d2ffd640 1 -- 172.21.15.53:0/2730515321 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa6c4011a00 con 0x113dcb0 2024-04-25T09:27:55.447 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.461+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1036890 con 0x113dcb0 2024-04-25T09:27:55.447 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.461+0000 7fa6d2ffd640 1 -- 172.21.15.53:0/2730515321 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa6c4011ca0 con 0x113dcb0 2024-04-25T09:27:55.447 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.461+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x11d7e60 con 0x113dcb0 2024-04-25T09:27:55.448 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.462+0000 7fa6d2ffd640 1 -- 172.21.15.53:0/2730515321 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa6c400e440 con 0x113dcb0 2024-04-25T09:27:55.448 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.462+0000 7fa6d2ffd640 1 --2- 172.21.15.53:0/2730515321 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa6c0037210 0x7fa6c0039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.448 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.462+0000 7fa6d2ffd640 1 -- 172.21.15.53:0/2730515321 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7fa6c4048f00 con 0x113dcb0 2024-04-25T09:27:55.449 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.462+0000 7fa6d9b9a640 1 --2- 172.21.15.53:0/2730515321 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa6c0037210 0x7fa6c0039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.449 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.462+0000 7fa6e223bec0 1 --2- 172.21.15.53:0/2730515321 >> v2:172.21.15.53:6805/3736905990 conn(0x11d3950 0x11d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.449 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.462+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x11c1d60 con 0x11d3950 2024-04-25T09:27:55.449 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.463+0000 7fa6d9b9a640 1 --2- 172.21.15.53:0/2730515321 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa6c0037210 0x7fa6c0039720 crc :-1 s=READY pgs=3760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.449 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.463+0000 7fa6dab9c640 1 --2- 172.21.15.53:0/2730515321 >> v2:172.21.15.53:6805/3736905990 conn(0x11d3950 0x11d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:55.451 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.467+0000 7fa6dab9c640 1 --2- 172.21.15.53:0/2730515321 >> v2:172.21.15.53:6805/3736905990 conn(0x11d3950 0x11d0750 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.477+0000 7fa6dab9c640 1 -- 172.21.15.53:0/2730515321 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(1 obj6 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa6cc00a430 con 0x11d3950 2024-04-25T09:27:55.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.477+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 >> v2:172.21.15.53:6805/3736905990 conn(0x11d3950 msgr2=0x11d0750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.477+0000 7fa6e223bec0 1 --2- 172.21.15.53:0/2730515321 >> v2:172.21.15.53:6805/3736905990 conn(0x11d3950 0x11d0750 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.477+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa6c0037210 msgr2=0x7fa6c0039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.477+0000 7fa6e223bec0 1 --2- 172.21.15.53:0/2730515321 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa6c0037210 0x7fa6c0039720 crc :-1 s=READY pgs=3760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.478+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 msgr2=0x11baf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.478+0000 7fa6e223bec0 1 --2- 172.21.15.53:0/2730515321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11baf10 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.478+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 shutdown_connections 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.478+0000 7fa6e223bec0 1 --2- 172.21.15.53:0/2730515321 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa6c0037210 0x7fa6c0039720 unknown :-1 s=CLOSED pgs=3760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.478+0000 7fa6e223bec0 1 --2- 172.21.15.53:0/2730515321 >> v2:172.21.15.53:6805/3736905990 conn(0x11d3950 0x11d0750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.478+0000 7fa6e223bec0 1 --2- 172.21.15.53:0/2730515321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x113dcb0 0x11baf10 unknown :-1 s=CLOSED pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.478+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 >> 172.21.15.53:0/2730515321 conn(0x105c960 msgr2=0x1142e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.478+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 shutdown_connections 2024-04-25T09:27:55.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.478+0000 7fa6e223bec0 1 -- 172.21.15.53:0/2730515321 wait complete. 2024-04-25T09:27:55.465 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:55.465 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj7 /etc/passwd 2024-04-25T09:27:55.503 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.517+0000 7fd49c12eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.507 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.522+0000 7fd49c12eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.508 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.523+0000 7fd49c12eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.508 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.523+0000 7fd49c12eec0 1 Processor -- start 2024-04-25T09:27:55.508 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.523+0000 7fd49c12eec0 1 -- start start 2024-04-25T09:27:55.510 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.525+0000 7fd49c12eec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xc86500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.510 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.525+0000 7fd49c12eec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0xad3950 con 0xb6e450 2024-04-25T09:27:55.511 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.525+0000 7fd48f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xc86500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.511 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.525+0000 7fd48f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xc86500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35222/0 (socket says 172.21.15.53:35222) 2024-04-25T09:27:55.511 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.525+0000 7fd48f7fe640 1 -- 172.21.15.53:0/3449039816 learned_addr learned my addr 172.21.15.53:0/3449039816 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.511 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.525+0000 7fd48f7fe640 1 -- 172.21.15.53:0/3449039816 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa721e0 con 0xb6e450 2024-04-25T09:27:55.511 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.525+0000 7fd48f7fe640 1 --2- 172.21.15.53:0/3449039816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xc86500 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a0f89ab7bfa25d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.511 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.525+0000 7fd48dffb640 1 -- 172.21.15.53:0/3449039816 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd48802fb00 con 0xb6e450 2024-04-25T09:27:55.511 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.526+0000 7fd48dffb640 1 -- 172.21.15.53:0/3449039816 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd48802fc60 con 0xb6e450 2024-04-25T09:27:55.511 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.526+0000 7fd48dffb640 1 -- 172.21.15.53:0/3449039816 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd488034410 con 0xb6e450 2024-04-25T09:27:55.512 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.526+0000 7fd49c12eec0 1 -- 172.21.15.53:0/3449039816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 msgr2=0xc86500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.512 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.526+0000 7fd49c12eec0 1 --2- 172.21.15.53:0/3449039816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xc86500 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.512 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.526+0000 7fd49c12eec0 1 -- 172.21.15.53:0/3449039816 shutdown_connections 2024-04-25T09:27:55.512 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.526+0000 7fd49c12eec0 1 --2- 172.21.15.53:0/3449039816 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xc86500 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.512 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.526+0000 7fd49c12eec0 1 -- 172.21.15.53:0/3449039816 >> 172.21.15.53:0/3449039816 conn(0xa8a960 msgr2=0xb67a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.512 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.526+0000 7fd49c12eec0 1 -- 172.21.15.53:0/3449039816 shutdown_connections 2024-04-25T09:27:55.513 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.526+0000 7fd49c12eec0 1 -- 172.21.15.53:0/3449039816 wait complete. 2024-04-25T09:27:55.513 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.527+0000 7fd49c12eec0 1 Processor -- start 2024-04-25T09:27:55.513 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.527+0000 7fd49c12eec0 1 -- start start 2024-04-25T09:27:55.514 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd49c12eec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xbea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd49c12eec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0xad13d0 con 0xb6e450 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd48f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xbea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd48f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xbea0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35228/0 (socket says 172.21.15.53:35228) 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd48f7fe640 1 -- 172.21.15.53:0/2979280402 learned_addr learned my addr 172.21.15.53:0/2979280402 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd48f7fe640 1 -- 172.21.15.53:0/2979280402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa64e30 con 0xb6e450 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd48f7fe640 1 --2- 172.21.15.53:0/2979280402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xbea0e0 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd48cff9640 1 -- 172.21.15.53:0/2979280402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd488034ad0 con 0xb6e450 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd48cff9640 1 -- 172.21.15.53:0/2979280402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd488034c30 con 0xb6e450 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xa64890 con 0xb6e450 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd48cff9640 1 -- 172.21.15.53:0/2979280402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd488033400 con 0xb6e450 2024-04-25T09:27:55.515 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.529+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0xbec7d0 con 0xb6e450 2024-04-25T09:27:55.516 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.530+0000 7fd48cff9640 1 -- 172.21.15.53:0/2979280402 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fd48803c040 con 0xb6e450 2024-04-25T09:27:55.516 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.531+0000 7fd48cff9640 1 --2- 172.21.15.53:0/2979280402 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd47c037210 0x7fd47c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.517 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.531+0000 7fd48cff9640 1 -- 172.21.15.53:0/2979280402 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7fd488039040 con 0xb6e450 2024-04-25T09:27:55.517 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.531+0000 7fd49c12eec0 1 --2- 172.21.15.53:0/2979280402 >> v2:172.21.15.53:6801/3778022725 conn(0xc009c0 0xbfcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.517 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.531+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 --> v2:172.21.15.53:6801/3778022725 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0xb677f0 con 0xc009c0 2024-04-25T09:27:55.517 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.531+0000 7fd48effd640 1 --2- 172.21.15.53:0/2979280402 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd47c037210 0x7fd47c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.517 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.531+0000 7fd48effd640 1 --2- 172.21.15.53:0/2979280402 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd47c037210 0x7fd47c039720 crc :-1 s=READY pgs=3761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.517 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.532+0000 7fd494d9c640 1 --2- 172.21.15.53:0/2979280402 >> v2:172.21.15.53:6801/3778022725 conn(0xc009c0 0xbfcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:55.519 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.534+0000 7fd494d9c640 1 --2- 172.21.15.53:0/2979280402 >> v2:172.21.15.53:6801/3778022725 conn(0xc009c0 0xbfcac0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd494d9c640 1 -- 172.21.15.53:0/2979280402 <== osd.0 v2:172.21.15.53:6801/3778022725 1 ==== osd_op_reply(1 obj7 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd48000c430 con 0xc009c0 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 >> v2:172.21.15.53:6801/3778022725 conn(0xc009c0 msgr2=0xbfcac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 --2- 172.21.15.53:0/2979280402 >> v2:172.21.15.53:6801/3778022725 conn(0xc009c0 0xbfcac0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd47c037210 msgr2=0x7fd47c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 --2- 172.21.15.53:0/2979280402 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd47c037210 0x7fd47c039720 crc :-1 s=READY pgs=3761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 msgr2=0xbea0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 --2- 172.21.15.53:0/2979280402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xbea0e0 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 shutdown_connections 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 --2- 172.21.15.53:0/2979280402 >> v2:172.21.15.53:6801/3778022725 conn(0xc009c0 0xbfcac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.881 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 --2- 172.21.15.53:0/2979280402 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd47c037210 0x7fd47c039720 unknown :-1 s=CLOSED pgs=3761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.882 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 --2- 172.21.15.53:0/2979280402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xb6e450 0xbea0e0 unknown :-1 s=CLOSED pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.882 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 >> 172.21.15.53:0/2979280402 conn(0xa8a960 msgr2=0xb70940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.882 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 shutdown_connections 2024-04-25T09:27:55.882 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.895+0000 7fd49c12eec0 1 -- 172.21.15.53:0/2979280402 wait complete. 2024-04-25T09:27:55.882 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:55.882 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj8 /etc/passwd 2024-04-25T09:27:55.919 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.934+0000 7fa014a30ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.924 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.939+0000 7fa014a30ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.924 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.939+0000 7fa014a30ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.925 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.940+0000 7fa014a30ec0 1 Processor -- start 2024-04-25T09:27:55.925 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.940+0000 7fa014a30ec0 1 -- start start 2024-04-25T09:27:55.927 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa014a30ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x10944b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.928 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa014a30ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1001950 con 0x1081750 2024-04-25T09:27:55.928 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa00cb9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x10944b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.928 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa00cb9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x10944b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35236/0 (socket says 172.21.15.53:35236) 2024-04-25T09:27:55.928 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa00cb9b640 1 -- 172.21.15.53:0/3671390706 learned_addr learned my addr 172.21.15.53:0/3671390706 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.928 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa00cb9b640 1 -- 172.21.15.53:0/3671390706 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xfa01e0 con 0x1081750 2024-04-25T09:27:55.928 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa00cb9b640 1 --2- 172.21.15.53:0/3671390706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x10944b0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2562112ffeb0a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.928 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa006ffd640 1 -- 172.21.15.53:0/3671390706 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ff800d7e0 con 0x1081750 2024-04-25T09:27:55.928 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa006ffd640 1 -- 172.21.15.53:0/3671390706 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9ff800d940 con 0x1081750 2024-04-25T09:27:55.928 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.942+0000 7fa006ffd640 1 -- 172.21.15.53:0/3671390706 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ff800dbe0 con 0x1081750 2024-04-25T09:27:55.929 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.943+0000 7fa014a30ec0 1 -- 172.21.15.53:0/3671390706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 msgr2=0x10944b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.929 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.943+0000 7fa014a30ec0 1 --2- 172.21.15.53:0/3671390706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x10944b0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.929 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.943+0000 7fa014a30ec0 1 -- 172.21.15.53:0/3671390706 shutdown_connections 2024-04-25T09:27:55.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.943+0000 7fa014a30ec0 1 --2- 172.21.15.53:0/3671390706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x10944b0 unknown :-1 s=CLOSED pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.943+0000 7fa014a30ec0 1 -- 172.21.15.53:0/3671390706 >> 172.21.15.53:0/3671390706 conn(0xfb8960 msgr2=0x1131c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.943+0000 7fa014a30ec0 1 -- 172.21.15.53:0/3671390706 shutdown_connections 2024-04-25T09:27:55.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.943+0000 7fa014a30ec0 1 -- 172.21.15.53:0/3671390706 wait complete. 2024-04-25T09:27:55.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.944+0000 7fa014a30ec0 1 Processor -- start 2024-04-25T09:27:55.930 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.944+0000 7fa014a30ec0 1 -- start start 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa014a30ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x11c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa014a30ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0xfff3d0 con 0x1081750 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa00cb9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x11c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa00cb9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x11c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35252/0 (socket says 172.21.15.53:35252) 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa00cb9b640 1 -- 172.21.15.53:0/523377520 learned_addr learned my addr 172.21.15.53:0/523377520 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa00cb9b640 1 -- 172.21.15.53:0/523377520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf92e30 con 0x1081750 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa00cb9b640 1 --2- 172.21.15.53:0/523377520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x11c4fc0 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa005ffb640 1 -- 172.21.15.53:0/523377520 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ff8012040 con 0x1081750 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa005ffb640 1 -- 172.21.15.53:0/523377520 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9ff8005040 con 0x1081750 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xf92890 con 0x1081750 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa005ffb640 1 -- 172.21.15.53:0/523377520 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9ff80082a0 con 0x1081750 2024-04-25T09:27:55.932 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.946+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1120ea0 con 0x1081750 2024-04-25T09:27:55.934 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.947+0000 7fa005ffb640 1 -- 172.21.15.53:0/523377520 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9ff8008450 con 0x1081750 2024-04-25T09:27:55.934 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.948+0000 7fa005ffb640 1 --2- 172.21.15.53:0/523377520 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9fe8037210 0x7f9fe8039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.934 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.948+0000 7fa005ffb640 1 -- 172.21.15.53:0/523377520 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7f9ff8048220 con 0x1081750 2024-04-25T09:27:55.934 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.948+0000 7fa014a30ec0 1 --2- 172.21.15.53:0/523377520 >> v2:172.21.15.53:6801/3778022725 conn(0x109aeb0 0x11c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.934 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.948+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 --> v2:172.21.15.53:6801/3778022725 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x11c8350 con 0x109aeb0 2024-04-25T09:27:55.934 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.948+0000 7f9ffffff640 1 --2- 172.21.15.53:0/523377520 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9fe8037210 0x7f9fe8039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.934 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.948+0000 7f9ffffff640 1 --2- 172.21.15.53:0/523377520 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9fe8037210 0x7f9fe8039720 crc :-1 s=READY pgs=3762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.934 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.949+0000 7fa00d39c640 1 --2- 172.21.15.53:0/523377520 >> v2:172.21.15.53:6801/3778022725 conn(0x109aeb0 0x11c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:55.937 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.952+0000 7fa00d39c640 1 --2- 172.21.15.53:0/523377520 >> v2:172.21.15.53:6801/3778022725 conn(0x109aeb0 0x11c7e10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.949 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.963+0000 7fa00d39c640 1 -- 172.21.15.53:0/523377520 <== osd.0 v2:172.21.15.53:6801/3778022725 1 ==== osd_op_reply(1 obj8 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa00000a430 con 0x109aeb0 2024-04-25T09:27:55.949 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.963+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 >> v2:172.21.15.53:6801/3778022725 conn(0x109aeb0 msgr2=0x11c7e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.949 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.963+0000 7fa014a30ec0 1 --2- 172.21.15.53:0/523377520 >> v2:172.21.15.53:6801/3778022725 conn(0x109aeb0 0x11c7e10 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.949 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9fe8037210 msgr2=0x7f9fe8039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.949 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 --2- 172.21.15.53:0/523377520 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9fe8037210 0x7f9fe8039720 crc :-1 s=READY pgs=3762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.949 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 msgr2=0x11c4fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.949 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 --2- 172.21.15.53:0/523377520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x11c4fc0 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.950 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 shutdown_connections 2024-04-25T09:27:55.950 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 --2- 172.21.15.53:0/523377520 >> v2:172.21.15.53:6801/3778022725 conn(0x109aeb0 0x11c7e10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.950 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 --2- 172.21.15.53:0/523377520 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9fe8037210 0x7f9fe8039720 unknown :-1 s=CLOSED pgs=3762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.950 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 --2- 172.21.15.53:0/523377520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1081750 0x11c4fc0 unknown :-1 s=CLOSED pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.950 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 >> 172.21.15.53:0/523377520 conn(0xfb8960 msgr2=0x1131c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.950 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 shutdown_connections 2024-04-25T09:27:55.950 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:55.964+0000 7fa014a30ec0 1 -- 172.21.15.53:0/523377520 wait complete. 2024-04-25T09:27:55.951 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:55.951 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj9 /etc/passwd 2024-04-25T09:27:55.988 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.002+0000 7fb9f1845ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.993 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.008+0000 7fb9f1845ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.993 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.008+0000 7fb9f1845ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.994 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.009+0000 7fb9f1845ec0 1 Processor -- start 2024-04-25T09:27:55.994 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.009+0000 7fb9f1845ec0 1 -- start start 2024-04-25T09:27:55.996 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.011+0000 7fb9f1845ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1b7c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:55.996 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.011+0000 7fb9f1845ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x19c1950 con 0x1a5aed0 2024-04-25T09:27:55.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.011+0000 7fb9e999b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1b7c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:55.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.011+0000 7fb9e999b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1b7c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35272/0 (socket says 172.21.15.53:35272) 2024-04-25T09:27:55.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.011+0000 7fb9e999b640 1 -- 172.21.15.53:0/211083514 learned_addr learned my addr 172.21.15.53:0/211083514 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:55.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.011+0000 7fb9e999b640 1 -- 172.21.15.53:0/211083514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19601e0 con 0x1a5aed0 2024-04-25T09:27:55.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.011+0000 7fb9e999b640 1 --2- 172.21.15.53:0/211083514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1b7c7d0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd6c403c6668bab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:55.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.011+0000 7fb9e37fe640 1 -- 172.21.15.53:0/211083514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9d400a040 con 0x1a5aed0 2024-04-25T09:27:55.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.012+0000 7fb9e37fe640 1 -- 172.21.15.53:0/211083514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb9d400a1a0 con 0x1a5aed0 2024-04-25T09:27:55.997 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.012+0000 7fb9e37fe640 1 -- 172.21.15.53:0/211083514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9d402fb20 con 0x1a5aed0 2024-04-25T09:27:55.998 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.012+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/211083514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 msgr2=0x1b7c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:55.998 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.012+0000 7fb9f1845ec0 1 --2- 172.21.15.53:0/211083514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1b7c7d0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.998 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.012+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/211083514 shutdown_connections 2024-04-25T09:27:55.998 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.012+0000 7fb9f1845ec0 1 --2- 172.21.15.53:0/211083514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1b7c7d0 unknown :-1 s=CLOSED pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:55.998 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.012+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/211083514 >> 172.21.15.53:0/211083514 conn(0x1978960 msgr2=0x1a60320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:55.999 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.012+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/211083514 shutdown_connections 2024-04-25T09:27:55.999 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.012+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/211083514 wait complete. 2024-04-25T09:27:55.999 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.013+0000 7fb9f1845ec0 1 Processor -- start 2024-04-25T09:27:55.999 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.013+0000 7fb9f1845ec0 1 -- start start 2024-04-25T09:27:56.001 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9f1845ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1aec910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:56.001 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9f1845ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x19bf3d0 con 0x1a5aed0 2024-04-25T09:27:56.001 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9e999b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1aec910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:56.001 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9e999b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1aec910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35282/0 (socket says 172.21.15.53:35282) 2024-04-25T09:27:56.001 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9e999b640 1 -- 172.21.15.53:0/1778123330 learned_addr learned my addr 172.21.15.53:0/1778123330 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:56.001 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9e999b640 1 -- 172.21.15.53:0/1778123330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1952e30 con 0x1a5aed0 2024-04-25T09:27:56.002 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9e999b640 1 --2- 172.21.15.53:0/1778123330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1aec910 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:56.003 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9e27fc640 1 -- 172.21.15.53:0/1778123330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9d4036040 con 0x1a5aed0 2024-04-25T09:27:56.003 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9e27fc640 1 -- 172.21.15.53:0/1778123330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb9d400a310 con 0x1a5aed0 2024-04-25T09:27:56.003 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1952890 con 0x1a5aed0 2024-04-25T09:27:56.004 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.015+0000 7fb9e27fc640 1 -- 172.21.15.53:0/1778123330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9d402ecf0 con 0x1a5aed0 2024-04-25T09:27:56.004 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.016+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1ada880 con 0x1a5aed0 2024-04-25T09:27:56.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.016+0000 7fb9e27fc640 1 -- 172.21.15.53:0/1778123330 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb9d403b370 con 0x1a5aed0 2024-04-25T09:27:56.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.017+0000 7fb9e27fc640 1 --2- 172.21.15.53:0/1778123330 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb9d0037210 0x7fb9d0039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:56.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.017+0000 7fb9e27fc640 1 -- 172.21.15.53:0/1778123330 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7fb9d406bd40 con 0x1a5aed0 2024-04-25T09:27:56.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.017+0000 7fb9f1845ec0 1 --2- 172.21.15.53:0/1778123330 >> v2:172.21.15.151:6806/46311736 conn(0x1a5bca0 0x1ad95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:56.005 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.017+0000 7fb9e919a640 1 --2- 172.21.15.53:0/1778123330 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb9d0037210 0x7fb9d0039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:56.006 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.017+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 --> v2:172.21.15.151:6806/46311736 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1add010 con 0x1a5bca0 2024-04-25T09:27:56.006 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.017+0000 7fb9e919a640 1 --2- 172.21.15.53:0/1778123330 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb9d0037210 0x7fb9d0039720 crc :-1 s=READY pgs=3763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:56.006 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.018+0000 7fb9ea19c640 1 --2- 172.21.15.53:0/1778123330 >> v2:172.21.15.151:6806/46311736 conn(0x1a5bca0 0x1ad95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:56.006 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.022+0000 7fb9ea19c640 1 --2- 172.21.15.53:0/1778123330 >> v2:172.21.15.151:6806/46311736 conn(0x1a5bca0 0x1ad95f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9ea19c640 1 -- 172.21.15.53:0/1778123330 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== osd_op_reply(1 obj9 [writefull 0~11876] v688'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb9dc00a430 con 0x1a5bca0 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 >> v2:172.21.15.151:6806/46311736 conn(0x1a5bca0 msgr2=0x1ad95f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 --2- 172.21.15.53:0/1778123330 >> v2:172.21.15.151:6806/46311736 conn(0x1a5bca0 0x1ad95f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb9d0037210 msgr2=0x7fb9d0039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 --2- 172.21.15.53:0/1778123330 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb9d0037210 0x7fb9d0039720 crc :-1 s=READY pgs=3763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 msgr2=0x1aec910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 --2- 172.21.15.53:0/1778123330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1aec910 crc :-1 s=READY pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 shutdown_connections 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 --2- 172.21.15.53:0/1778123330 >> v2:172.21.15.151:6806/46311736 conn(0x1a5bca0 0x1ad95f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 --2- 172.21.15.53:0/1778123330 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb9d0037210 0x7fb9d0039720 unknown :-1 s=CLOSED pgs=3763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 --2- 172.21.15.53:0/1778123330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1a5aed0 0x1aec910 unknown :-1 s=CLOSED pgs=12891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.021 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 >> 172.21.15.53:0/1778123330 conn(0x1978960 msgr2=0x1b77490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:56.021 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 shutdown_connections 2024-04-25T09:27:56.021 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.034+0000 7fb9f1845ec0 1 -- 172.21.15.53:0/1778123330 wait complete. 2024-04-25T09:27:56.021 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:27:56.021 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put obj10 /etc/passwd 2024-04-25T09:27:56.057 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.072+0000 7f3ce2a37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:56.063 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.078+0000 7f3ce2a37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:56.063 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.078+0000 7f3ce2a37ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:56.064 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.079+0000 7f3ce2a37ec0 1 Processor -- start 2024-04-25T09:27:56.064 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.079+0000 7f3ce2a37ec0 1 -- start start 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.080+0000 7f3ce2a37ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1ed0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.080+0000 7f3ce2a37ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1d1f950 con 0x1db86a0 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.080+0000 7f3cdab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1ed0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.080+0000 7f3cdab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1ed0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35286/0 (socket says 172.21.15.53:35286) 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.080+0000 7f3cdab9b640 1 -- 172.21.15.53:0/967175244 learned_addr learned my addr 172.21.15.53:0/967175244 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3cdab9b640 1 -- 172.21.15.53:0/967175244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1cbe1e0 con 0x1db86a0 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3cdab9b640 1 --2- 172.21.15.53:0/967175244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1ed0450 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4455868c849416ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3cd9398640 1 -- 172.21.15.53:0/967175244 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3cc400a040 con 0x1db86a0 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3cd9398640 1 -- 172.21.15.53:0/967175244 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3cc4033040 con 0x1db86a0 2024-04-25T09:27:56.066 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3cd9398640 1 -- 172.21.15.53:0/967175244 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3cc400a2d0 con 0x1db86a0 2024-04-25T09:27:56.068 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/967175244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 msgr2=0x1ed0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:56.068 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3ce2a37ec0 1 --2- 172.21.15.53:0/967175244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1ed0450 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.068 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/967175244 shutdown_connections 2024-04-25T09:27:56.068 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3ce2a37ec0 1 --2- 172.21.15.53:0/967175244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1ed0450 unknown :-1 s=CLOSED pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.068 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.081+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/967175244 >> 172.21.15.53:0/967175244 conn(0x1cd6960 msgr2=0x1db1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:56.068 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.082+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/967175244 shutdown_connections 2024-04-25T09:27:56.068 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.082+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/967175244 wait complete. 2024-04-25T09:27:56.068 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.082+0000 7f3ce2a37ec0 1 Processor -- start 2024-04-25T09:27:56.068 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.083+0000 7f3ce2a37ec0 1 -- start start 2024-04-25T09:27:56.070 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.084+0000 7f3ce2a37ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1edf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:56.070 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.084+0000 7f3ce2a37ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1d1d3d0 con 0x1db86a0 2024-04-25T09:27:56.070 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.084+0000 7f3cdab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1edf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:56.070 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.084+0000 7f3cdab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1edf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:35288/0 (socket says 172.21.15.53:35288) 2024-04-25T09:27:56.070 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.084+0000 7f3cdab9b640 1 -- 172.21.15.53:0/2755662555 learned_addr learned my addr 172.21.15.53:0/2755662555 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:27:56.070 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.084+0000 7f3cdab9b640 1 -- 172.21.15.53:0/2755662555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1cb0e30 con 0x1db86a0 2024-04-25T09:27:56.070 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.084+0000 7f3cdab9b640 1 --2- 172.21.15.53:0/2755662555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1edf660 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:56.070 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.085+0000 7f3cd37fe640 1 -- 172.21.15.53:0/2755662555 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3cc402f990 con 0x1db86a0 2024-04-25T09:27:56.070 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.085+0000 7f3cd37fe640 1 -- 172.21.15.53:0/2755662555 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3cc402faf0 con 0x1db86a0 2024-04-25T09:27:56.071 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.085+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1cb0890 con 0x1db86a0 2024-04-25T09:27:56.071 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.085+0000 7f3cd37fe640 1 -- 172.21.15.53:0/2755662555 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3cc402fd90 con 0x1db86a0 2024-04-25T09:27:56.071 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.085+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1ebb340 con 0x1db86a0 2024-04-25T09:27:56.072 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.086+0000 7f3cd37fe640 1 -- 172.21.15.53:0/2755662555 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f3cc403a400 con 0x1db86a0 2024-04-25T09:27:56.072 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.086+0000 7f3cd37fe640 1 --2- 172.21.15.53:0/2755662555 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3cc00371c0 0x7f3cc00396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:56.072 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.086+0000 7f3cd37fe640 1 -- 172.21.15.53:0/2755662555 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(688..688 src has 401..688) ==== 3791+0+0 (crc 0 0 0) 0x7f3cc4032040 con 0x1db86a0 2024-04-25T09:27:56.072 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.086+0000 7f3ce2a37ec0 1 --2- 172.21.15.53:0/2755662555 >> v2:172.21.15.53:6801/3778022725 conn(0x1dba450 0x1eba040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:27:56.072 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.086+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 --> v2:172.21.15.53:6801/3778022725 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1ebdc40 con 0x1dba450 2024-04-25T09:27:56.072 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.086+0000 7f3cda39a640 1 --2- 172.21.15.53:0/2755662555 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3cc00371c0 0x7f3cc00396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:27:56.072 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.087+0000 7f3cda39a640 1 --2- 172.21.15.53:0/2755662555 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3cc00371c0 0x7f3cc00396d0 crc :-1 s=READY pgs=3764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:56.072 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.087+0000 7f3cdb39c640 1 --2- 172.21.15.53:0/2755662555 >> v2:172.21.15.53:6801/3778022725 conn(0x1dba450 0x1eba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:27:56.074 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.089+0000 7f3cdb39c640 1 --2- 172.21.15.53:0/2755662555 >> v2:172.21.15.53:6801/3778022725 conn(0x1dba450 0x1eba040 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:27:56.086 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3cdb39c640 1 -- 172.21.15.53:0/2755662555 <== osd.0 v2:172.21.15.53:6801/3778022725 1 ==== osd_op_reply(1 obj10 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3ccc00a430 con 0x1dba450 2024-04-25T09:27:56.086 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 >> v2:172.21.15.53:6801/3778022725 conn(0x1dba450 msgr2=0x1eba040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:56.086 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 --2- 172.21.15.53:0/2755662555 >> v2:172.21.15.53:6801/3778022725 conn(0x1dba450 0x1eba040 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.086 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3cc00371c0 msgr2=0x7f3cc00396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:56.086 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 --2- 172.21.15.53:0/2755662555 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3cc00371c0 0x7f3cc00396d0 crc :-1 s=READY pgs=3764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.086 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 msgr2=0x1edf660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:27:56.087 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 --2- 172.21.15.53:0/2755662555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1edf660 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.087 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 shutdown_connections 2024-04-25T09:27:56.087 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 --2- 172.21.15.53:0/2755662555 >> v2:172.21.15.53:6801/3778022725 conn(0x1dba450 0x1eba040 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.087 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 --2- 172.21.15.53:0/2755662555 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3cc00371c0 0x7f3cc00396d0 unknown :-1 s=CLOSED pgs=3764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.087 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 --2- 172.21.15.53:0/2755662555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1db86a0 0x1edf660 unknown :-1 s=CLOSED pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:27:56.087 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.100+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 >> 172.21.15.53:0/2755662555 conn(0x1cd6960 msgr2=0x1db1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:27:56.087 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.101+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 shutdown_connections 2024-04-25T09:27:56.087 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:27:56.101+0000 7f3ce2a37ec0 1 -- 172.21.15.53:0/2755662555 wait complete. 2024-04-25T09:27:56.088 INFO:tasks.workunit.client.0.smithi053.stderr:+ sleep 30 2024-04-25T09:28:26.091 INFO:tasks.workunit.client.0.smithi053.stderr:+ pid=96373 2024-04-25T09:28:26.091 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool set-quota c50b9a0b-a761-4651-b0e1-76fe43e4a63b max_objects 100 2024-04-25T09:28:26.091 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put onemore /etc/passwd 2024-04-25T09:28:26.136 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.151+0000 7fa56fa2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:26.143 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.158+0000 7fa56fa2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:26.143 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.158+0000 7fa56fa2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:26.144 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.159+0000 7fa56fa2dec0 1 Processor -- start 2024-04-25T09:28:26.144 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.159+0000 7fa56fa2dec0 1 -- start start 2024-04-25T09:28:26.146 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.161+0000 7fa56fa2dec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x262d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:26.147 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.161+0000 7fa56fa2dec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x2517950 con 0x25b2450 2024-04-25T09:28:26.147 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.162+0000 7fa562ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x262d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:26.147 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.162+0000 7fa562ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x262d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58968/0 (socket says 172.21.15.53:58968) 2024-04-25T09:28:26.147 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.162+0000 7fa562ffd640 1 -- 172.21.15.53:0/1834060324 learned_addr learned my addr 172.21.15.53:0/1834060324 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:28:26.148 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.162+0000 7fa562ffd640 1 -- 172.21.15.53:0/1834060324 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24b61e0 con 0x25b2450 2024-04-25T09:28:26.148 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.162+0000 7fa562ffd640 1 --2- 172.21.15.53:0/1834060324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x262d090 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3ce791881e2b11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:26.148 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.162+0000 7fa5617fa640 1 -- 172.21.15.53:0/1834060324 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa55400a040 con 0x25b2450 2024-04-25T09:28:26.148 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.163+0000 7fa5617fa640 1 -- 172.21.15.53:0/1834060324 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa55400a1a0 con 0x25b2450 2024-04-25T09:28:26.148 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.163+0000 7fa5617fa640 1 -- 172.21.15.53:0/1834060324 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa55402fb20 con 0x25b2450 2024-04-25T09:28:26.149 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.164+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/1834060324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 msgr2=0x262d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:26.149 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.164+0000 7fa56fa2dec0 1 --2- 172.21.15.53:0/1834060324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x262d090 crc :-1 s=READY pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:26.149 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.164+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/1834060324 shutdown_connections 2024-04-25T09:28:26.149 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.164+0000 7fa56fa2dec0 1 --2- 172.21.15.53:0/1834060324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x262d090 unknown :-1 s=CLOSED pgs=12898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:26.149 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.164+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/1834060324 >> 172.21.15.53:0/1834060324 conn(0x24ce960 msgr2=0x25ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:28:26.149 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.164+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/1834060324 shutdown_connections 2024-04-25T09:28:26.149 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.164+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/1834060324 wait complete. 2024-04-25T09:28:26.150 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.165+0000 7fa56fa2dec0 1 Processor -- start 2024-04-25T09:28:26.150 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.165+0000 7fa56fa2dec0 1 -- start start 2024-04-25T09:28:26.152 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.167+0000 7fa56fa2dec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x26306b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:26.152 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.167+0000 7fa56fa2dec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x25153d0 con 0x25b2450 2024-04-25T09:28:26.152 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.167+0000 7fa562ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x26306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:26.152 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.167+0000 7fa562ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x26306b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58980/0 (socket says 172.21.15.53:58980) 2024-04-25T09:28:26.152 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.167+0000 7fa562ffd640 1 -- 172.21.15.53:0/4293278364 learned_addr learned my addr 172.21.15.53:0/4293278364 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:28:26.153 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.167+0000 7fa562ffd640 1 -- 172.21.15.53:0/4293278364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24a8e30 con 0x25b2450 2024-04-25T09:28:26.153 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.168+0000 7fa562ffd640 1 --2- 172.21.15.53:0/4293278364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x26306b0 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:26.153 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.168+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa554036040 con 0x25b2450 2024-04-25T09:28:26.153 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.168+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa554037040 con 0x25b2450 2024-04-25T09:28:26.154 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.168+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/4293278364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x24a8890 con 0x25b2450 2024-04-25T09:28:26.154 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.168+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa554009880 con 0x25b2450 2024-04-25T09:28:26.154 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.168+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/4293278364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2631b00 con 0x25b2450 2024-04-25T09:28:26.155 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.169+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa554009a30 con 0x25b2450 2024-04-25T09:28:26.155 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.169+0000 7fa54bfff640 1 --2- 172.21.15.53:0/4293278364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa550037210 0x7fa550039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:26.155 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.169+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(690..690 src has 401..690) ==== 3791+0+0 (crc 0 0 0) 0x7fa55406b4d0 con 0x25b2450 2024-04-25T09:28:26.155 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.169+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=691}) -- 0x7fa55003d480 con 0x25b2450 2024-04-25T09:28:26.155 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.169+0000 7fa56fa2dec0 1 --2- 172.21.15.53:0/4293278364 >> v2:172.21.15.53:6801/3778022725 conn(0x26449c0 0x26d95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:26.155 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.170+0000 7fa5627fc640 1 --2- 172.21.15.53:0/4293278364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa550037210 0x7fa550039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:26.155 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.170+0000 7fa5627fc640 1 --2- 172.21.15.53:0/4293278364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa550037210 0x7fa550039720 crc :-1 s=READY pgs=3765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:26.156 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.171+0000 7fa5637fe640 1 --2- 172.21.15.53:0/4293278364 >> v2:172.21.15.53:6801/3778022725 conn(0x26449c0 0x26d95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:28:26.160 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.175+0000 7fa5637fe640 1 --2- 172.21.15.53:0/4293278364 >> v2:172.21.15.53:6801/3778022725 conn(0x26449c0 0x26d95f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:26.199 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.206+0000 7fcf70206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:26.200 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.215+0000 7fcf70206640 1 Processor -- start 2024-04-25T09:28:26.200 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.216+0000 7fcf70206640 1 -- start start 2024-04-25T09:28:26.203 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.217+0000 7fcf70206640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf6809b460 0x7fcf68134f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:26.203 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.217+0000 7fcf70206640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf68134c80 con 0x7fcf681354d0 2024-04-25T09:28:26.203 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.217+0000 7fcf70206640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6809bf20 con 0x7fcf6809b460 2024-04-25T09:28:26.203 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.217+0000 7fcf6dfa2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf6809b460 0x7fcf68134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:26.203 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.217+0000 7fcf6dfa2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf6809b460 0x7fcf68134f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58990/0 (socket says 172.21.15.53:58990) 2024-04-25T09:28:26.203 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.217+0000 7fcf6d7a1640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcf681354d0 0x7fcf681315a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:34534/0 (socket says 172.21.15.53:34534) 2024-04-25T09:28:26.203 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.217+0000 7fcf6dfa2640 1 -- 172.21.15.53:0/824284855 learned_addr learned my addr 172.21.15.53:0/824284855 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:28:26.203 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.218+0000 7fcf6dfa2640 1 -- 172.21.15.53:0/824284855 >> v1:172.21.15.53:6789/0 conn(0x7fcf681354d0 legacy=0x7fcf681315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:26.204 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.218+0000 7fcf6dfa2640 1 -- 172.21.15.53:0/824284855 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6809c8d0 con 0x7fcf6809b460 2024-04-25T09:28:26.204 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.218+0000 7fcf6dfa2640 1 --2- 172.21.15.53:0/824284855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6809b460 0x7fcf68134f90 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a323d7547f940fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:26.204 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.218+0000 7fcf6cfa0640 1 -- 172.21.15.53:0/824284855 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf64009e50 con 0x7fcf6809b460 2024-04-25T09:28:26.204 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.218+0000 7fcf6cfa0640 1 -- 172.21.15.53:0/824284855 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcf6400e230 con 0x7fcf6809b460 2024-04-25T09:28:26.204 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.218+0000 7fcf6cfa0640 1 -- 172.21.15.53:0/824284855 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf6400e4d0 con 0x7fcf6809b460 2024-04-25T09:28:26.205 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.219+0000 7fcf70206640 1 -- 172.21.15.53:0/824284855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6809b460 msgr2=0x7fcf68134f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:26.205 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.219+0000 7fcf70206640 1 --2- 172.21.15.53:0/824284855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6809b460 0x7fcf68134f90 crc :-1 s=READY pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:26.205 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.219+0000 7fcf70206640 1 -- 172.21.15.53:0/824284855 shutdown_connections 2024-04-25T09:28:26.205 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.219+0000 7fcf70206640 1 --2- 172.21.15.53:0/824284855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf6809b460 0x7fcf68134f90 unknown :-1 s=CLOSED pgs=12901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:26.205 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.219+0000 7fcf70206640 1 -- 172.21.15.53:0/824284855 >> 172.21.15.53:0/824284855 conn(0x7fcf680a3c00 msgr2=0x7fcf680a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:28:26.205 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.219+0000 7fcf70206640 1 -- 172.21.15.53:0/824284855 shutdown_connections 2024-04-25T09:28:26.205 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.219+0000 7fcf70206640 1 -- 172.21.15.53:0/824284855 wait complete. 2024-04-25T09:28:26.205 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.219+0000 7fcf70206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:26.206 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.221+0000 7fcf70206640 1 Processor -- start 2024-04-25T09:28:26.206 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.221+0000 7fcf70206640 1 -- start start 2024-04-25T09:28:26.208 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.222+0000 7fcf70206640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf681354d0 0x7fcf68120f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:26.208 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.222+0000 7fcf70206640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68125110 con 0x7fcf681354d0 2024-04-25T09:28:26.208 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf6dfa2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf681354d0 0x7fcf68120f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:26.208 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf6dfa2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf681354d0 0x7fcf68120f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59000/0 (socket says 172.21.15.53:59000) 2024-04-25T09:28:26.208 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf6dfa2640 1 -- 172.21.15.53:0/1856041631 learned_addr learned my addr 172.21.15.53:0/1856041631 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:28:26.208 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf6dfa2640 1 -- 172.21.15.53:0/1856041631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68132070 con 0x7fcf681354d0 2024-04-25T09:28:26.208 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf6dfa2640 1 --2- 172.21.15.53:0/1856041631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf681354d0 0x7fcf68120f10 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:26.209 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf6400ee20 con 0x7fcf681354d0 2024-04-25T09:28:26.209 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcf64015420 con 0x7fcf681354d0 2024-04-25T09:28:26.209 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf68123400 con 0x7fcf681354d0 2024-04-25T09:28:26.209 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf640156c0 con 0x7fcf681354d0 2024-04-25T09:28:26.209 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.223+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf68124580 con 0x7fcf681354d0 2024-04-25T09:28:26.210 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.224+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf68123830 con 0x7fcf681354d0 2024-04-25T09:28:26.210 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.224+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fcf640158c0 con 0x7fcf681354d0 2024-04-25T09:28:26.210 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.225+0000 7fcf5e7fc640 1 --2- 172.21.15.53:0/1856041631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fcf4c038930 0x7fcf4c03ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:26.210 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.225+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(690..690 src has 401..690) ==== 3791+0+0 (crc 0 0 0) 0x7fcf64049cb0 con 0x7fcf681354d0 2024-04-25T09:28:26.211 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.225+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=691}) -- 0x7fcf4c03eb40 con 0x7fcf681354d0 2024-04-25T09:28:26.211 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.225+0000 7fcf6d7a1640 1 --2- 172.21.15.53:0/1856041631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fcf4c038930 0x7fcf4c03ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:26.211 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.226+0000 7fcf6d7a1640 1 --2- 172.21.15.53:0/1856041631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fcf4c038930 0x7fcf4c03ae40 crc :-1 s=READY pgs=3766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:26.215 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.230+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fcf64010c30 con 0x7fcf681354d0 2024-04-25T09:28:26.404 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:26.419+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "100"} v 0) -- 0x7fcf68132260 con 0x7fcf681354d0 2024-04-25T09:28:27.401 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:27.416+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v691) ==== 225+0+0 (crc 0 0 0) 0x7fcf64010e60 con 0x7fcf681354d0 2024-04-25T09:28:27.402 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:27.416+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(691..691 src has 401..691) ==== 628+0+0 (crc 0 0 0) 0x7fcf64013e70 con 0x7fcf681354d0 2024-04-25T09:28:27.402 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:27.416+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 <== mon.0 v2:172.21.15.53:3300/0 6 ==== osd_map(691..691 src has 401..691) ==== 628+0+0 (crc 0 0 0) 0x7fa55403b310 con 0x25b2450 2024-04-25T09:28:27.402 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:27.416+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=692}) -- 0x7fcf4c03f930 con 0x7fcf681354d0 2024-04-25T09:28:27.402 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:27.416+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=692}) -- 0x7fa55003db10 con 0x25b2450 2024-04-25T09:28:27.517 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:27.532+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "100"} v 0) -- 0x7fcf68124de0 con 0x7fcf681354d0 2024-04-25T09:28:28.092 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.106+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v692) ==== 225+0+0 (crc 0 0 0) 0x7fcf64010820 con 0x7fcf681354d0 2024-04-25T09:28:28.092 INFO:tasks.workunit.client.0.smithi053.stderr:set-quota max_objects = 100 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b 2024-04-25T09:28:28.092 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.106+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 <== mon.0 v2:172.21.15.53:3300/0 10 ==== osd_map(692..692 src has 401..692) ==== 628+0+0 (crc 0 0 0) 0x7fcf64007d50 con 0x7fcf681354d0 2024-04-25T09:28:28.092 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.106+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 <== mon.0 v2:172.21.15.53:3300/0 7 ==== osd_map(692..692 src has 401..692) ==== 628+0+0 (crc 0 0 0) 0x7fa554009d30 con 0x25b2450 2024-04-25T09:28:28.092 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.106+0000 7fcf5e7fc640 1 -- 172.21.15.53:0/1856041631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=693}) -- 0x7fcf4c03fb80 con 0x7fcf681354d0 2024-04-25T09:28:28.092 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.106+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=693}) -- 0x7fa55003dd30 con 0x25b2450 2024-04-25T09:28:28.092 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.106+0000 7fa54bfff640 1 -- 172.21.15.53:0/4293278364 --> v2:172.21.15.53:6801/3778022725 -- osd_op(unknown.0.0:1 200.5 200:b9ff7440:::onemore:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x7fa55003df20 con 0x26449c0 2024-04-25T09:28:28.093 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fcf4c038930 msgr2=0x7fcf4c03ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.093 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 --2- 172.21.15.53:0/1856041631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fcf4c038930 0x7fcf4c03ae40 crc :-1 s=READY pgs=3766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.093 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf681354d0 msgr2=0x7fcf68120f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.094 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 --2- 172.21.15.53:0/1856041631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf681354d0 0x7fcf68120f10 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.094 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 shutdown_connections 2024-04-25T09:28:28.094 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 --2- 172.21.15.53:0/1856041631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fcf4c038930 0x7fcf4c03ae40 unknown :-1 s=CLOSED pgs=3766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.094 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 --2- 172.21.15.53:0/1856041631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf681354d0 0x7fcf68120f10 unknown :-1 s=CLOSED pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.094 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 >> 172.21.15.53:0/1856041631 conn(0x7fcf680a3c00 msgr2=0x7fcf681335b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:28:28.094 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 shutdown_connections 2024-04-25T09:28:28.094 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.108+0000 7fcf70206640 1 -- 172.21.15.53:0/1856041631 wait complete. 2024-04-25T09:28:28.106 INFO:tasks.workunit.client.0.smithi053.stderr:+ wait 96373 2024-04-25T09:28:28.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa5637fe640 1 -- 172.21.15.53:0/4293278364 <== osd.0 v2:172.21.15.53:6801/3778022725 1 ==== osd_op_reply(1 onemore [writefull 0~11876] v692'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7fa55c00a430 con 0x26449c0 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/4293278364 >> v2:172.21.15.53:6801/3778022725 conn(0x26449c0 msgr2=0x26d95f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 --2- 172.21.15.53:0/4293278364 >> v2:172.21.15.53:6801/3778022725 conn(0x26449c0 0x26d95f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/4293278364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa550037210 msgr2=0x7fa550039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 --2- 172.21.15.53:0/4293278364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa550037210 0x7fa550039720 crc :-1 s=READY pgs=3765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/4293278364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 msgr2=0x26306b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 --2- 172.21.15.53:0/4293278364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x26306b0 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/4293278364 shutdown_connections 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 --2- 172.21.15.53:0/4293278364 >> v2:172.21.15.53:6801/3778022725 conn(0x26449c0 0x26d95f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 --2- 172.21.15.53:0/4293278364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa550037210 0x7fa550039720 unknown :-1 s=CLOSED pgs=3765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 --2- 172.21.15.53:0/4293278364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x25b2450 0x26306b0 unknown :-1 s=CLOSED pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/4293278364 >> 172.21.15.53:0/4293278364 conn(0x24ce960 msgr2=0x25ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:28:28.322 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/4293278364 shutdown_connections 2024-04-25T09:28:28.323 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.335+0000 7fa56fa2dec0 1 -- 172.21.15.53:0/4293278364 wait complete. 2024-04-25T09:28:28.323 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -ne 0 ']' 2024-04-25T09:28:28.323 INFO:tasks.workunit.client.0.smithi053.stderr:+ true 2024-04-25T09:28:28.323 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put twomore /etc/passwd 2024-04-25T09:28:28.359 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.374+0000 7fc44d455ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:28.365 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.380+0000 7fc44d455ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:28.365 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.380+0000 7fc44d455ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:28.366 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.381+0000 7fc44d455ec0 1 Processor -- start 2024-04-25T09:28:28.366 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.381+0000 7fc44d455ec0 1 -- start start 2024-04-25T09:28:28.368 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc44d455ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:28.368 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc44d455ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1416950 con 0x14af6a0 2024-04-25T09:28:28.368 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc44559b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:28.368 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc44559b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50256/0 (socket says 172.21.15.53:50256) 2024-04-25T09:28:28.369 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc44559b640 1 -- 172.21.15.53:0/1005231775 learned_addr learned my addr 172.21.15.53:0/1005231775 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:28:28.369 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc44559b640 1 -- 172.21.15.53:0/1005231775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13b51e0 con 0x14af6a0 2024-04-25T09:28:28.369 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc44559b640 1 --2- 172.21.15.53:0/1005231775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15c8100 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365e14b9dbd0776 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:28.369 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc43effd640 1 -- 172.21.15.53:0/1005231775 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc43002fb00 con 0x14af6a0 2024-04-25T09:28:28.369 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc43effd640 1 -- 172.21.15.53:0/1005231775 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc43002fc60 con 0x14af6a0 2024-04-25T09:28:28.369 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.383+0000 7fc43effd640 1 -- 172.21.15.53:0/1005231775 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc430034410 con 0x14af6a0 2024-04-25T09:28:28.370 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.384+0000 7fc44d455ec0 1 -- 172.21.15.53:0/1005231775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 msgr2=0x15c8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.370 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.384+0000 7fc44d455ec0 1 --2- 172.21.15.53:0/1005231775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15c8100 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.370 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.384+0000 7fc44d455ec0 1 -- 172.21.15.53:0/1005231775 shutdown_connections 2024-04-25T09:28:28.370 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.384+0000 7fc44d455ec0 1 --2- 172.21.15.53:0/1005231775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15c8100 unknown :-1 s=CLOSED pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.370 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.384+0000 7fc44d455ec0 1 -- 172.21.15.53:0/1005231775 >> 172.21.15.53:0/1005231775 conn(0x13cd960 msgr2=0x15cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:28:28.370 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.384+0000 7fc44d455ec0 1 -- 172.21.15.53:0/1005231775 shutdown_connections 2024-04-25T09:28:28.370 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.384+0000 7fc44d455ec0 1 -- 172.21.15.53:0/1005231775 wait complete. 2024-04-25T09:28:28.371 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.385+0000 7fc44d455ec0 1 Processor -- start 2024-04-25T09:28:28.371 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.385+0000 7fc44d455ec0 1 -- start start 2024-04-25T09:28:28.372 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.386+0000 7fc44d455ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:28.372 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.386+0000 7fc44d455ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x14143d0 con 0x14af6a0 2024-04-25T09:28:28.372 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc44559b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:28.372 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc44559b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50264/0 (socket says 172.21.15.53:50264) 2024-04-25T09:28:28.372 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc44559b640 1 -- 172.21.15.53:0/4070512989 learned_addr learned my addr 172.21.15.53:0/4070512989 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:28:28.373 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc44559b640 1 -- 172.21.15.53:0/4070512989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13a7e30 con 0x14af6a0 2024-04-25T09:28:28.373 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc44559b640 1 --2- 172.21.15.53:0/4070512989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15b5140 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:28.373 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc43dffb640 1 -- 172.21.15.53:0/4070512989 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc43002fb00 con 0x14af6a0 2024-04-25T09:28:28.373 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc43dffb640 1 -- 172.21.15.53:0/4070512989 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc430034bc0 con 0x14af6a0 2024-04-25T09:28:28.373 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc43dffb640 1 -- 172.21.15.53:0/4070512989 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc430034e60 con 0x14af6a0 2024-04-25T09:28:28.373 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13a7890 con 0x14af6a0 2024-04-25T09:28:28.373 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.387+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15b85b0 con 0x14af6a0 2024-04-25T09:28:28.374 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.388+0000 7fc43dffb640 1 -- 172.21.15.53:0/4070512989 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc43003c040 con 0x14af6a0 2024-04-25T09:28:28.374 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.388+0000 7fc43dffb640 1 --2- 172.21.15.53:0/4070512989 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc42c037210 0x7fc42c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:28.374 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.388+0000 7fc43dffb640 1 -- 172.21.15.53:0/4070512989 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(692..692 src has 401..692) ==== 3791+0+0 (crc 0 0 0) 0x7fc430039040 con 0x14af6a0 2024-04-25T09:28:28.374 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.389+0000 7fc44d455ec0 1 --2- 172.21.15.53:0/4070512989 >> v2:172.21.15.53:6805/3736905990 conn(0x14b1450 0x15c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:28.374 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.389+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:1 200.6 200:7019d845:::twomore:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x15b8cc0 con 0x14b1450 2024-04-25T09:28:28.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.389+0000 7fc444d9a640 1 --2- 172.21.15.53:0/4070512989 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc42c037210 0x7fc42c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:28.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.389+0000 7fc444d9a640 1 --2- 172.21.15.53:0/4070512989 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc42c037210 0x7fc42c039720 crc :-1 s=READY pgs=3767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:28.375 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.389+0000 7fc445d9c640 1 --2- 172.21.15.53:0/4070512989 >> v2:172.21.15.53:6805/3736905990 conn(0x14b1450 0x15c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:28:28.377 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.392+0000 7fc445d9c640 1 --2- 172.21.15.53:0/4070512989 >> v2:172.21.15.53:6805/3736905990 conn(0x14b1450 0x15c75b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.574+0000 7fc445d9c640 1 -- 172.21.15.53:0/4070512989 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(1 twomore [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7fc43800c430 con 0x14b1450 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.574+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 >> v2:172.21.15.53:6805/3736905990 conn(0x14b1450 msgr2=0x15c75b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.574+0000 7fc44d455ec0 1 --2- 172.21.15.53:0/4070512989 >> v2:172.21.15.53:6805/3736905990 conn(0x14b1450 0x15c75b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.574+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc42c037210 msgr2=0x7fc42c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.574+0000 7fc44d455ec0 1 --2- 172.21.15.53:0/4070512989 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc42c037210 0x7fc42c039720 crc :-1 s=READY pgs=3767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.574+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 msgr2=0x15b5140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.574+0000 7fc44d455ec0 1 --2- 172.21.15.53:0/4070512989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15b5140 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.575+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 shutdown_connections 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.575+0000 7fc44d455ec0 1 --2- 172.21.15.53:0/4070512989 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc42c037210 0x7fc42c039720 unknown :-1 s=CLOSED pgs=3767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.575+0000 7fc44d455ec0 1 --2- 172.21.15.53:0/4070512989 >> v2:172.21.15.53:6805/3736905990 conn(0x14b1450 0x15c75b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.575+0000 7fc44d455ec0 1 --2- 172.21.15.53:0/4070512989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x14af6a0 0x15b5140 unknown :-1 s=CLOSED pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.575+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 >> 172.21.15.53:0/4070512989 conn(0x13cd960 msgr2=0x15cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:28:28.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.575+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 shutdown_connections 2024-04-25T09:28:28.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.575+0000 7fc44d455ec0 1 -- 172.21.15.53:0/4070512989 wait complete. 2024-04-25T09:28:28.562 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool set-quota c50b9a0b-a761-4651-b0e1-76fe43e4a63b max_bytes 100 2024-04-25T09:28:28.658 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.665+0000 7fa857b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:28.659 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.674+0000 7fa857b9d640 1 Processor -- start 2024-04-25T09:28:28.659 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.675+0000 7fa857b9d640 1 -- start start 2024-04-25T09:28:28.662 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.676+0000 7fa857b9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa850137c60 0x7fa85013a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:28.662 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.676+0000 7fa857b9d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85006e8b0 con 0x7fa850131a20 2024-04-25T09:28:28.662 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.676+0000 7fa857b9d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa8501315d0 con 0x7fa850137c60 2024-04-25T09:28:28.662 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.676+0000 7fa855939640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa850131a20 0x7fa850131e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:42510/0 (socket says 172.21.15.53:42510) 2024-04-25T09:28:28.662 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.676+0000 7fa855939640 1 -- 172.21.15.53:0/354504603 learned_addr learned my addr 172.21.15.53:0/354504603 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:28:28.662 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.676+0000 7fa855138640 1 --2- 172.21.15.53:0/354504603 >> v2:172.21.15.53:3300/0 conn(0x7fa850137c60 0x7fa85013a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:28.662 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.677+0000 7fa854937640 1 -- 172.21.15.53:0/354504603 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227977324 0 0) 0x7fa85006e8b0 con 0x7fa850131a20 2024-04-25T09:28:28.662 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.677+0000 7fa854937640 1 -- 172.21.15.53:0/354504603 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa83c003580 con 0x7fa850131a20 2024-04-25T09:28:28.663 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.677+0000 7fa855138640 1 -- 172.21.15.53:0/354504603 >> v1:172.21.15.53:6789/0 conn(0x7fa850131a20 legacy=0x7fa850131e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.663 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.677+0000 7fa855138640 1 -- 172.21.15.53:0/354504603 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85006ebf0 con 0x7fa850137c60 2024-04-25T09:28:28.663 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.677+0000 7fa855138640 1 --2- 172.21.15.53:0/354504603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850137c60 0x7fa85013a080 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16fc2e63b0db173 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:28.663 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.677+0000 7fa854937640 1 -- 172.21.15.53:0/354504603 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa84c009d90 con 0x7fa850137c60 2024-04-25T09:28:28.663 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.677+0000 7fa854937640 1 -- 172.21.15.53:0/354504603 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa84c00e230 con 0x7fa850137c60 2024-04-25T09:28:28.663 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.677+0000 7fa854937640 1 -- 172.21.15.53:0/354504603 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa84c00e4d0 con 0x7fa850137c60 2024-04-25T09:28:28.664 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.678+0000 7fa857b9d640 1 -- 172.21.15.53:0/354504603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850137c60 msgr2=0x7fa85013a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:28.664 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.678+0000 7fa857b9d640 1 --2- 172.21.15.53:0/354504603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850137c60 0x7fa85013a080 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.664 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.678+0000 7fa857b9d640 1 -- 172.21.15.53:0/354504603 shutdown_connections 2024-04-25T09:28:28.664 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.678+0000 7fa857b9d640 1 --2- 172.21.15.53:0/354504603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850137c60 0x7fa85013a080 unknown :-1 s=CLOSED pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:28.664 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.678+0000 7fa857b9d640 1 -- 172.21.15.53:0/354504603 >> 172.21.15.53:0/354504603 conn(0x7fa8500a1a20 msgr2=0x7fa8500a1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:28:28.664 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.678+0000 7fa857b9d640 1 -- 172.21.15.53:0/354504603 shutdown_connections 2024-04-25T09:28:28.664 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.678+0000 7fa857b9d640 1 -- 172.21.15.53:0/354504603 wait complete. 2024-04-25T09:28:28.664 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.678+0000 7fa857b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:28.665 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.680+0000 7fa857b9d640 1 Processor -- start 2024-04-25T09:28:28.665 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.680+0000 7fa857b9d640 1 -- start start 2024-04-25T09:28:28.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.681+0000 7fa857b9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850131a20 0x7fa85011dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:28.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.681+0000 7fa857b9d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa850120240 con 0x7fa850131a20 2024-04-25T09:28:28.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.681+0000 7fa855939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850131a20 0x7fa85011dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:28.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.681+0000 7fa855939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850131a20 0x7fa85011dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:50288/0 (socket says 172.21.15.53:50288) 2024-04-25T09:28:28.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.681+0000 7fa855939640 1 -- 172.21.15.53:0/2702021261 learned_addr learned my addr 172.21.15.53:0/2702021261 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:28:28.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.682+0000 7fa855939640 1 -- 172.21.15.53:0/2702021261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa850121cf0 con 0x7fa850131a20 2024-04-25T09:28:28.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.682+0000 7fa855939640 1 --2- 172.21.15.53:0/2702021261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850131a20 0x7fa85011dd30 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:28.667 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.682+0000 7fa8427fc640 1 -- 172.21.15.53:0/2702021261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa844005a60 con 0x7fa850131a20 2024-04-25T09:28:28.668 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.682+0000 7fa8427fc640 1 -- 172.21.15.53:0/2702021261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa844005bc0 con 0x7fa850131a20 2024-04-25T09:28:28.668 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.682+0000 7fa8427fc640 1 -- 172.21.15.53:0/2702021261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa844005e60 con 0x7fa850131a20 2024-04-25T09:28:28.668 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.682+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa850130e00 con 0x7fa850131a20 2024-04-25T09:28:28.668 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.682+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa850121280 con 0x7fa850131a20 2024-04-25T09:28:28.669 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.683+0000 7fa8427fc640 1 -- 172.21.15.53:0/2702021261 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa8440070b0 con 0x7fa850131a20 2024-04-25T09:28:28.669 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.683+0000 7fa8427fc640 1 --2- 172.21.15.53:0/2702021261 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa834038980 0x7fa83403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:28:28.669 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.683+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8500697f0 con 0x7fa850131a20 2024-04-25T09:28:28.669 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.683+0000 7fa8427fc640 1 -- 172.21.15.53:0/2702021261 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(692..692 src has 401..692) ==== 3791+0+0 (crc 0 0 0) 0x7fa844048610 con 0x7fa850131a20 2024-04-25T09:28:28.669 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.683+0000 7fa855138640 1 --2- 172.21.15.53:0/2702021261 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa834038980 0x7fa83403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:28:28.669 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.684+0000 7fa855138640 1 --2- 172.21.15.53:0/2702021261 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa834038980 0x7fa83403ae90 crc :-1 s=READY pgs=3768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:28:28.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.689+0000 7fa8427fc640 1 -- 172.21.15.53:0/2702021261 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fa84400da20 con 0x7fa850131a20 2024-04-25T09:28:28.861 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:28.876+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "100"} v 0) -- 0x7fa850073a90 con 0x7fa850131a20 2024-04-25T09:28:29.405 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:29.420+0000 7fa8427fc640 1 -- 172.21.15.53:0/2702021261 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v693) ==== 221+0+0 (crc 0 0 0) 0x7fa84402b350 con 0x7fa850131a20 2024-04-25T09:28:29.570 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:29.585+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "100"} v 0) -- 0x7fa8500008d0 con 0x7fa850131a20 2024-04-25T09:28:30.410 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.425+0000 7fa8427fc640 1 -- 172.21.15.53:0/2702021261 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v694) ==== 221+0+0 (crc 0 0 0) 0x7fa84400d610 con 0x7fa850131a20 2024-04-25T09:28:30.410 INFO:tasks.workunit.client.0.smithi053.stderr:set-quota max_bytes = 100 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b 2024-04-25T09:28:30.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.427+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa834038980 msgr2=0x7fa83403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:30.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.427+0000 7fa857b9d640 1 --2- 172.21.15.53:0/2702021261 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa834038980 0x7fa83403ae90 crc :-1 s=READY pgs=3768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:30.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.427+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850131a20 msgr2=0x7fa85011dd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:28:30.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.427+0000 7fa857b9d640 1 --2- 172.21.15.53:0/2702021261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850131a20 0x7fa85011dd30 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:30.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.428+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 shutdown_connections 2024-04-25T09:28:30.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.428+0000 7fa857b9d640 1 --2- 172.21.15.53:0/2702021261 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa834038980 0x7fa83403ae90 unknown :-1 s=CLOSED pgs=3768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:30.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.428+0000 7fa857b9d640 1 --2- 172.21.15.53:0/2702021261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa850131a20 0x7fa85011dd30 unknown :-1 s=CLOSED pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:28:30.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.428+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 >> 172.21.15.53:0/2702021261 conn(0x7fa8500a1a20 msgr2=0x7fa850135c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:28:30.414 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.428+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 shutdown_connections 2024-04-25T09:28:30.414 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:28:30.428+0000 7fa857b9d640 1 -- 172.21.15.53:0/2702021261 wait complete. 2024-04-25T09:28:30.425 INFO:tasks.workunit.client.0.smithi053.stderr:+ sleep 30 2024-04-25T09:29:00.427 INFO:tasks.workunit.client.0.smithi053.stderr:+ pid=96464 2024-04-25T09:29:00.427 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool set-quota c50b9a0b-a761-4651-b0e1-76fe43e4a63b max_bytes 0 2024-04-25T09:29:00.427 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put two /etc/passwd 2024-04-25T09:29:00.472 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.487+0000 7f1f61ae3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:00.478 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.494+0000 7f1f61ae3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:00.479 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.494+0000 7f1f61ae3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:00.480 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.495+0000 7f1f61ae3ec0 1 Processor -- start 2024-04-25T09:29:00.480 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.495+0000 7f1f61ae3ec0 1 -- start start 2024-04-25T09:29:00.482 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.496+0000 7f1f61ae3ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x168a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:00.482 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.497+0000 7f1f61ae3ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x15ed950 con 0x166d750 2024-04-25T09:29:00.482 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.497+0000 7f1f59f9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x168a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:00.482 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.497+0000 7f1f59f9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x168a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56244/0 (socket says 172.21.15.53:56244) 2024-04-25T09:29:00.482 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.497+0000 7f1f59f9b640 1 -- 172.21.15.53:0/729661631 learned_addr learned my addr 172.21.15.53:0/729661631 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:00.482 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.497+0000 7f1f59f9b640 1 -- 172.21.15.53:0/729661631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x158c1e0 con 0x166d750 2024-04-25T09:29:00.483 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.497+0000 7f1f59f9b640 1 --2- 172.21.15.53:0/729661631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x168a5d0 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d055ea0d2f9db4f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:00.483 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.498+0000 7f1f537fe640 1 -- 172.21.15.53:0/729661631 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1f44029b30 con 0x166d750 2024-04-25T09:29:00.483 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.498+0000 7f1f537fe640 1 -- 172.21.15.53:0/729661631 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1f44029c90 con 0x166d750 2024-04-25T09:29:00.483 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.498+0000 7f1f537fe640 1 -- 172.21.15.53:0/729661631 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1f44006790 con 0x166d750 2024-04-25T09:29:00.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.499+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/729661631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 msgr2=0x168a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:00.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.499+0000 7f1f61ae3ec0 1 --2- 172.21.15.53:0/729661631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x168a5d0 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:00.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.499+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/729661631 shutdown_connections 2024-04-25T09:29:00.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.499+0000 7f1f61ae3ec0 1 --2- 172.21.15.53:0/729661631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x168a5d0 unknown :-1 s=CLOSED pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:00.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.499+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/729661631 >> 172.21.15.53:0/729661631 conn(0x15a4960 msgr2=0x171dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:00.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.499+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/729661631 shutdown_connections 2024-04-25T09:29:00.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.499+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/729661631 wait complete. 2024-04-25T09:29:00.485 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.500+0000 7f1f61ae3ec0 1 Processor -- start 2024-04-25T09:29:00.485 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.500+0000 7f1f61ae3ec0 1 -- start start 2024-04-25T09:29:00.487 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.502+0000 7f1f61ae3ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x1718dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:00.487 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.502+0000 7f1f61ae3ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x15eb3d0 con 0x166d750 2024-04-25T09:29:00.487 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.502+0000 7f1f59f9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x1718dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:00.487 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.502+0000 7f1f59f9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x1718dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56254/0 (socket says 172.21.15.53:56254) 2024-04-25T09:29:00.487 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.502+0000 7f1f59f9b640 1 -- 172.21.15.53:0/491892347 learned_addr learned my addr 172.21.15.53:0/491892347 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:00.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.502+0000 7f1f59f9b640 1 -- 172.21.15.53:0/491892347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x157ee30 con 0x166d750 2024-04-25T09:29:00.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.502+0000 7f1f59f9b640 1 --2- 172.21.15.53:0/491892347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x1718dd0 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:00.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.503+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1f4403a040 con 0x166d750 2024-04-25T09:29:00.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.503+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1f44034440 con 0x166d750 2024-04-25T09:29:00.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.503+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/491892347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x157e890 con 0x166d750 2024-04-25T09:29:00.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.503+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1f440346e0 con 0x166d750 2024-04-25T09:29:00.488 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.503+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/491892347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1721120 con 0x166d750 2024-04-25T09:29:00.489 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.504+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1f44031040 con 0x166d750 2024-04-25T09:29:00.489 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.504+0000 7f1f527fc640 1 --2- 172.21.15.53:0/491892347 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f40037210 0x7f1f40039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:00.489 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.504+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(696..696 src has 401..696) ==== 3791+0+0 (crc 0 0 0) 0x7f1f4402e040 con 0x166d750 2024-04-25T09:29:00.489 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.504+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7f1f4003d420 con 0x166d750 2024-04-25T09:29:00.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.504+0000 7f1f61ae3ec0 1 --2- 172.21.15.53:0/491892347 >> v2:172.21.15.53:6805/3736905990 conn(0x1686ce0 0x17067d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:00.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.504+0000 7f1f5979a640 1 --2- 172.21.15.53:0/491892347 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f40037210 0x7f1f40039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:00.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.505+0000 7f1f5979a640 1 --2- 172.21.15.53:0/491892347 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f40037210 0x7f1f40039720 crc :-1 s=READY pgs=3769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:00.490 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.505+0000 7f1f5a79c640 1 --2- 172.21.15.53:0/491892347 >> v2:172.21.15.53:6805/3736905990 conn(0x1686ce0 0x17067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:00.494 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.509+0000 7f1f5a79c640 1 --2- 172.21.15.53:0/491892347 >> v2:172.21.15.53:6805/3736905990 conn(0x1686ce0 0x17067d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:00.532 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.539+0000 7fee11c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:00.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.548+0000 7fee11c2d640 1 Processor -- start 2024-04-25T09:29:00.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.548+0000 7fee11c2d640 1 -- start start 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.550+0000 7fee11c2d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee0c09b460 0x7fee0c134f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.550+0000 7fee11c2d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0c134c80 con 0x7fee0c1354d0 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.550+0000 7fee11c2d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fee0c09bf20 con 0x7fee0c09b460 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.550+0000 7fee0b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee0c09b460 0x7fee0c134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.550+0000 7fee0affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fee0c1354d0 0x7fee0c1315a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39172/0 (socket says 172.21.15.53:39172) 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.550+0000 7fee0b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fee0c09b460 0x7fee0c134f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56260/0 (socket says 172.21.15.53:56260) 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.550+0000 7fee0b7fe640 1 -- 172.21.15.53:0/3741219065 learned_addr learned my addr 172.21.15.53:0/3741219065 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.550+0000 7fee0b7fe640 1 -- 172.21.15.53:0/3741219065 >> v1:172.21.15.53:6789/0 conn(0x7fee0c1354d0 legacy=0x7fee0c1315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.551+0000 7fee0b7fe640 1 -- 172.21.15.53:0/3741219065 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c09c8d0 con 0x7fee0c09b460 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.551+0000 7fee0a7fc640 1 -- 172.21.15.53:0/3741219065 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100790002 0 0) 0x7fee0c134c80 con 0x7fee0c1354d0 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.551+0000 7fee0b7fe640 1 --2- 172.21.15.53:0/3741219065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c09b460 0x7fee0c134f90 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac07d323bb50f069 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.551+0000 7fee0a7fc640 1 -- 172.21.15.53:0/3741219065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fedfc009e50 con 0x7fee0c09b460 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.551+0000 7fee0a7fc640 1 -- 172.21.15.53:0/3741219065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fedfc00e230 con 0x7fee0c09b460 2024-04-25T09:29:00.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.551+0000 7fee0a7fc640 1 -- 172.21.15.53:0/3741219065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fedfc00e4d0 con 0x7fee0c09b460 2024-04-25T09:29:00.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.552+0000 7fee11c2d640 1 -- 172.21.15.53:0/3741219065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c09b460 msgr2=0x7fee0c134f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:00.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.552+0000 7fee11c2d640 1 --2- 172.21.15.53:0/3741219065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c09b460 0x7fee0c134f90 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:00.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.552+0000 7fee11c2d640 1 -- 172.21.15.53:0/3741219065 shutdown_connections 2024-04-25T09:29:00.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.552+0000 7fee11c2d640 1 --2- 172.21.15.53:0/3741219065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c09b460 0x7fee0c134f90 unknown :-1 s=CLOSED pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:00.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.552+0000 7fee11c2d640 1 -- 172.21.15.53:0/3741219065 >> 172.21.15.53:0/3741219065 conn(0x7fee0c0a3c00 msgr2=0x7fee0c0a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:00.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.552+0000 7fee11c2d640 1 -- 172.21.15.53:0/3741219065 shutdown_connections 2024-04-25T09:29:00.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.552+0000 7fee11c2d640 1 -- 172.21.15.53:0/3741219065 wait complete. 2024-04-25T09:29:00.538 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.552+0000 7fee11c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:00.539 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.554+0000 7fee11c2d640 1 Processor -- start 2024-04-25T09:29:00.539 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.554+0000 7fee11c2d640 1 -- start start 2024-04-25T09:29:00.541 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.555+0000 7fee11c2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c1354d0 0x7fee0c121540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:00.541 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.555+0000 7fee11c2d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c120c50 con 0x7fee0c1354d0 2024-04-25T09:29:00.541 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.555+0000 7fee0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c1354d0 0x7fee0c121540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:00.541 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.555+0000 7fee0b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c1354d0 0x7fee0c121540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56274/0 (socket says 172.21.15.53:56274) 2024-04-25T09:29:00.541 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.555+0000 7fee0b7fe640 1 -- 172.21.15.53:0/3221902617 learned_addr learned my addr 172.21.15.53:0/3221902617 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:00.541 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.556+0000 7fee0b7fe640 1 -- 172.21.15.53:0/3221902617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c121220 con 0x7fee0c1354d0 2024-04-25T09:29:00.541 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.556+0000 7fee0b7fe640 1 --2- 172.21.15.53:0/3221902617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c1354d0 0x7fee0c121540 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:00.541 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.556+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fedfc00ee50 con 0x7fee0c1354d0 2024-04-25T09:29:00.541 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.556+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c122890 con 0x7fee0c1354d0 2024-04-25T09:29:00.542 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.556+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fedfc015420 con 0x7fee0c1354d0 2024-04-25T09:29:00.542 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.556+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fedfc0156c0 con 0x7fee0c1354d0 2024-04-25T09:29:00.542 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.556+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c120e80 con 0x7fee0c1354d0 2024-04-25T09:29:00.542 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.557+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c0697f0 con 0x7fee0c1354d0 2024-04-25T09:29:00.543 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.557+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fedfc0158c0 con 0x7fee0c1354d0 2024-04-25T09:29:00.543 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.557+0000 7fedf3fff640 1 --2- 172.21.15.53:0/3221902617 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fedf8038930 0x7fedf803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:00.543 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.557+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(696..696 src has 401..696) ==== 3791+0+0 (crc 0 0 0) 0x7fedfc049c80 con 0x7fee0c1354d0 2024-04-25T09:29:00.543 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.557+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7fedf803eb40 con 0x7fee0c1354d0 2024-04-25T09:29:00.543 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.558+0000 7fee0affd640 1 --2- 172.21.15.53:0/3221902617 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fedf8038930 0x7fedf803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:00.543 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.558+0000 7fee0affd640 1 --2- 172.21.15.53:0/3221902617 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fedf8038930 0x7fedf803ae40 crc :-1 s=READY pgs=3770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:00.547 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.563+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fedfc012c00 con 0x7fee0c1354d0 2024-04-25T09:29:00.737 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:00.752+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "0"} v 0) -- 0x7fee0c0681a0 con 0x7fee0c1354d0 2024-04-25T09:29:01.412 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:01.427+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v697) ==== 217+0+0 (crc 0 0 0) 0x7fedfc0127f0 con 0x7fee0c1354d0 2024-04-25T09:29:01.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:01.427+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(697..697 src has 401..697) ==== 628+0+0 (crc 0 0 0) 0x7fedfc012e30 con 0x7fee0c1354d0 2024-04-25T09:29:01.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:01.427+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 <== mon.0 v2:172.21.15.53:3300/0 6 ==== osd_map(697..697 src has 401..697) ==== 628+0+0 (crc 0 0 0) 0x7f1f44038e40 con 0x166d750 2024-04-25T09:29:01.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:01.428+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7fedf803fa80 con 0x7fee0c1354d0 2024-04-25T09:29:01.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:01.428+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7f1f4003dab0 con 0x166d750 2024-04-25T09:29:01.527 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:01.542+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "0"} v 0) -- 0x7fee0c124120 con 0x7fee0c1354d0 2024-04-25T09:29:02.413 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.428+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v698) ==== 217+0+0 (crc 0 0 0) 0x7fedfc0129d0 con 0x7fee0c1354d0 2024-04-25T09:29:02.414 INFO:tasks.workunit.client.0.smithi053.stderr:set-quota max_bytes = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b 2024-04-25T09:29:02.414 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.429+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 <== mon.0 v2:172.21.15.53:3300/0 10 ==== osd_map(698..698 src has 401..698) ==== 628+0+0 (crc 0 0 0) 0x7fedfc007d50 con 0x7fee0c1354d0 2024-04-25T09:29:02.414 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.429+0000 7fedf3fff640 1 -- 172.21.15.53:0/3221902617 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7fedf803fba0 con 0x7fee0c1354d0 2024-04-25T09:29:02.417 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fedf8038930 msgr2=0x7fedf803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:02.417 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7fee11c2d640 1 --2- 172.21.15.53:0/3221902617 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fedf8038930 0x7fedf803ae40 crc :-1 s=READY pgs=3770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:02.417 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c1354d0 msgr2=0x7fee0c121540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:02.417 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7fee11c2d640 1 --2- 172.21.15.53:0/3221902617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c1354d0 0x7fee0c121540 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:02.418 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 <== mon.0 v2:172.21.15.53:3300/0 7 ==== osd_map(698..698 src has 401..698) ==== 628+0+0 (crc 0 0 0) 0x7f1f4402fd70 con 0x166d750 2024-04-25T09:29:02.418 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 shutdown_connections 2024-04-25T09:29:02.418 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7f1f4003dcd0 con 0x166d750 2024-04-25T09:29:02.418 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7fee11c2d640 1 --2- 172.21.15.53:0/3221902617 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fedf8038930 0x7fedf803ae40 crc :-1 s=CLOSED pgs=3770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:02.418 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7fee11c2d640 1 --2- 172.21.15.53:0/3221902617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee0c1354d0 0x7fee0c121540 unknown :-1 s=CLOSED pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:02.418 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.432+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 >> 172.21.15.53:0/3221902617 conn(0x7fee0c0a3c00 msgr2=0x7fee0c133440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:02.418 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.433+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 shutdown_connections 2024-04-25T09:29:02.418 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.433+0000 7fee11c2d640 1 -- 172.21.15.53:0/3221902617 wait complete. 2024-04-25T09:29:02.432 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool set-quota c50b9a0b-a761-4651-b0e1-76fe43e4a63b max_objects 0 2024-04-25T09:29:02.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.559+0000 7f580b66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:02.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.573+0000 7f580b66d640 1 Processor -- start 2024-04-25T09:29:02.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.573+0000 7f580b66d640 1 -- start start 2024-04-25T09:29:02.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.575+0000 7f580b66d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5804133500 0x7f5804137b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:02.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.575+0000 7f580b66d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5804071d30 con 0x7f5804073370 2024-04-25T09:29:02.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.575+0000 7f580b66d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f5804072880 con 0x7f5804133500 2024-04-25T09:29:02.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.575+0000 7f5808c08640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f5804133500 0x7f5804137b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:02.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.575+0000 7f5809409640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f5804073370 0x7f5804132df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39176/0 (socket says 172.21.15.53:39176) 2024-04-25T09:29:02.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.575+0000 7f5809409640 1 -- 172.21.15.53:0/1783680814 learned_addr learned my addr 172.21.15.53:0/1783680814 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:29:02.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.575+0000 7f5808c08640 1 -- 172.21.15.53:0/1783680814 >> v1:172.21.15.53:6789/0 conn(0x7f5804073370 legacy=0x7f5804132df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:02.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.575+0000 7f57fbfff640 1 -- 172.21.15.53:0/1783680814 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688350936 0 0) 0x7f5804071d30 con 0x7f5804073370 2024-04-25T09:29:02.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.575+0000 7f5808c08640 1 -- 172.21.15.53:0/1783680814 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58040723a0 con 0x7f5804133500 2024-04-25T09:29:02.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.576+0000 7f5808c08640 1 --2- 172.21.15.53:0/1783680814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804133500 0x7f5804137b50 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca828af156e52c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:02.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.576+0000 7f57fbfff640 1 -- 172.21.15.53:0/1783680814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57f4009d80 con 0x7f5804133500 2024-04-25T09:29:02.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.576+0000 7f57fbfff640 1 -- 172.21.15.53:0/1783680814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57f400e230 con 0x7f5804133500 2024-04-25T09:29:02.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.576+0000 7f57fbfff640 1 -- 172.21.15.53:0/1783680814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57f400e4d0 con 0x7f5804133500 2024-04-25T09:29:02.562 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.577+0000 7f580b66d640 1 -- 172.21.15.53:0/1783680814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804133500 msgr2=0x7f5804137b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:02.562 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.577+0000 7f580b66d640 1 --2- 172.21.15.53:0/1783680814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804133500 0x7f5804137b50 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:02.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.577+0000 7f580b66d640 1 -- 172.21.15.53:0/1783680814 shutdown_connections 2024-04-25T09:29:02.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.577+0000 7f580b66d640 1 --2- 172.21.15.53:0/1783680814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804133500 0x7f5804137b50 unknown :-1 s=CLOSED pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:02.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.577+0000 7f580b66d640 1 -- 172.21.15.53:0/1783680814 >> 172.21.15.53:0/1783680814 conn(0x7f580409f3b0 msgr2=0x7f580409f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:02.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.577+0000 7f580b66d640 1 -- 172.21.15.53:0/1783680814 shutdown_connections 2024-04-25T09:29:02.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.577+0000 7f580b66d640 1 -- 172.21.15.53:0/1783680814 wait complete. 2024-04-25T09:29:02.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.578+0000 7f580b66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:02.565 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.580+0000 7f580b66d640 1 Processor -- start 2024-04-25T09:29:02.565 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.580+0000 7f580b66d640 1 -- start start 2024-04-25T09:29:02.566 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.581+0000 7f580b66d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804073370 0x7f58041c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:02.566 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.581+0000 7f580b66d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f580411fef0 con 0x7f5804073370 2024-04-25T09:29:02.566 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.582+0000 7f5809409640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804073370 0x7f58041c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:02.567 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.582+0000 7f5809409640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804073370 0x7f58041c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56298/0 (socket says 172.21.15.53:56298) 2024-04-25T09:29:02.567 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.582+0000 7f5809409640 1 -- 172.21.15.53:0/1802661425 learned_addr learned my addr 172.21.15.53:0/1802661425 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:02.567 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.582+0000 7f5809409640 1 -- 172.21.15.53:0/1802661425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58041214e0 con 0x7f5804073370 2024-04-25T09:29:02.568 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.582+0000 7f5809409640 1 --2- 172.21.15.53:0/1802661425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804073370 0x7f58041c3f80 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:02.568 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.582+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5800004b80 con 0x7f5804073370 2024-04-25T09:29:02.568 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.583+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5800004ce0 con 0x7f5804073370 2024-04-25T09:29:02.568 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.583+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5804120680 con 0x7f5804073370 2024-04-25T09:29:02.568 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.583+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5800007120 con 0x7f5804073370 2024-04-25T09:29:02.568 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.583+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5804122a90 con 0x7f5804073370 2024-04-25T09:29:02.569 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.584+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f58000072d0 con 0x7f5804073370 2024-04-25T09:29:02.569 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.584+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58041327a0 con 0x7f5804073370 2024-04-25T09:29:02.570 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.584+0000 7f57f9ffb640 1 --2- 172.21.15.53:0/1802661425 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f57e8038980 0x7f57e803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:02.570 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.584+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(698..698 src has 401..698) ==== 3791+0+0 (crc 0 0 0) 0x7f5800048870 con 0x7f5804073370 2024-04-25T09:29:02.570 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.584+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7f57e803ebf0 con 0x7f5804073370 2024-04-25T09:29:02.570 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.585+0000 7f5808c08640 1 --2- 172.21.15.53:0/1802661425 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f57e8038980 0x7f57e803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:02.570 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.585+0000 7f5808c08640 1 --2- 172.21.15.53:0/1802661425 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f57e8038980 0x7f57e803ae90 crc :-1 s=READY pgs=3771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:02.575 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.591+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f580000f230 con 0x7f5804073370 2024-04-25T09:29:02.774 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:02.789+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "0"} v 0) -- 0x7f58040697f0 con 0x7f5804073370 2024-04-25T09:29:03.099 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.113+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v699) ==== 221+0+0 (crc 0 0 0) 0x7f580000a5d0 con 0x7f5804073370 2024-04-25T09:29:03.099 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.114+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(699..699 src has 401..699) ==== 628+0+0 (crc 0 0 0) 0x7f1f44032cc0 con 0x166d750 2024-04-25T09:29:03.099 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.114+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(699..699 src has 401..699) ==== 628+0+0 (crc 0 0 0) 0x7f580000ac10 con 0x7f5804073370 2024-04-25T09:29:03.099 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.114+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7f1f4003dcd0 con 0x166d750 2024-04-25T09:29:03.099 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.114+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7f57e803fb30 con 0x7f5804073370 2024-04-25T09:29:03.099 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.114+0000 7f1f527fc640 1 -- 172.21.15.53:0/491892347 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:1 200.6 200:6b5d76a5:::two:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e699) -- 0x7f1f4003df20 con 0x1686ce0 2024-04-25T09:29:03.264 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.279+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "0"} v 0) -- 0x7f5804120ef0 con 0x7f5804073370 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f5a79c640 1 -- 172.21.15.53:0/491892347 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(1 two [writefull 0~11876] v699'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f1f4c00a430 con 0x1686ce0 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/491892347 >> v2:172.21.15.53:6805/3736905990 conn(0x1686ce0 msgr2=0x17067d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 --2- 172.21.15.53:0/491892347 >> v2:172.21.15.53:6805/3736905990 conn(0x1686ce0 0x17067d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/491892347 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f40037210 msgr2=0x7f1f40039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 --2- 172.21.15.53:0/491892347 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f40037210 0x7f1f40039720 crc :-1 s=READY pgs=3769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/491892347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 msgr2=0x1718dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 --2- 172.21.15.53:0/491892347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x1718dd0 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/491892347 shutdown_connections 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 --2- 172.21.15.53:0/491892347 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f1f40037210 0x7f1f40039720 unknown :-1 s=CLOSED pgs=3769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 --2- 172.21.15.53:0/491892347 >> v2:172.21.15.53:6805/3736905990 conn(0x1686ce0 0x17067d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 --2- 172.21.15.53:0/491892347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x166d750 0x1718dd0 unknown :-1 s=CLOSED pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/491892347 >> 172.21.15.53:0/491892347 conn(0x15a4960 msgr2=0x171c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:03.299 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/491892347 shutdown_connections 2024-04-25T09:29:03.300 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:03.313+0000 7f1f61ae3ec0 1 -- 172.21.15.53:0/491892347 wait complete. 2024-04-25T09:29:04.102 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.116+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v700) ==== 221+0+0 (crc 0 0 0) 0x7f580000a7b0 con 0x7f5804073370 2024-04-25T09:29:04.102 INFO:tasks.workunit.client.0.smithi053.stderr:set-quota max_objects = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b 2024-04-25T09:29:04.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f57f9ffb640 1 -- 172.21.15.53:0/1802661425 <== mon.0 v2:172.21.15.53:3300/0 10 ==== osd_map(700..700 src has 401..700) ==== 628+0+0 (crc 0 0 0) 0x7f5800048b80 con 0x7f5804073370 2024-04-25T09:29:04.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f57e8038980 msgr2=0x7f57e803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:04.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 --2- 172.21.15.53:0/1802661425 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f57e8038980 0x7f57e803ae90 crc :-1 s=READY pgs=3771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804073370 msgr2=0x7f58041c3f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:04.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 --2- 172.21.15.53:0/1802661425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804073370 0x7f58041c3f80 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 shutdown_connections 2024-04-25T09:29:04.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 --2- 172.21.15.53:0/1802661425 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f57e8038980 0x7f57e803ae90 unknown :-1 s=CLOSED pgs=3771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.105 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 --2- 172.21.15.53:0/1802661425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5804073370 0x7f58041c3f80 unknown :-1 s=CLOSED pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.105 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 >> 172.21.15.53:0/1802661425 conn(0x7f580409f3b0 msgr2=0x7f5804131160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:04.105 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 shutdown_connections 2024-04-25T09:29:04.105 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.119+0000 7f580b66d640 1 -- 172.21.15.53:0/1802661425 wait complete. 2024-04-25T09:29:04.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ wait 96464 2024-04-25T09:29:04.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ '[' 0 -ne 0 ']' 2024-04-25T09:29:04.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ true 2024-04-25T09:29:04.120 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put three /etc/passwd 2024-04-25T09:29:04.161 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.176+0000 7f8e34e32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:04.168 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.183+0000 7f8e34e32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:04.168 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.183+0000 7f8e34e32ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:04.169 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.184+0000 7f8e34e32ec0 1 Processor -- start 2024-04-25T09:29:04.169 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.184+0000 7f8e34e32ec0 1 -- start start 2024-04-25T09:29:04.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e34e32ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0x9540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:04.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e34e32ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x8c1950 con 0x940740 2024-04-25T09:29:04.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e2cf9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0x9540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:04.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e2cf9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0x9540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56312/0 (socket says 172.21.15.53:56312) 2024-04-25T09:29:04.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e2cf9b640 1 -- 172.21.15.53:0/3275575577 learned_addr learned my addr 172.21.15.53:0/3275575577 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:04.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e2cf9b640 1 -- 172.21.15.53:0/3275575577 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x8601e0 con 0x940740 2024-04-25T09:29:04.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e2cf9b640 1 --2- 172.21.15.53:0/3275575577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0x9540a0 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5123096862b00e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:04.172 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e267fc640 1 -- 172.21.15.53:0/3275575577 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8e1800b5d0 con 0x940740 2024-04-25T09:29:04.172 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e267fc640 1 -- 172.21.15.53:0/3275575577 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8e1800b730 con 0x940740 2024-04-25T09:29:04.172 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.186+0000 7f8e267fc640 1 -- 172.21.15.53:0/3275575577 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8e1800b9d0 con 0x940740 2024-04-25T09:29:04.172 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.187+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/3275575577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 msgr2=0x9540a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:04.172 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.187+0000 7f8e34e32ec0 1 --2- 172.21.15.53:0/3275575577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0x9540a0 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.173 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.187+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/3275575577 shutdown_connections 2024-04-25T09:29:04.173 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.187+0000 7f8e34e32ec0 1 --2- 172.21.15.53:0/3275575577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0x9540a0 unknown :-1 s=CLOSED pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.173 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.187+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/3275575577 >> 172.21.15.53:0/3275575577 conn(0x878960 msgr2=0x95df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:04.173 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.187+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/3275575577 shutdown_connections 2024-04-25T09:29:04.173 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.187+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/3275575577 wait complete. 2024-04-25T09:29:04.173 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.188+0000 7f8e34e32ec0 1 Processor -- start 2024-04-25T09:29:04.173 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.188+0000 7f8e34e32ec0 1 -- start start 2024-04-25T09:29:04.175 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.190+0000 7f8e34e32ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0xa75720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:04.175 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.190+0000 7f8e34e32ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x8bf3d0 con 0x940740 2024-04-25T09:29:04.175 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.190+0000 7f8e2cf9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0xa75720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:04.175 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.190+0000 7f8e2cf9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0xa75720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56318/0 (socket says 172.21.15.53:56318) 2024-04-25T09:29:04.175 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.190+0000 7f8e2cf9b640 1 -- 172.21.15.53:0/4078473115 learned_addr learned my addr 172.21.15.53:0/4078473115 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:04.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.191+0000 7f8e2cf9b640 1 -- 172.21.15.53:0/4078473115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x852e30 con 0x940740 2024-04-25T09:29:04.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.191+0000 7f8e2cf9b640 1 --2- 172.21.15.53:0/4078473115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0xa75720 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:04.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.191+0000 7f8e257fa640 1 -- 172.21.15.53:0/4078473115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8e18012910 con 0x940740 2024-04-25T09:29:04.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.191+0000 7f8e257fa640 1 -- 172.21.15.53:0/4078473115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8e18005040 con 0x940740 2024-04-25T09:29:04.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.191+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x852890 con 0x940740 2024-04-25T09:29:04.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.191+0000 7f8e257fa640 1 -- 172.21.15.53:0/4078473115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8e18012ba0 con 0x940740 2024-04-25T09:29:04.177 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.191+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0xa76b80 con 0x940740 2024-04-25T09:29:04.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.192+0000 7f8e257fa640 1 -- 172.21.15.53:0/4078473115 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f8e1800d040 con 0x940740 2024-04-25T09:29:04.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.193+0000 7f8e257fa640 1 --2- 172.21.15.53:0/4078473115 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8e14037210 0x7f8e14039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:04.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.193+0000 7f8e257fa640 1 -- 172.21.15.53:0/4078473115 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(700..700 src has 401..700) ==== 3791+0+0 (crc 0 0 0) 0x7f8e1800a040 con 0x940740 2024-04-25T09:29:04.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.193+0000 7f8e34e32ec0 1 --2- 172.21.15.53:0/4078473115 >> v2:172.21.15.151:6806/46311736 conn(0x9ebb10 0xa83710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:04.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.193+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 --> v2:172.21.15.151:6806/46311736 -- osd_op(unknown.0.0:1 200.3 200:c57798d7:::three:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0x9d74f0 con 0x9ebb10 2024-04-25T09:29:04.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.193+0000 7f8e277fe640 1 --2- 172.21.15.53:0/4078473115 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8e14037210 0x7f8e14039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:04.179 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.194+0000 7f8e277fe640 1 --2- 172.21.15.53:0/4078473115 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8e14037210 0x7f8e14039720 crc :-1 s=READY pgs=3772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:04.179 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.194+0000 7f8e2d79c640 1 --2- 172.21.15.53:0/4078473115 >> v2:172.21.15.151:6806/46311736 conn(0x9ebb10 0xa83710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:04.182 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.197+0000 7f8e2d79c640 1 --2- 172.21.15.53:0/4078473115 >> v2:172.21.15.151:6806/46311736 conn(0x9ebb10 0xa83710 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.376+0000 7f8e2d79c640 1 -- 172.21.15.53:0/4078473115 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== osd_op_reply(1 three [writefull 0~11876] v700'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8e2000a430 con 0x9ebb10 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 >> v2:172.21.15.151:6806/46311736 conn(0x9ebb10 msgr2=0xa83710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 --2- 172.21.15.53:0/4078473115 >> v2:172.21.15.151:6806/46311736 conn(0x9ebb10 0xa83710 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8e14037210 msgr2=0x7f8e14039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 --2- 172.21.15.53:0/4078473115 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8e14037210 0x7f8e14039720 crc :-1 s=READY pgs=3772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 msgr2=0xa75720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 --2- 172.21.15.53:0/4078473115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0xa75720 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 shutdown_connections 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 --2- 172.21.15.53:0/4078473115 >> v2:172.21.15.151:6806/46311736 conn(0x9ebb10 0xa83710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 --2- 172.21.15.53:0/4078473115 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8e14037210 0x7f8e14039720 unknown :-1 s=CLOSED pgs=3772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 --2- 172.21.15.53:0/4078473115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x940740 0xa75720 unknown :-1 s=CLOSED pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 >> 172.21.15.53:0/4078473115 conn(0x878960 msgr2=0x9e9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:04.363 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 shutdown_connections 2024-04-25T09:29:04.364 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.377+0000 7f8e34e32ec0 1 -- 172.21.15.53:0/4078473115 wait complete. 2024-04-25T09:29:04.364 INFO:tasks.workunit.client.0.smithi053.stderr:++ uuidgen 2024-04-25T09:29:04.365 INFO:tasks.workunit.client.0.smithi053.stderr:+ pp=c703408b-a4c5-4118-ba7e-91b1f88f4328 2024-04-25T09:29:04.365 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool create c703408b-a4c5-4118-ba7e-91b1f88f4328 12 2024-04-25T09:29:04.460 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.467+0000 7f84f5217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:04.461 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.476+0000 7f84f5217640 1 Processor -- start 2024-04-25T09:29:04.461 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.476+0000 7f84f5217640 1 -- start start 2024-04-25T09:29:04.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84f5217640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f84f0135b60 0x7f84f0137f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:04.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84f5217640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f0072230 con 0x7f84f012f830 2024-04-25T09:29:04.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84f5217640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f84f0073110 con 0x7f84f0135b60 2024-04-25T09:29:04.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84ee59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f84f0135b60 0x7f84f0137f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:04.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84eed9d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f84f012f830 0x7f84f012fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39188/0 (socket says 172.21.15.53:39188) 2024-04-25T09:29:04.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84eed9d640 1 -- 172.21.15.53:0/1531134050 learned_addr learned my addr 172.21.15.53:0/1531134050 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:29:04.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84ee59c640 1 -- 172.21.15.53:0/1531134050 >> v1:172.21.15.53:6789/0 conn(0x7f84f012f830 legacy=0x7f84f012fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:04.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84edd9b640 1 -- 172.21.15.53:0/1531134050 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899323253 0 0) 0x7f84f0072230 con 0x7f84f012f830 2024-04-25T09:29:04.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84ee59c640 1 -- 172.21.15.53:0/1531134050 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f0072e40 con 0x7f84f0135b60 2024-04-25T09:29:04.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84ee59c640 1 --2- 172.21.15.53:0/1531134050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0135b60 0x7f84f0137f80 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbacc627a95c9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:04.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84edd9b640 1 -- 172.21.15.53:0/1531134050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84e4009d80 con 0x7f84f0135b60 2024-04-25T09:29:04.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84edd9b640 1 -- 172.21.15.53:0/1531134050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f84e400e230 con 0x7f84f0135b60 2024-04-25T09:29:04.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.478+0000 7f84edd9b640 1 -- 172.21.15.53:0/1531134050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84e400e4d0 con 0x7f84f0135b60 2024-04-25T09:29:04.465 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.479+0000 7f84f5217640 1 -- 172.21.15.53:0/1531134050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0135b60 msgr2=0x7f84f0137f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:04.465 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.479+0000 7f84f5217640 1 --2- 172.21.15.53:0/1531134050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0135b60 0x7f84f0137f80 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.465 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.479+0000 7f84f5217640 1 -- 172.21.15.53:0/1531134050 shutdown_connections 2024-04-25T09:29:04.465 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.479+0000 7f84f5217640 1 --2- 172.21.15.53:0/1531134050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f0135b60 0x7f84f0137f80 unknown :-1 s=CLOSED pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:04.465 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.479+0000 7f84f5217640 1 -- 172.21.15.53:0/1531134050 >> 172.21.15.53:0/1531134050 conn(0x7f84f009f3b0 msgr2=0x7f84f009f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:04.465 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.479+0000 7f84f5217640 1 -- 172.21.15.53:0/1531134050 shutdown_connections 2024-04-25T09:29:04.465 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.479+0000 7f84f5217640 1 -- 172.21.15.53:0/1531134050 wait complete. 2024-04-25T09:29:04.465 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.479+0000 7f84f5217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:04.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.481+0000 7f84f5217640 1 Processor -- start 2024-04-25T09:29:04.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.482+0000 7f84f5217640 1 -- start start 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.483+0000 7f84f5217640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f012f830 0x7f84f01c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.483+0000 7f84f5217640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f84f011bc10 con 0x7f84f012f830 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.483+0000 7f84eed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f012f830 0x7f84f01c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.483+0000 7f84eed9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f012f830 0x7f84f01c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56334/0 (socket says 172.21.15.53:56334) 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.483+0000 7f84eed9d640 1 -- 172.21.15.53:0/1948240444 learned_addr learned my addr 172.21.15.53:0/1948240444 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.483+0000 7f84eed9d640 1 -- 172.21.15.53:0/1948240444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f011f810 con 0x7f84f012f830 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.484+0000 7f84eed9d640 1 --2- 172.21.15.53:0/1948240444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f012f830 0x7f84f01c70c0 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.484+0000 7f84d77fe640 1 -- 172.21.15.53:0/1948240444 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84e0004b80 con 0x7f84f012f830 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.484+0000 7f84d77fe640 1 -- 172.21.15.53:0/1948240444 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f84e0004ce0 con 0x7f84f012f830 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.484+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f011b870 con 0x7f84f012f830 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.484+0000 7f84d77fe640 1 -- 172.21.15.53:0/1948240444 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f84e0007120 con 0x7f84f012f830 2024-04-25T09:29:04.469 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.484+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f011f3e0 con 0x7f84f012f830 2024-04-25T09:29:04.470 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.485+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f012eec0 con 0x7f84f012f830 2024-04-25T09:29:04.470 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.485+0000 7f84d77fe640 1 -- 172.21.15.53:0/1948240444 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f84e00072d0 con 0x7f84f012f830 2024-04-25T09:29:04.471 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.485+0000 7f84d77fe640 1 --2- 172.21.15.53:0/1948240444 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84dc038980 0x7f84dc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:04.471 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.485+0000 7f84d77fe640 1 -- 172.21.15.53:0/1948240444 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(700..700 src has 401..700) ==== 3791+0+0 (crc 0 0 0) 0x7f84e00487e0 con 0x7f84f012f830 2024-04-25T09:29:04.471 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.485+0000 7f84ee59c640 1 --2- 172.21.15.53:0/1948240444 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84dc038980 0x7f84dc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:04.471 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.486+0000 7f84ee59c640 1 --2- 172.21.15.53:0/1948240444 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84dc038980 0x7f84dc03ae90 crc :-1 s=READY pgs=3773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:04.475 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.490+0000 7f84d77fe640 1 -- 172.21.15.53:0/1948240444 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f84e000a9e0 con 0x7f84f012f830 2024-04-25T09:29:04.661 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:04.676+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "pg_num": 12} v 0) -- 0x7f84f00697f0 con 0x7f84f012f830 2024-04-25T09:29:05.424 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.439+0000 7f84d77fe640 1 -- 172.21.15.53:0/1948240444 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "pg_num": 12}]=0 pool 'c703408b-a4c5-4118-ba7e-91b1f88f4328' created v701) ==== 176+0+0 (crc 0 0 0) 0x7f84e000a5d0 con 0x7f84f012f830 2024-04-25T09:29:05.614 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.629+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "pg_num": 12} v 0) -- 0x7f84f011ba00 con 0x7f84f012f830 2024-04-25T09:29:05.615 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.630+0000 7f84d77fe640 1 -- 172.21.15.53:0/1948240444 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "pg_num": 12}]=0 pool 'c703408b-a4c5-4118-ba7e-91b1f88f4328' already exists v701) ==== 183+0+0 (crc 0 0 0) 0x7f84e000a7b0 con 0x7f84f012f830 2024-04-25T09:29:05.615 INFO:tasks.workunit.client.0.smithi053.stderr:pool 'c703408b-a4c5-4118-ba7e-91b1f88f4328' already exists 2024-04-25T09:29:05.617 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84dc038980 msgr2=0x7f84dc03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:05.617 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 --2- 172.21.15.53:0/1948240444 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84dc038980 0x7f84dc03ae90 crc :-1 s=READY pgs=3773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:05.617 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f012f830 msgr2=0x7f84f01c70c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:05.617 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 --2- 172.21.15.53:0/1948240444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f012f830 0x7f84f01c70c0 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:05.618 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 shutdown_connections 2024-04-25T09:29:05.618 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 --2- 172.21.15.53:0/1948240444 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84dc038980 0x7f84dc03ae90 unknown :-1 s=CLOSED pgs=3773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:05.618 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 --2- 172.21.15.53:0/1948240444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84f012f830 0x7f84f01c70c0 unknown :-1 s=CLOSED pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:05.618 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 >> 172.21.15.53:0/1948240444 conn(0x7f84f009f3b0 msgr2=0x7f84f009f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:05.618 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 shutdown_connections 2024-04-25T09:29:05.618 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.632+0000 7f84f5217640 1 -- 172.21.15.53:0/1948240444 wait complete. 2024-04-25T09:29:05.636 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool application enable c703408b-a4c5-4118-ba7e-91b1f88f4328 rados 2024-04-25T09:29:05.783 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.782+0000 7f79da824640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:05.784 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.799+0000 7f79da824640 1 Processor -- start 2024-04-25T09:29:05.784 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.799+0000 7f79da824640 1 -- start start 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.801+0000 7f79da824640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79d41356a0 0x7f79d4139e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.801+0000 7f79da824640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79d4134c80 con 0x7f79d409b460 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.801+0000 7f79da824640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f79d409bf20 con 0x7f79d41356a0 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.801+0000 7f79d37fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f79d41356a0 0x7f79d4139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.801+0000 7f79d3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f79d409b460 0x7f79d4134f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:39198/0 (socket says 172.21.15.53:39198) 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.801+0000 7f79d3fff640 1 -- 172.21.15.53:0/177147485 learned_addr learned my addr 172.21.15.53:0/177147485 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.802+0000 7f79d37fe640 1 -- 172.21.15.53:0/177147485 >> v1:172.21.15.53:6789/0 conn(0x7f79d409b460 legacy=0x7f79d4134f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.802+0000 7f79d37fe640 1 -- 172.21.15.53:0/177147485 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d409c8d0 con 0x7f79d41356a0 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.802+0000 7f79d37fe640 1 --2- 172.21.15.53:0/177147485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 0x7f79d4139e80 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d146b827aeb8cc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.802+0000 7f79d2ffd640 1 -- 172.21.15.53:0/177147485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79c8009d90 con 0x7f79d41356a0 2024-04-25T09:29:05.787 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.802+0000 7f79d2ffd640 1 -- 172.21.15.53:0/177147485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f79c800e230 con 0x7f79d41356a0 2024-04-25T09:29:05.788 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.802+0000 7f79d2ffd640 1 -- 172.21.15.53:0/177147485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79c800e4d0 con 0x7f79d41356a0 2024-04-25T09:29:05.788 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.803+0000 7f79da824640 1 -- 172.21.15.53:0/177147485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 msgr2=0x7f79d4139e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:05.789 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.803+0000 7f79da824640 1 --2- 172.21.15.53:0/177147485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 0x7f79d4139e80 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:05.789 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.803+0000 7f79da824640 1 -- 172.21.15.53:0/177147485 shutdown_connections 2024-04-25T09:29:05.789 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.803+0000 7f79da824640 1 --2- 172.21.15.53:0/177147485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 0x7f79d4139e80 unknown :-1 s=CLOSED pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:05.789 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.803+0000 7f79da824640 1 -- 172.21.15.53:0/177147485 >> 172.21.15.53:0/177147485 conn(0x7f79d40a3c00 msgr2=0x7f79d40a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:05.789 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.803+0000 7f79da824640 1 -- 172.21.15.53:0/177147485 shutdown_connections 2024-04-25T09:29:05.789 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.803+0000 7f79da824640 1 -- 172.21.15.53:0/177147485 wait complete. 2024-04-25T09:29:05.789 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.804+0000 7f79da824640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:05.790 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.806+0000 7f79da824640 1 Processor -- start 2024-04-25T09:29:05.790 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.806+0000 7f79da824640 1 -- start start 2024-04-25T09:29:05.792 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.807+0000 7f79da824640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 0x7f79d41c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:05.793 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.807+0000 7f79da824640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f79d41bf2f0 con 0x7f79d41356a0 2024-04-25T09:29:05.793 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.807+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 0x7f79d41c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:05.793 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.807+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 0x7f79d41c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56356/0 (socket says 172.21.15.53:56356) 2024-04-25T09:29:05.793 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.808+0000 7f79d3fff640 1 -- 172.21.15.53:0/3701960087 learned_addr learned my addr 172.21.15.53:0/3701960087 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:05.793 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.808+0000 7f79d3fff640 1 -- 172.21.15.53:0/3701960087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d4132410 con 0x7f79d41356a0 2024-04-25T09:29:05.793 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.808+0000 7f79d3fff640 1 --2- 172.21.15.53:0/3701960087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 0x7f79d41c97c0 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:05.794 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.808+0000 7f79d0ff9640 1 -- 172.21.15.53:0/3701960087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79c4005a60 con 0x7f79d41356a0 2024-04-25T09:29:05.794 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.808+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d41209b0 con 0x7f79d41356a0 2024-04-25T09:29:05.794 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.808+0000 7f79d0ff9640 1 -- 172.21.15.53:0/3701960087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f79c4005bc0 con 0x7f79d41356a0 2024-04-25T09:29:05.794 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.808+0000 7f79d0ff9640 1 -- 172.21.15.53:0/3701960087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79c4005e60 con 0x7f79d41356a0 2024-04-25T09:29:05.794 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.808+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d40a08d0 con 0x7f79d41356a0 2024-04-25T09:29:05.795 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.809+0000 7f79d0ff9640 1 -- 172.21.15.53:0/3701960087 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f79c40070b0 con 0x7f79d41356a0 2024-04-25T09:29:05.795 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.810+0000 7f79d0ff9640 1 --2- 172.21.15.53:0/3701960087 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f79c0038930 0x7f79c003ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:05.795 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.810+0000 7f79d0ff9640 1 -- 172.21.15.53:0/3701960087 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(701..701 src has 401..701) ==== 4166+0+0 (crc 0 0 0) 0x7f79c40487e0 con 0x7f79d41356a0 2024-04-25T09:29:05.795 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.810+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d40697f0 con 0x7f79d41356a0 2024-04-25T09:29:05.795 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.810+0000 7f79d37fe640 1 --2- 172.21.15.53:0/3701960087 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f79c0038930 0x7f79c003ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:05.796 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.811+0000 7f79d37fe640 1 --2- 172.21.15.53:0/3701960087 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f79c0038930 0x7f79c003ae40 crc :-1 s=READY pgs=3774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:05.801 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:05.816+0000 7f79d0ff9640 1 -- 172.21.15.53:0/3701960087 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f79c400d6f0 con 0x7f79d41356a0 2024-04-25T09:29:05.988 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:06.003+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "app": "rados"} v 0) -- 0x7f79d40681a0 con 0x7f79d41356a0 2024-04-25T09:29:06.427 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:06.443+0000 7f79d0ff9640 1 -- 172.21.15.53:0/3701960087 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "app": "rados"}]=0 enabled application 'rados' on pool 'c703408b-a4c5-4118-ba7e-91b1f88f4328' v702) ==== 213+0+0 (crc 0 0 0) 0x7f79c400d150 con 0x7f79d41356a0 2024-04-25T09:29:06.609 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:06.624+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "app": "rados"} v 0) -- 0x7f79d40a0550 con 0x7f79d41356a0 2024-04-25T09:29:07.431 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.446+0000 7f79d0ff9640 1 -- 172.21.15.53:0/3701960087 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "app": "rados"}]=0 enabled application 'rados' on pool 'c703408b-a4c5-4118-ba7e-91b1f88f4328' v703) ==== 213+0+0 (crc 0 0 0) 0x7f79c400d330 con 0x7f79d41356a0 2024-04-25T09:29:07.431 INFO:tasks.workunit.client.0.smithi053.stderr:enabled application 'rados' on pool 'c703408b-a4c5-4118-ba7e-91b1f88f4328' 2024-04-25T09:29:07.434 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f79c0038930 msgr2=0x7f79c003ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:07.434 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 --2- 172.21.15.53:0/3701960087 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f79c0038930 0x7f79c003ae40 crc :-1 s=READY pgs=3774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:07.435 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 msgr2=0x7f79d41c97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:07.435 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 --2- 172.21.15.53:0/3701960087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 0x7f79d41c97c0 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:07.435 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 shutdown_connections 2024-04-25T09:29:07.435 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 --2- 172.21.15.53:0/3701960087 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f79c0038930 0x7f79c003ae40 unknown :-1 s=CLOSED pgs=3774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:07.435 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 --2- 172.21.15.53:0/3701960087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f79d41356a0 0x7f79d41c97c0 unknown :-1 s=CLOSED pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:07.435 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 >> 172.21.15.53:0/3701960087 conn(0x7f79d40a3c00 msgr2=0x7f79d40a4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:07.435 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 shutdown_connections 2024-04-25T09:29:07.435 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.449+0000 7f79da824640 1 -- 172.21.15.53:0/3701960087 wait complete. 2024-04-25T09:29:07.446 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool set-quota c703408b-a4c5-4118-ba7e-91b1f88f4328 max_objects 10 2024-04-25T09:29:07.550 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.556+0000 7f60ca59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:07.551 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.566+0000 7f60ca59d640 1 Processor -- start 2024-04-25T09:29:07.551 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.566+0000 7f60ca59d640 1 -- start start 2024-04-25T09:29:07.553 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60ca59d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f60c409c280 0x7f60c4136270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60ca59d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60c406fe60 con 0x7f60c4131310 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60ca59d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f60c409c790 con 0x7f60c409c280 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60c3fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f60c4131310 0x7f60c4131720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52324/0 (socket says 172.21.15.53:52324) 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60c3fff640 1 -- 172.21.15.53:0/4243462843 learned_addr learned my addr 172.21.15.53:0/4243462843 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60c37fe640 1 --2- 172.21.15.53:0/4243462843 >> v2:172.21.15.53:3300/0 conn(0x7f60c409c280 0x7f60c4136270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60c2ffd640 1 -- 172.21.15.53:0/4243462843 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848898029 0 0) 0x7f60c406fe60 con 0x7f60c4131310 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60c2ffd640 1 -- 172.21.15.53:0/4243462843 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60ac003580 con 0x7f60c4131310 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60c37fe640 1 -- 172.21.15.53:0/4243462843 >> v1:172.21.15.53:6789/0 conn(0x7f60c4131310 legacy=0x7f60c4131720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.568+0000 7f60c37fe640 1 -- 172.21.15.53:0/4243462843 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c4131e30 con 0x7f60c409c280 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.569+0000 7f60c37fe640 1 --2- 172.21.15.53:0/4243462843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 0x7f60c4136270 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49289e1feea966e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.569+0000 7f60c2ffd640 1 -- 172.21.15.53:0/4243462843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f60b8009d90 con 0x7f60c409c280 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.569+0000 7f60c2ffd640 1 -- 172.21.15.53:0/4243462843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f60b800e230 con 0x7f60c409c280 2024-04-25T09:29:07.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.569+0000 7f60c2ffd640 1 -- 172.21.15.53:0/4243462843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f60b800e4d0 con 0x7f60c409c280 2024-04-25T09:29:07.555 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.570+0000 7f60ca59d640 1 -- 172.21.15.53:0/4243462843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 msgr2=0x7f60c4136270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:07.555 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.570+0000 7f60ca59d640 1 --2- 172.21.15.53:0/4243462843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 0x7f60c4136270 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:07.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.570+0000 7f60ca59d640 1 -- 172.21.15.53:0/4243462843 shutdown_connections 2024-04-25T09:29:07.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.570+0000 7f60ca59d640 1 --2- 172.21.15.53:0/4243462843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 0x7f60c4136270 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:07.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.570+0000 7f60ca59d640 1 -- 172.21.15.53:0/4243462843 >> 172.21.15.53:0/4243462843 conn(0x7f60c40a0680 msgr2=0x7f60c40a0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:07.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.570+0000 7f60ca59d640 1 -- 172.21.15.53:0/4243462843 shutdown_connections 2024-04-25T09:29:07.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.570+0000 7f60ca59d640 1 -- 172.21.15.53:0/4243462843 wait complete. 2024-04-25T09:29:07.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.570+0000 7f60ca59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:07.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.572+0000 7f60ca59d640 1 Processor -- start 2024-04-25T09:29:07.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.572+0000 7f60ca59d640 1 -- start start 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.573+0000 7f60ca59d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 0x7f60c4120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.573+0000 7f60ca59d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f60c4122d40 con 0x7f60c409c280 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.573+0000 7f60c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 0x7f60c4120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.573+0000 7f60c3fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 0x7f60c4120d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60682/0 (socket says 172.21.15.53:60682) 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.573+0000 7f60c3fff640 1 -- 172.21.15.53:0/2570385253 learned_addr learned my addr 172.21.15.53:0/2570385253 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.574+0000 7f60c3fff640 1 -- 172.21.15.53:0/2570385253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c4120900 con 0x7f60c409c280 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.574+0000 7f60c3fff640 1 --2- 172.21.15.53:0/2570385253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 0x7f60c4120d50 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.574+0000 7f60c0ff9640 1 -- 172.21.15.53:0/2570385253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f60b4005a60 con 0x7f60c409c280 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.574+0000 7f60c0ff9640 1 -- 172.21.15.53:0/2570385253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f60b4005bc0 con 0x7f60c409c280 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.574+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c41244c0 con 0x7f60c409c280 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.574+0000 7f60c0ff9640 1 -- 172.21.15.53:0/2570385253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f60b4005e60 con 0x7f60c409c280 2024-04-25T09:29:07.564 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.574+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c4120560 con 0x7f60c409c280 2024-04-25T09:29:07.565 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.575+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c409c8e0 con 0x7f60c409c280 2024-04-25T09:29:07.565 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.575+0000 7f60c0ff9640 1 -- 172.21.15.53:0/2570385253 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f60b40070b0 con 0x7f60c409c280 2024-04-25T09:29:07.565 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.575+0000 7f60c0ff9640 1 --2- 172.21.15.53:0/2570385253 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f60b0038980 0x7f60b003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:07.565 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.575+0000 7f60c0ff9640 1 -- 172.21.15.53:0/2570385253 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(703..703 src has 401..703) ==== 4179+0+0 (crc 0 0 0) 0x7f60b40487a0 con 0x7f60c409c280 2024-04-25T09:29:07.565 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.576+0000 7f60c37fe640 1 --2- 172.21.15.53:0/2570385253 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f60b0038980 0x7f60b003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:07.565 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.576+0000 7f60c37fe640 1 --2- 172.21.15.53:0/2570385253 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f60b0038980 0x7f60b003ae90 crc :-1 s=READY pgs=3775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:07.565 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.581+0000 7f60c0ff9640 1 -- 172.21.15.53:0/2570385253 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f60b400d7f0 con 0x7f60c409c280 2024-04-25T09:29:07.788 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:07.803+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "field": "max_objects", "val": "10"} v 0) -- 0x7f60c40697f0 con 0x7f60c409c280 2024-04-25T09:29:08.099 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:08.114+0000 7f60c0ff9640 1 -- 172.21.15.53:0/2570385253 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool c703408b-a4c5-4118-ba7e-91b1f88f4328 v704) ==== 223+0+0 (crc 0 0 0) 0x7f60b400d610 con 0x7f60c409c280 2024-04-25T09:29:08.214 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:08.229+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "field": "max_objects", "val": "10"} v 0) -- 0x7f60c40008d0 con 0x7f60c409c280 2024-04-25T09:29:09.101 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.115+0000 7f60c0ff9640 1 -- 172.21.15.53:0/2570385253 <== mon.0 v2:172.21.15.53:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool c703408b-a4c5-4118-ba7e-91b1f88f4328 v705) ==== 223+0+0 (crc 0 0 0) 0x7f60b400ee90 con 0x7f60c409c280 2024-04-25T09:29:09.101 INFO:tasks.workunit.client.0.smithi053.stderr:set-quota max_objects = 10 for pool c703408b-a4c5-4118-ba7e-91b1f88f4328 2024-04-25T09:29:09.103 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f60b0038980 msgr2=0x7f60b003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:09.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 --2- 172.21.15.53:0/2570385253 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f60b0038980 0x7f60b003ae90 crc :-1 s=READY pgs=3775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:09.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 msgr2=0x7f60c4120d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:09.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 --2- 172.21.15.53:0/2570385253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 0x7f60c4120d50 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:09.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 shutdown_connections 2024-04-25T09:29:09.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 --2- 172.21.15.53:0/2570385253 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f60b0038980 0x7f60b003ae90 unknown :-1 s=CLOSED pgs=3775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:09.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 --2- 172.21.15.53:0/2570385253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60c409c280 0x7f60c4120d50 unknown :-1 s=CLOSED pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:09.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 >> 172.21.15.53:0/2570385253 conn(0x7f60c40a0680 msgr2=0x7f60c409d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:09.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 shutdown_connections 2024-04-25T09:29:09.104 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:09.118+0000 7f60ca59d640 1 -- 172.21.15.53:0/2570385253 wait complete. 2024-04-25T09:29:09.115 INFO:tasks.workunit.client.0.smithi053.stderr:+ sleep 30 2024-04-25T09:29:39.118 INFO:tasks.workunit.client.0.smithi053.stderr:++ seq 1 10 2024-04-25T09:29:39.119 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.119 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj1 /etc/passwd 2024-04-25T09:29:39.164 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.179+0000 7fed9aa33ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.170 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.185+0000 7fed9aa33ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.185+0000 7fed9aa33ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.186+0000 7fed9aa33ec0 1 Processor -- start 2024-04-25T09:29:39.171 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.186+0000 7fed9aa33ec0 1 -- start start 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.188+0000 7fed9aa33ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x856610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.188+0000 7fed9aa33ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7bb950 con 0x8546a0 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.188+0000 7fed92b9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x856610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.188+0000 7fed92b9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x856610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39366/0 (socket says 172.21.15.53:39366) 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.188+0000 7fed92b9b640 1 -- 172.21.15.53:0/478699180 learned_addr learned my addr 172.21.15.53:0/478699180 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.188+0000 7fed92b9b640 1 -- 172.21.15.53:0/478699180 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x75a1e0 con 0x8546a0 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.189+0000 7fed92b9b640 1 --2- 172.21.15.53:0/478699180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x856610 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b893030a95265a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.189+0000 7fed91398640 1 -- 172.21.15.53:0/478699180 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed840060b0 con 0x8546a0 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.189+0000 7fed91398640 1 -- 172.21.15.53:0/478699180 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed84006210 con 0x8546a0 2024-04-25T09:29:39.174 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.189+0000 7fed91398640 1 -- 172.21.15.53:0/478699180 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed84001a70 con 0x8546a0 2024-04-25T09:29:39.175 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.189+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/478699180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 msgr2=0x856610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.189+0000 7fed9aa33ec0 1 --2- 172.21.15.53:0/478699180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x856610 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.189+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/478699180 shutdown_connections 2024-04-25T09:29:39.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.189+0000 7fed9aa33ec0 1 --2- 172.21.15.53:0/478699180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x856610 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.189+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/478699180 >> 172.21.15.53:0/478699180 conn(0x772960 msgr2=0x970330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.190+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/478699180 shutdown_connections 2024-04-25T09:29:39.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.190+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/478699180 wait complete. 2024-04-25T09:29:39.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.191+0000 7fed9aa33ec0 1 Processor -- start 2024-04-25T09:29:39.176 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.191+0000 7fed9aa33ec0 1 -- start start 2024-04-25T09:29:39.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.192+0000 7fed9aa33ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x97cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.192+0000 7fed9aa33ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7b93d0 con 0x8546a0 2024-04-25T09:29:39.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.192+0000 7fed92b9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x97cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.192+0000 7fed92b9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x97cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39376/0 (socket says 172.21.15.53:39376) 2024-04-25T09:29:39.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.192+0000 7fed92b9b640 1 -- 172.21.15.53:0/3446209339 learned_addr learned my addr 172.21.15.53:0/3446209339 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.193+0000 7fed92b9b640 1 -- 172.21.15.53:0/3446209339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x74ce30 con 0x8546a0 2024-04-25T09:29:39.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.193+0000 7fed92b9b640 1 --2- 172.21.15.53:0/3446209339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x97cbf0 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.193+0000 7fed8b7fe640 1 -- 172.21.15.53:0/3446209339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed84004a20 con 0x8546a0 2024-04-25T09:29:39.178 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.193+0000 7fed8b7fe640 1 -- 172.21.15.53:0/3446209339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed84004b80 con 0x8546a0 2024-04-25T09:29:39.179 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.193+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x74c890 con 0x8546a0 2024-04-25T09:29:39.179 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.193+0000 7fed8b7fe640 1 -- 172.21.15.53:0/3446209339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed84004e20 con 0x8546a0 2024-04-25T09:29:39.179 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.193+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x96c7a0 con 0x8546a0 2024-04-25T09:29:39.180 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.194+0000 7fed8b7fe640 1 -- 172.21.15.53:0/3446209339 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fed84010440 con 0x8546a0 2024-04-25T09:29:39.180 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.194+0000 7fed8b7fe640 1 --2- 172.21.15.53:0/3446209339 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fed6c037210 0x7fed6c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.180 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.194+0000 7fed8b7fe640 1 -- 172.21.15.53:0/3446209339 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7fed84049d70 con 0x8546a0 2024-04-25T09:29:39.180 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.195+0000 7fed9aa33ec0 1 --2- 172.21.15.53:0/3446209339 >> v2:172.21.15.151:6806/46311736 conn(0x854ab0 0x958680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.180 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.195+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 --> v2:172.21.15.151:6806/46311736 -- osd_op(unknown.0.0:1 201.7 201:ff7b1f36:::obj1:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x95b5b0 con 0x854ab0 2024-04-25T09:29:39.180 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.195+0000 7fed9239a640 1 --2- 172.21.15.53:0/3446209339 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fed6c037210 0x7fed6c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.181 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.195+0000 7fed9239a640 1 --2- 172.21.15.53:0/3446209339 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fed6c037210 0x7fed6c039720 crc :-1 s=READY pgs=3776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.181 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.195+0000 7fed9339c640 1 --2- 172.21.15.53:0/3446209339 >> v2:172.21.15.151:6806/46311736 conn(0x854ab0 0x958680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.183 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.199+0000 7fed9339c640 1 --2- 172.21.15.53:0/3446209339 >> v2:172.21.15.151:6806/46311736 conn(0x854ab0 0x958680 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.197 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.211+0000 7fed9339c640 1 -- 172.21.15.53:0/3446209339 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== osd_op_reply(1 obj1 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fed7c00c430 con 0x854ab0 2024-04-25T09:29:39.197 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 >> v2:172.21.15.151:6806/46311736 conn(0x854ab0 msgr2=0x958680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.197 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 --2- 172.21.15.53:0/3446209339 >> v2:172.21.15.151:6806/46311736 conn(0x854ab0 0x958680 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.197 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fed6c037210 msgr2=0x7fed6c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.197 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 --2- 172.21.15.53:0/3446209339 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fed6c037210 0x7fed6c039720 crc :-1 s=READY pgs=3776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.197 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 msgr2=0x97cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.197 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 --2- 172.21.15.53:0/3446209339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x97cbf0 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.197 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 shutdown_connections 2024-04-25T09:29:39.198 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 --2- 172.21.15.53:0/3446209339 >> v2:172.21.15.151:6806/46311736 conn(0x854ab0 0x958680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.198 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 --2- 172.21.15.53:0/3446209339 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fed6c037210 0x7fed6c039720 unknown :-1 s=CLOSED pgs=3776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.198 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 --2- 172.21.15.53:0/3446209339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x8546a0 0x97cbf0 unknown :-1 s=CLOSED pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.198 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 >> 172.21.15.53:0/3446209339 conn(0x772960 msgr2=0x970140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.198 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 shutdown_connections 2024-04-25T09:29:39.198 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.212+0000 7fed9aa33ec0 1 -- 172.21.15.53:0/3446209339 wait complete. 2024-04-25T09:29:39.199 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.200 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj2 /etc/passwd 2024-04-25T09:29:39.238 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.254+0000 7f652723cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.244 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.260+0000 7f652723cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.244 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.260+0000 7f652723cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.245 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.261+0000 7f652723cec0 1 Processor -- start 2024-04-25T09:29:39.245 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.261+0000 7f652723cec0 1 -- start start 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.262+0000 7f652723cec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x2465c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.262+0000 7f652723cec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x2339950 con 0x23d1cb0 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.262+0000 7f651f39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x2465c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.262+0000 7f651f39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x2465c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39404/0 (socket says 172.21.15.53:39404) 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.262+0000 7f651f39b640 1 -- 172.21.15.53:0/3078762266 learned_addr learned my addr 172.21.15.53:0/3078762266 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.263+0000 7f651f39b640 1 -- 172.21.15.53:0/3078762266 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x22d81e0 con 0x23d1cb0 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.263+0000 7f651f39b640 1 --2- 172.21.15.53:0/3078762266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x2465c70 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f888683da53edf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.263+0000 7f651db98640 1 -- 172.21.15.53:0/3078762266 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f65080061e0 con 0x23d1cb0 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.263+0000 7f651db98640 1 -- 172.21.15.53:0/3078762266 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6508006340 con 0x23d1cb0 2024-04-25T09:29:39.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.263+0000 7f651db98640 1 -- 172.21.15.53:0/3078762266 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6508004880 con 0x23d1cb0 2024-04-25T09:29:39.249 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.263+0000 7f652723cec0 1 -- 172.21.15.53:0/3078762266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 msgr2=0x2465c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.249 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.263+0000 7f652723cec0 1 --2- 172.21.15.53:0/3078762266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x2465c70 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.250 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.264+0000 7f652723cec0 1 -- 172.21.15.53:0/3078762266 shutdown_connections 2024-04-25T09:29:39.250 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.264+0000 7f652723cec0 1 --2- 172.21.15.53:0/3078762266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x2465c70 unknown :-1 s=CLOSED pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.250 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.264+0000 7f652723cec0 1 -- 172.21.15.53:0/3078762266 >> 172.21.15.53:0/3078762266 conn(0x22f0960 msgr2=0x23d6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.250 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.264+0000 7f652723cec0 1 -- 172.21.15.53:0/3078762266 shutdown_connections 2024-04-25T09:29:39.250 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.264+0000 7f652723cec0 1 -- 172.21.15.53:0/3078762266 wait complete. 2024-04-25T09:29:39.250 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.265+0000 7f652723cec0 1 Processor -- start 2024-04-25T09:29:39.250 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.265+0000 7f652723cec0 1 -- start start 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.266+0000 7f652723cec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x246af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.266+0000 7f652723cec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x23373d0 con 0x23d1cb0 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.266+0000 7f651f39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x246af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.266+0000 7f651f39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x246af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39412/0 (socket says 172.21.15.53:39412) 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.266+0000 7f651f39b640 1 -- 172.21.15.53:0/2972903533 learned_addr learned my addr 172.21.15.53:0/2972903533 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.267+0000 7f651f39b640 1 -- 172.21.15.53:0/2972903533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x22cae30 con 0x23d1cb0 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.267+0000 7f651f39b640 1 --2- 172.21.15.53:0/2972903533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x246af70 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.267+0000 7f651cb96640 1 -- 172.21.15.53:0/2972903533 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6508001ba0 con 0x23d1cb0 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.267+0000 7f651cb96640 1 -- 172.21.15.53:0/2972903533 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6508001d00 con 0x23d1cb0 2024-04-25T09:29:39.252 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.267+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x22ca890 con 0x23d1cb0 2024-04-25T09:29:39.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.267+0000 7f651cb96640 1 -- 172.21.15.53:0/2972903533 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6508001fa0 con 0x23d1cb0 2024-04-25T09:29:39.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.267+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x246ac50 con 0x23d1cb0 2024-04-25T09:29:39.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.268+0000 7f651cb96640 1 -- 172.21.15.53:0/2972903533 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f6508014410 con 0x23d1cb0 2024-04-25T09:29:39.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.268+0000 7f651cb96640 1 --2- 172.21.15.53:0/2972903533 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f64f80371c0 0x7f64f80396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.268+0000 7f651cb96640 1 -- 172.21.15.53:0/2972903533 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7f65080489a0 con 0x23d1cb0 2024-04-25T09:29:39.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.268+0000 7f652723cec0 1 --2- 172.21.15.53:0/2972903533 >> v2:172.21.15.151:6805/3300556569 conn(0x2467950 0x24fb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.268+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 --> v2:172.21.15.151:6805/3300556569 -- osd_op(unknown.0.0:1 201.8 201:104778fc:::obj2:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x246a410 con 0x2467950 2024-04-25T09:29:39.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.269+0000 7f651eb9a640 1 --2- 172.21.15.53:0/2972903533 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f64f80371c0 0x7f64f80396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.255 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.269+0000 7f651eb9a640 1 --2- 172.21.15.53:0/2972903533 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f64f80371c0 0x7f64f80396d0 crc :-1 s=READY pgs=3777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.255 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.269+0000 7f651fb9c640 1 --2- 172.21.15.53:0/2972903533 >> v2:172.21.15.151:6805/3300556569 conn(0x2467950 0x24fb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.257 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.273+0000 7f651fb9c640 1 --2- 172.21.15.53:0/2972903533 >> v2:172.21.15.151:6805/3300556569 conn(0x2467950 0x24fb450 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.270 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f651fb9c640 1 -- 172.21.15.53:0/2972903533 <== osd.2 v2:172.21.15.151:6805/3300556569 1 ==== osd_op_reply(1 obj2 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f651000c430 con 0x2467950 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 >> v2:172.21.15.151:6805/3300556569 conn(0x2467950 msgr2=0x24fb450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 --2- 172.21.15.53:0/2972903533 >> v2:172.21.15.151:6805/3300556569 conn(0x2467950 0x24fb450 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f64f80371c0 msgr2=0x7f64f80396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 --2- 172.21.15.53:0/2972903533 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f64f80371c0 0x7f64f80396d0 crc :-1 s=READY pgs=3777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 msgr2=0x246af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 --2- 172.21.15.53:0/2972903533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x246af70 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 shutdown_connections 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 --2- 172.21.15.53:0/2972903533 >> v2:172.21.15.151:6805/3300556569 conn(0x2467950 0x24fb450 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 --2- 172.21.15.53:0/2972903533 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f64f80371c0 0x7f64f80396d0 unknown :-1 s=CLOSED pgs=3777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 --2- 172.21.15.53:0/2972903533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x23d1cb0 0x246af70 unknown :-1 s=CLOSED pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 >> 172.21.15.53:0/2972903533 conn(0x22f0960 msgr2=0x23d6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 shutdown_connections 2024-04-25T09:29:39.271 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.285+0000 7f652723cec0 1 -- 172.21.15.53:0/2972903533 wait complete. 2024-04-25T09:29:39.273 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.273 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj3 /etc/passwd 2024-04-25T09:29:39.310 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.325+0000 7f98b1f28ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.315 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.331+0000 7f98b1f28ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.316 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.331+0000 7f98b1f28ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.317 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.332+0000 7f98b1f28ec0 1 Processor -- start 2024-04-25T09:29:39.317 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.332+0000 7f98b1f28ec0 1 -- start start 2024-04-25T09:29:39.320 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.333+0000 7f98b1f28ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x23be500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.320 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.333+0000 7f98b1f28ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x220b950 con 0x22a6450 2024-04-25T09:29:39.320 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.333+0000 7f98a9b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x23be500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.333+0000 7f98a9b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x23be500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39428/0 (socket says 172.21.15.53:39428) 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.334+0000 7f98a9b9a640 1 -- 172.21.15.53:0/3510750123 learned_addr learned my addr 172.21.15.53:0/3510750123 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.334+0000 7f98a9b9a640 1 -- 172.21.15.53:0/3510750123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x21aa1e0 con 0x22a6450 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.334+0000 7f98a9b9a640 1 --2- 172.21.15.53:0/3510750123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x23be500 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82da1b3ceefe26c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.334+0000 7f989bfff640 1 -- 172.21.15.53:0/3510750123 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f98a0032040 con 0x22a6450 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.334+0000 7f989bfff640 1 -- 172.21.15.53:0/3510750123 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f98a000a040 con 0x22a6450 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.334+0000 7f989bfff640 1 -- 172.21.15.53:0/3510750123 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f98a000a2e0 con 0x22a6450 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.335+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/3510750123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 msgr2=0x23be500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.335+0000 7f98b1f28ec0 1 --2- 172.21.15.53:0/3510750123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x23be500 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.335+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/3510750123 shutdown_connections 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.335+0000 7f98b1f28ec0 1 --2- 172.21.15.53:0/3510750123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x23be500 unknown :-1 s=CLOSED pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.335+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/3510750123 >> 172.21.15.53:0/3510750123 conn(0x21c2960 msgr2=0x229fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.335+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/3510750123 shutdown_connections 2024-04-25T09:29:39.321 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.335+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/3510750123 wait complete. 2024-04-25T09:29:39.323 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.336+0000 7f98b1f28ec0 1 Processor -- start 2024-04-25T09:29:39.323 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.336+0000 7f98b1f28ec0 1 -- start start 2024-04-25T09:29:39.323 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.337+0000 7f98b1f28ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x2334a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.323 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.337+0000 7f98b1f28ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x22093d0 con 0x22a6450 2024-04-25T09:29:39.323 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.337+0000 7f98a9b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x2334a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.323 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.337+0000 7f98a9b9a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x2334a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39440/0 (socket says 172.21.15.53:39440) 2024-04-25T09:29:39.324 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.337+0000 7f98a9b9a640 1 -- 172.21.15.53:0/1125300738 learned_addr learned my addr 172.21.15.53:0/1125300738 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.324 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.338+0000 7f98a9b9a640 1 -- 172.21.15.53:0/1125300738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x219ce30 con 0x22a6450 2024-04-25T09:29:39.324 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.338+0000 7f98a9b9a640 1 --2- 172.21.15.53:0/1125300738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x2334a90 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.324 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.338+0000 7f989affd640 1 -- 172.21.15.53:0/1125300738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f98a002d780 con 0x22a6450 2024-04-25T09:29:39.324 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.338+0000 7f989affd640 1 -- 172.21.15.53:0/1125300738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f98a002d8e0 con 0x22a6450 2024-04-25T09:29:39.324 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.338+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x219c890 con 0x22a6450 2024-04-25T09:29:39.324 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.338+0000 7f989affd640 1 -- 172.21.15.53:0/1125300738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f98a002db80 con 0x22a6450 2024-04-25T09:29:39.324 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.338+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2323980 con 0x22a6450 2024-04-25T09:29:39.326 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.339+0000 7f989affd640 1 -- 172.21.15.53:0/1125300738 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f98a002dd30 con 0x22a6450 2024-04-25T09:29:39.326 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.339+0000 7f989affd640 1 --2- 172.21.15.53:0/1125300738 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9888037260 0x7f9888039770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.326 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.339+0000 7f989affd640 1 -- 172.21.15.53:0/1125300738 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7f98a0032040 con 0x22a6450 2024-04-25T09:29:39.326 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.339+0000 7f98b1f28ec0 1 --2- 172.21.15.53:0/1125300738 >> v2:172.21.15.53:6805/3736905990 conn(0x23389c0 0x2321570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.326 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.339+0000 7f98a9399640 1 --2- 172.21.15.53:0/1125300738 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9888037260 0x7f9888039770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.326 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.339+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:1 201.1 201:8dd16f86:::obj3:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x23247d0 con 0x23389c0 2024-04-25T09:29:39.326 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.340+0000 7f98a9399640 1 --2- 172.21.15.53:0/1125300738 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9888037260 0x7f9888039770 crc :-1 s=READY pgs=3778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.326 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.340+0000 7f98aa39b640 1 --2- 172.21.15.53:0/1125300738 >> v2:172.21.15.53:6805/3736905990 conn(0x23389c0 0x2321570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.329 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.344+0000 7f98aa39b640 1 --2- 172.21.15.53:0/1125300738 >> v2:172.21.15.53:6805/3736905990 conn(0x23389c0 0x2321570 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98aa39b640 1 -- 172.21.15.53:0/1125300738 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(1 obj3 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f989c00a430 con 0x23389c0 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 >> v2:172.21.15.53:6805/3736905990 conn(0x23389c0 msgr2=0x2321570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 --2- 172.21.15.53:0/1125300738 >> v2:172.21.15.53:6805/3736905990 conn(0x23389c0 0x2321570 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9888037260 msgr2=0x7f9888039770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 --2- 172.21.15.53:0/1125300738 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9888037260 0x7f9888039770 crc :-1 s=READY pgs=3778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 msgr2=0x2334a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 --2- 172.21.15.53:0/1125300738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x2334a90 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 shutdown_connections 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 --2- 172.21.15.53:0/1125300738 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9888037260 0x7f9888039770 unknown :-1 s=CLOSED pgs=3778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 --2- 172.21.15.53:0/1125300738 >> v2:172.21.15.53:6805/3736905990 conn(0x23389c0 0x2321570 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.342 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 --2- 172.21.15.53:0/1125300738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x22a6450 0x2334a90 unknown :-1 s=CLOSED pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.343 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 >> 172.21.15.53:0/1125300738 conn(0x21c2960 msgr2=0x229fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.343 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 shutdown_connections 2024-04-25T09:29:39.343 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.356+0000 7f98b1f28ec0 1 -- 172.21.15.53:0/1125300738 wait complete. 2024-04-25T09:29:39.344 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.344 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj4 /etc/passwd 2024-04-25T09:29:39.380 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.396+0000 7face7724ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.386 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.401+0000 7face7724ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.386 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.401+0000 7face7724ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.387 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.402+0000 7face7724ec0 1 Processor -- start 2024-04-25T09:29:39.387 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.402+0000 7face7724ec0 1 -- start start 2024-04-25T09:29:39.390 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7face7724ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xeb4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.390 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7face7724ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0xe20950 con 0xf4d9c0 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7facdaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xeb4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7facdaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xeb4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39464/0 (socket says 172.21.15.53:39464) 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7facdaffd640 1 -- 172.21.15.53:0/3137336209 learned_addr learned my addr 172.21.15.53:0/3137336209 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7facdaffd640 1 -- 172.21.15.53:0/3137336209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdbf1e0 con 0xf4d9c0 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7facdaffd640 1 --2- 172.21.15.53:0/3137336209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xeb4270 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593013b4e1fcb367 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7facd97fa640 1 -- 172.21.15.53:0/3137336209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faccc00c490 con 0xf4d9c0 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7facd97fa640 1 -- 172.21.15.53:0/3137336209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faccc00c5f0 con 0xf4d9c0 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.404+0000 7facd97fa640 1 -- 172.21.15.53:0/3137336209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faccc00c890 con 0xf4d9c0 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.405+0000 7face7724ec0 1 -- 172.21.15.53:0/3137336209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 msgr2=0xeb4270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.405+0000 7face7724ec0 1 --2- 172.21.15.53:0/3137336209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xeb4270 crc :-1 s=READY pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.405+0000 7face7724ec0 1 -- 172.21.15.53:0/3137336209 shutdown_connections 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.405+0000 7face7724ec0 1 --2- 172.21.15.53:0/3137336209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xeb4270 unknown :-1 s=CLOSED pgs=12947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.391 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.405+0000 7face7724ec0 1 -- 172.21.15.53:0/3137336209 >> 172.21.15.53:0/3137336209 conn(0xdd7960 msgr2=0xf4b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.392 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.405+0000 7face7724ec0 1 -- 172.21.15.53:0/3137336209 shutdown_connections 2024-04-25T09:29:39.392 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.405+0000 7face7724ec0 1 -- 172.21.15.53:0/3137336209 wait complete. 2024-04-25T09:29:39.393 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.406+0000 7face7724ec0 1 Processor -- start 2024-04-25T09:29:39.393 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.406+0000 7face7724ec0 1 -- start start 2024-04-25T09:29:39.393 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7face7724ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xfe4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.393 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7face7724ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0xe1e3d0 con 0xf4d9c0 2024-04-25T09:29:39.393 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7facdaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xfe4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7facdaffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xfe4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39476/0 (socket says 172.21.15.53:39476) 2024-04-25T09:29:39.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7facdaffd640 1 -- 172.21.15.53:0/3798411403 learned_addr learned my addr 172.21.15.53:0/3798411403 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7facdaffd640 1 -- 172.21.15.53:0/3798411403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdb1e30 con 0xf4d9c0 2024-04-25T09:29:39.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7facdaffd640 1 --2- 172.21.15.53:0/3798411403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xfe4dd0 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7facc3fff640 1 -- 172.21.15.53:0/3798411403 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faccc016040 con 0xf4d9c0 2024-04-25T09:29:39.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7facc3fff640 1 -- 172.21.15.53:0/3798411403 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faccc011900 con 0xf4d9c0 2024-04-25T09:29:39.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7facc3fff640 1 -- 172.21.15.53:0/3798411403 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faccc011ba0 con 0xf4d9c0 2024-04-25T09:29:39.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xdb1890 con 0xf4d9c0 2024-04-25T09:29:39.394 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.408+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0xeb5020 con 0xf4d9c0 2024-04-25T09:29:39.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.409+0000 7facc3fff640 1 -- 172.21.15.53:0/3798411403 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7faccc00e440 con 0xf4d9c0 2024-04-25T09:29:39.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.409+0000 7facc3fff640 1 --2- 172.21.15.53:0/3798411403 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7facc80371c0 0x7facc80396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.410+0000 7facc3fff640 1 -- 172.21.15.53:0/3798411403 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7faccc048f20 con 0xf4d9c0 2024-04-25T09:29:39.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.410+0000 7face7724ec0 1 --2- 172.21.15.53:0/3798411403 >> v2:172.21.15.151:6806/46311736 conn(0xf50800 0xf3a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.395 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.410+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 --> v2:172.21.15.151:6806/46311736 -- osd_op(unknown.0.0:1 201.0 201:0ee9ae15:::obj4:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0xf3d0c0 con 0xf50800 2024-04-25T09:29:39.396 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.410+0000 7facda7fc640 1 --2- 172.21.15.53:0/3798411403 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7facc80371c0 0x7facc80396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.396 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.410+0000 7facda7fc640 1 --2- 172.21.15.53:0/3798411403 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7facc80371c0 0x7facc80396d0 crc :-1 s=READY pgs=3779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.396 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.411+0000 7facdb7fe640 1 --2- 172.21.15.53:0/3798411403 >> v2:172.21.15.151:6806/46311736 conn(0xf50800 0xf3a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.400 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.416+0000 7facdb7fe640 1 --2- 172.21.15.53:0/3798411403 >> v2:172.21.15.151:6806/46311736 conn(0xf50800 0xf3a9b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.414 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7facdb7fe640 1 -- 172.21.15.53:0/3798411403 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== osd_op_reply(1 obj4 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7facd400a430 con 0xf50800 2024-04-25T09:29:39.415 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 >> v2:172.21.15.151:6806/46311736 conn(0xf50800 msgr2=0xf3a9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.415 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 --2- 172.21.15.53:0/3798411403 >> v2:172.21.15.151:6806/46311736 conn(0xf50800 0xf3a9b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.415 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7facc80371c0 msgr2=0x7facc80396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.415 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 --2- 172.21.15.53:0/3798411403 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7facc80371c0 0x7facc80396d0 crc :-1 s=READY pgs=3779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.415 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 msgr2=0xfe4dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.415 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 --2- 172.21.15.53:0/3798411403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xfe4dd0 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.415 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 shutdown_connections 2024-04-25T09:29:39.415 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 --2- 172.21.15.53:0/3798411403 >> v2:172.21.15.151:6806/46311736 conn(0xf50800 0xf3a9b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.415 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 --2- 172.21.15.53:0/3798411403 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7facc80371c0 0x7facc80396d0 unknown :-1 s=CLOSED pgs=3779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.416 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 --2- 172.21.15.53:0/3798411403 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0xf4d9c0 0xfe4dd0 unknown :-1 s=CLOSED pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.416 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 >> 172.21.15.53:0/3798411403 conn(0xdd7960 msgr2=0xf4b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.416 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 shutdown_connections 2024-04-25T09:29:39.416 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.429+0000 7face7724ec0 1 -- 172.21.15.53:0/3798411403 wait complete. 2024-04-25T09:29:39.416 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.417 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj5 /etc/passwd 2024-04-25T09:29:39.452 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.468+0000 7f9a54726ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.458 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.473+0000 7f9a54726ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.458 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.473+0000 7f9a54726ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.459 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.474+0000 7f9a54726ec0 1 Processor -- start 2024-04-25T09:29:39.459 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.474+0000 7f9a54726ec0 1 -- start start 2024-04-25T09:29:39.461 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.476+0000 7f9a54726ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1ec3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.461 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.476+0000 7f9a54726ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1d0c950 con 0x1da2bc0 2024-04-25T09:29:39.462 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.476+0000 7f9a4cb9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1ec3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.462 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.476+0000 7f9a4cb9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1ec3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39496/0 (socket says 172.21.15.53:39496) 2024-04-25T09:29:39.462 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.476+0000 7f9a4cb9b640 1 -- 172.21.15.53:0/3176273874 learned_addr learned my addr 172.21.15.53:0/3176273874 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.462 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.476+0000 7f9a4cb9b640 1 -- 172.21.15.53:0/3176273874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1cab1e0 con 0x1da2bc0 2024-04-25T09:29:39.462 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a4cb9b640 1 --2- 172.21.15.53:0/3176273874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1ec3ce0 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f035a0aee40bc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.462 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a467fc640 1 -- 172.21.15.53:0/3176273874 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a4002f980 con 0x1da2bc0 2024-04-25T09:29:39.462 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a467fc640 1 -- 172.21.15.53:0/3176273874 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a4002fae0 con 0x1da2bc0 2024-04-25T09:29:39.462 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a467fc640 1 -- 172.21.15.53:0/3176273874 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a4002fd80 con 0x1da2bc0 2024-04-25T09:29:39.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3176273874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 msgr2=0x1ec3ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a54726ec0 1 --2- 172.21.15.53:0/3176273874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1ec3ce0 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.463 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3176273874 shutdown_connections 2024-04-25T09:29:39.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a54726ec0 1 --2- 172.21.15.53:0/3176273874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1ec3ce0 unknown :-1 s=CLOSED pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3176273874 >> 172.21.15.53:0/3176273874 conn(0x1cc3960 msgr2=0x1d9d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3176273874 shutdown_connections 2024-04-25T09:29:39.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.477+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3176273874 wait complete. 2024-04-25T09:29:39.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.478+0000 7f9a54726ec0 1 Processor -- start 2024-04-25T09:29:39.464 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.478+0000 7f9a54726ec0 1 -- start start 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.480+0000 7f9a54726ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1eab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.480+0000 7f9a54726ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1d0a3d0 con 0x1da2bc0 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.480+0000 7f9a4cb9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1eab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.480+0000 7f9a4cb9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1eab710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39504/0 (socket says 172.21.15.53:39504) 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.480+0000 7f9a4cb9b640 1 -- 172.21.15.53:0/3504216217 learned_addr learned my addr 172.21.15.53:0/3504216217 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.480+0000 7f9a4cb9b640 1 -- 172.21.15.53:0/3504216217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c9de30 con 0x1da2bc0 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.480+0000 7f9a4cb9b640 1 --2- 172.21.15.53:0/3504216217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1eab710 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.481+0000 7f9a457fa640 1 -- 172.21.15.53:0/3504216217 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a40034970 con 0x1da2bc0 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.481+0000 7f9a457fa640 1 -- 172.21.15.53:0/3504216217 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a40034ad0 con 0x1da2bc0 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.481+0000 7f9a457fa640 1 -- 172.21.15.53:0/3504216217 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a40034d70 con 0x1da2bc0 2024-04-25T09:29:39.466 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.481+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c9d890 con 0x1da2bc0 2024-04-25T09:29:39.467 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.481+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1ec7450 con 0x1da2bc0 2024-04-25T09:29:39.468 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.482+0000 7f9a457fa640 1 -- 172.21.15.53:0/3504216217 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9a40030040 con 0x1da2bc0 2024-04-25T09:29:39.468 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.482+0000 7f9a457fa640 1 --2- 172.21.15.53:0/3504216217 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9a28037210 0x7f9a28039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.468 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.482+0000 7f9a457fa640 1 -- 172.21.15.53:0/3504216217 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7f9a40039040 con 0x1da2bc0 2024-04-25T09:29:39.468 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.482+0000 7f9a54726ec0 1 --2- 172.21.15.53:0/3504216217 >> v2:172.21.15.53:6801/3778022725 conn(0x1da5350 0x1ec3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.468 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.482+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 --> v2:172.21.15.53:6801/3778022725 -- osd_op(unknown.0.0:1 201.3 201:c52c9666:::obj5:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x1eae940 con 0x1da5350 2024-04-25T09:29:39.468 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.482+0000 7f9a477fe640 1 --2- 172.21.15.53:0/3504216217 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9a28037210 0x7f9a28039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.468 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.483+0000 7f9a477fe640 1 --2- 172.21.15.53:0/3504216217 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9a28037210 0x7f9a28039720 crc :-1 s=READY pgs=3780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.468 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.483+0000 7f9a4d39c640 1 --2- 172.21.15.53:0/3504216217 >> v2:172.21.15.53:6801/3778022725 conn(0x1da5350 0x1ec3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.471 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.486+0000 7f9a4d39c640 1 --2- 172.21.15.53:0/3504216217 >> v2:172.21.15.53:6801/3778022725 conn(0x1da5350 0x1ec3490 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a4d39c640 1 -- 172.21.15.53:0/3504216217 <== osd.0 v2:172.21.15.53:6801/3778022725 1 ==== osd_op_reply(1 obj5 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f9a3800c430 con 0x1da5350 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 >> v2:172.21.15.53:6801/3778022725 conn(0x1da5350 msgr2=0x1ec3490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 --2- 172.21.15.53:0/3504216217 >> v2:172.21.15.53:6801/3778022725 conn(0x1da5350 0x1ec3490 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9a28037210 msgr2=0x7f9a28039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 --2- 172.21.15.53:0/3504216217 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9a28037210 0x7f9a28039720 crc :-1 s=READY pgs=3780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 msgr2=0x1eab710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 --2- 172.21.15.53:0/3504216217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1eab710 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 shutdown_connections 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 --2- 172.21.15.53:0/3504216217 >> v2:172.21.15.53:6801/3778022725 conn(0x1da5350 0x1ec3490 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 --2- 172.21.15.53:0/3504216217 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f9a28037210 0x7f9a28039720 unknown :-1 s=CLOSED pgs=3780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.498+0000 7f9a54726ec0 1 --2- 172.21.15.53:0/3504216217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1da2bc0 0x1eab710 unknown :-1 s=CLOSED pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.499+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 >> 172.21.15.53:0/3504216217 conn(0x1cc3960 msgr2=0x1d9d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.499+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 shutdown_connections 2024-04-25T09:29:39.484 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.499+0000 7f9a54726ec0 1 -- 172.21.15.53:0/3504216217 wait complete. 2024-04-25T09:29:39.486 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.486 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj6 /etc/passwd 2024-04-25T09:29:39.522 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.537+0000 7fbd4fd82ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.528 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.543+0000 7fbd4fd82ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.528 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.543+0000 7fbd4fd82ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.528 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.544+0000 7fbd4fd82ec0 1 Processor -- start 2024-04-25T09:29:39.528 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.544+0000 7fbd4fd82ec0 1 -- start start 2024-04-25T09:29:39.532 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.545+0000 7fbd4fd82ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2590270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.532 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.545+0000 7fbd4fd82ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x24fc950 con 0x26299c0 2024-04-25T09:29:39.532 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.545+0000 7fbd437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2590270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.532 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.545+0000 7fbd437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2590270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39510/0 (socket says 172.21.15.53:39510) 2024-04-25T09:29:39.532 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.545+0000 7fbd437fe640 1 -- 172.21.15.53:0/893893282 learned_addr learned my addr 172.21.15.53:0/893893282 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.532 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.546+0000 7fbd437fe640 1 -- 172.21.15.53:0/893893282 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x249b1e0 con 0x26299c0 2024-04-25T09:29:39.532 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.546+0000 7fbd437fe640 1 --2- 172.21.15.53:0/893893282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2590270 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9679faa06a84f9ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.532 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.546+0000 7fbd41ffb640 1 -- 172.21.15.53:0/893893282 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd3400b500 con 0x26299c0 2024-04-25T09:29:39.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.546+0000 7fbd41ffb640 1 -- 172.21.15.53:0/893893282 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbd3400b660 con 0x26299c0 2024-04-25T09:29:39.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.546+0000 7fbd41ffb640 1 -- 172.21.15.53:0/893893282 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd3400b900 con 0x26299c0 2024-04-25T09:29:39.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.547+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/893893282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 msgr2=0x2590270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.547+0000 7fbd4fd82ec0 1 --2- 172.21.15.53:0/893893282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2590270 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.547+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/893893282 shutdown_connections 2024-04-25T09:29:39.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.547+0000 7fbd4fd82ec0 1 --2- 172.21.15.53:0/893893282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2590270 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.547+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/893893282 >> 172.21.15.53:0/893893282 conn(0x24b3960 msgr2=0x26273f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.547+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/893893282 shutdown_connections 2024-04-25T09:29:39.533 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.547+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/893893282 wait complete. 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.548+0000 7fbd4fd82ec0 1 Processor -- start 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.548+0000 7fbd4fd82ec0 1 -- start start 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.549+0000 7fbd4fd82ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2614190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.549+0000 7fbd4fd82ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x24fa3d0 con 0x26299c0 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.549+0000 7fbd437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2614190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.549+0000 7fbd437fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2614190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39520/0 (socket says 172.21.15.53:39520) 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.549+0000 7fbd437fe640 1 -- 172.21.15.53:0/1236003732 learned_addr learned my addr 172.21.15.53:0/1236003732 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.549+0000 7fbd437fe640 1 -- 172.21.15.53:0/1236003732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x248de30 con 0x26299c0 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.550+0000 7fbd437fe640 1 --2- 172.21.15.53:0/1236003732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2614190 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.535 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.550+0000 7fbd40ff9640 1 -- 172.21.15.53:0/1236003732 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd340110b0 con 0x26299c0 2024-04-25T09:29:39.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.550+0000 7fbd40ff9640 1 -- 172.21.15.53:0/1236003732 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbd34011210 con 0x26299c0 2024-04-25T09:29:39.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.550+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x248d890 con 0x26299c0 2024-04-25T09:29:39.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.550+0000 7fbd40ff9640 1 -- 172.21.15.53:0/1236003732 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd34011b00 con 0x26299c0 2024-04-25T09:29:39.536 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.550+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2617600 con 0x26299c0 2024-04-25T09:29:39.537 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.551+0000 7fbd40ff9640 1 -- 172.21.15.53:0/1236003732 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fbd34011cf0 con 0x26299c0 2024-04-25T09:29:39.537 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.551+0000 7fbd40ff9640 1 --2- 172.21.15.53:0/1236003732 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbd30037210 0x7fbd30039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.537 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.551+0000 7fbd40ff9640 1 -- 172.21.15.53:0/1236003732 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7fbd34048d00 con 0x26299c0 2024-04-25T09:29:39.537 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.551+0000 7fbd4fd82ec0 1 --2- 172.21.15.53:0/1236003732 >> v2:172.21.15.53:6805/3736905990 conn(0x262c800 0x2ac2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.537 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.551+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:1 201.4 201:233a42c1:::obj6:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x2617d10 con 0x262c800 2024-04-25T09:29:39.537 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.551+0000 7fbd42ffd640 1 --2- 172.21.15.53:0/1236003732 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbd30037210 0x7fbd30039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.537 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.552+0000 7fbd42ffd640 1 --2- 172.21.15.53:0/1236003732 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbd30037210 0x7fbd30039720 crc :-1 s=READY pgs=3781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.537 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.552+0000 7fbd48f9c640 1 --2- 172.21.15.53:0/1236003732 >> v2:172.21.15.53:6805/3736905990 conn(0x262c800 0x2ac2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.539 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.554+0000 7fbd48f9c640 1 --2- 172.21.15.53:0/1236003732 >> v2:172.21.15.53:6805/3736905990 conn(0x262c800 0x2ac2a20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.566+0000 7fbd48f9c640 1 -- 172.21.15.53:0/1236003732 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(1 obj6 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbd3c00a430 con 0x262c800 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.566+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 >> v2:172.21.15.53:6805/3736905990 conn(0x262c800 msgr2=0x2ac2a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.566+0000 7fbd4fd82ec0 1 --2- 172.21.15.53:0/1236003732 >> v2:172.21.15.53:6805/3736905990 conn(0x262c800 0x2ac2a20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.566+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbd30037210 msgr2=0x7fbd30039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.566+0000 7fbd4fd82ec0 1 --2- 172.21.15.53:0/1236003732 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbd30037210 0x7fbd30039720 crc :-1 s=READY pgs=3781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.567+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 msgr2=0x2614190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.567+0000 7fbd4fd82ec0 1 --2- 172.21.15.53:0/1236003732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2614190 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.567+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 shutdown_connections 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.567+0000 7fbd4fd82ec0 1 --2- 172.21.15.53:0/1236003732 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbd30037210 0x7fbd30039720 unknown :-1 s=CLOSED pgs=3781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.567+0000 7fbd4fd82ec0 1 --2- 172.21.15.53:0/1236003732 >> v2:172.21.15.53:6805/3736905990 conn(0x262c800 0x2ac2a20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.553 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.567+0000 7fbd4fd82ec0 1 --2- 172.21.15.53:0/1236003732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x26299c0 0x2614190 unknown :-1 s=CLOSED pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.553 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.567+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 >> 172.21.15.53:0/1236003732 conn(0x24b3960 msgr2=0x2592360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.553 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.567+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 shutdown_connections 2024-04-25T09:29:39.553 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.567+0000 7fbd4fd82ec0 1 -- 172.21.15.53:0/1236003732 wait complete. 2024-04-25T09:29:39.554 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.554 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj7 /etc/passwd 2024-04-25T09:29:39.593 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.608+0000 7f846acd6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.600 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.615+0000 7f846acd6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.600 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.615+0000 7f846acd6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.601 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.616+0000 7f846acd6ec0 1 Processor -- start 2024-04-25T09:29:39.601 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.616+0000 7f846acd6ec0 1 -- start start 2024-04-25T09:29:39.603 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.618+0000 7f846acd6ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1b4a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.604 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.618+0000 7f846acd6ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1ab7950 con 0x1b36740 2024-04-25T09:29:39.604 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.618+0000 7f846319b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1b4a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.604 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.618+0000 7f846319b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1b4a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39534/0 (socket says 172.21.15.53:39534) 2024-04-25T09:29:39.604 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.618+0000 7f846319b640 1 -- 172.21.15.53:0/1160707459 learned_addr learned my addr 172.21.15.53:0/1160707459 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.604 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.618+0000 7f846319b640 1 -- 172.21.15.53:0/1160707459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a561e0 con 0x1b36740 2024-04-25T09:29:39.604 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.618+0000 7f846319b640 1 --2- 172.21.15.53:0/1160707459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1b4a0a0 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51d79cdafdd0aa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.604 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.618+0000 7f8461998640 1 -- 172.21.15.53:0/1160707459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f844c00a040 con 0x1b36740 2024-04-25T09:29:39.604 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.619+0000 7f8461998640 1 -- 172.21.15.53:0/1160707459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f844c00a1a0 con 0x1b36740 2024-04-25T09:29:39.604 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.619+0000 7f8461998640 1 -- 172.21.15.53:0/1160707459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f844c02cb40 con 0x1b36740 2024-04-25T09:29:39.605 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.619+0000 7f846acd6ec0 1 -- 172.21.15.53:0/1160707459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 msgr2=0x1b4a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.605 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.619+0000 7f846acd6ec0 1 --2- 172.21.15.53:0/1160707459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1b4a0a0 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.605 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.619+0000 7f846acd6ec0 1 -- 172.21.15.53:0/1160707459 shutdown_connections 2024-04-25T09:29:39.606 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.619+0000 7f846acd6ec0 1 --2- 172.21.15.53:0/1160707459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1b4a0a0 unknown :-1 s=CLOSED pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.606 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.619+0000 7f846acd6ec0 1 -- 172.21.15.53:0/1160707459 >> 172.21.15.53:0/1160707459 conn(0x1a6e960 msgr2=0x1bdec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.606 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.619+0000 7f846acd6ec0 1 -- 172.21.15.53:0/1160707459 shutdown_connections 2024-04-25T09:29:39.606 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.620+0000 7f846acd6ec0 1 -- 172.21.15.53:0/1160707459 wait complete. 2024-04-25T09:29:39.606 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.620+0000 7f846acd6ec0 1 Processor -- start 2024-04-25T09:29:39.606 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.621+0000 7f846acd6ec0 1 -- start start 2024-04-25T09:29:39.607 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.622+0000 7f846acd6ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1c6b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.607 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.622+0000 7f846acd6ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1ab53d0 con 0x1b36740 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.622+0000 7f846319b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1c6b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.622+0000 7f846319b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1c6b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39538/0 (socket says 172.21.15.53:39538) 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.622+0000 7f846319b640 1 -- 172.21.15.53:0/3814506489 learned_addr learned my addr 172.21.15.53:0/3814506489 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.622+0000 7f846319b640 1 -- 172.21.15.53:0/3814506489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1a48e30 con 0x1b36740 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.623+0000 7f846319b640 1 --2- 172.21.15.53:0/3814506489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1c6b3f0 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.623+0000 7f8460996640 1 -- 172.21.15.53:0/3814506489 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f844c02cb40 con 0x1b36740 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.623+0000 7f8460996640 1 -- 172.21.15.53:0/3814506489 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f844c02cd40 con 0x1b36740 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.623+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1a48890 con 0x1b36740 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.623+0000 7f8460996640 1 -- 172.21.15.53:0/3814506489 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f844c02dd00 con 0x1b36740 2024-04-25T09:29:39.608 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.623+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1c6cf30 con 0x1b36740 2024-04-25T09:29:39.609 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.624+0000 7f8460996640 1 -- 172.21.15.53:0/3814506489 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f844c035040 con 0x1b36740 2024-04-25T09:29:39.609 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.624+0000 7f8460996640 1 --2- 172.21.15.53:0/3814506489 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84480371c0 0x7f84480396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.610 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.624+0000 7f8460996640 1 -- 172.21.15.53:0/3814506489 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7f844c032040 con 0x1b36740 2024-04-25T09:29:39.610 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.624+0000 7f846acd6ec0 1 --2- 172.21.15.53:0/3814506489 >> v2:172.21.15.53:6805/3736905990 conn(0x1be1940 0x207d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.610 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.624+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:1 201.9 201:9a09113a:::obj7:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x1bcd280 con 0x1be1940 2024-04-25T09:29:39.610 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.624+0000 7f846299a640 1 --2- 172.21.15.53:0/3814506489 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84480371c0 0x7f84480396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.610 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.625+0000 7f846299a640 1 --2- 172.21.15.53:0/3814506489 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84480371c0 0x7f84480396d0 crc :-1 s=READY pgs=3782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.610 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.625+0000 7f846399c640 1 --2- 172.21.15.53:0/3814506489 >> v2:172.21.15.53:6805/3736905990 conn(0x1be1940 0x207d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.613 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.629+0000 7f846399c640 1 --2- 172.21.15.53:0/3814506489 >> v2:172.21.15.53:6805/3736905990 conn(0x1be1940 0x207d7b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.627 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846399c640 1 -- 172.21.15.53:0/3814506489 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(1 obj7 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f845400a430 con 0x1be1940 2024-04-25T09:29:39.627 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 >> v2:172.21.15.53:6805/3736905990 conn(0x1be1940 msgr2=0x207d7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 --2- 172.21.15.53:0/3814506489 >> v2:172.21.15.53:6805/3736905990 conn(0x1be1940 0x207d7b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84480371c0 msgr2=0x7f84480396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 --2- 172.21.15.53:0/3814506489 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84480371c0 0x7f84480396d0 crc :-1 s=READY pgs=3782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 msgr2=0x1c6b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 --2- 172.21.15.53:0/3814506489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1c6b3f0 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 shutdown_connections 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 --2- 172.21.15.53:0/3814506489 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f84480371c0 0x7f84480396d0 unknown :-1 s=CLOSED pgs=3782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 --2- 172.21.15.53:0/3814506489 >> v2:172.21.15.53:6805/3736905990 conn(0x1be1940 0x207d7b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 --2- 172.21.15.53:0/3814506489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1b36740 0x1c6b3f0 unknown :-1 s=CLOSED pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 >> 172.21.15.53:0/3814506489 conn(0x1a6e960 msgr2=0x1b54e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 shutdown_connections 2024-04-25T09:29:39.628 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.642+0000 7f846acd6ec0 1 -- 172.21.15.53:0/3814506489 wait complete. 2024-04-25T09:29:39.630 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.630 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj8 /etc/passwd 2024-04-25T09:29:39.665 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.681+0000 7f5d8bf2aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.686+0000 7f5d8bf2aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.671 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.686+0000 7f5d8bf2aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.687+0000 7f5d8bf2aec0 1 Processor -- start 2024-04-25T09:29:39.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.687+0000 7f5d8bf2aec0 1 -- start start 2024-04-25T09:29:39.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d8bf2aec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x19620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d8bf2aec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x18cf950 con 0x194e740 2024-04-25T09:29:39.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d7f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x19620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d7f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x19620a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39562/0 (socket says 172.21.15.53:39562) 2024-04-25T09:29:39.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d7f7fe640 1 -- 172.21.15.53:0/2073590217 learned_addr learned my addr 172.21.15.53:0/2073590217 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d7f7fe640 1 -- 172.21.15.53:0/2073590217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x186e1e0 con 0x194e740 2024-04-25T09:29:39.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d7f7fe640 1 --2- 172.21.15.53:0/2073590217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x19620a0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8ae60e51e3b38a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d7dffb640 1 -- 172.21.15.53:0/2073590217 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d7000a040 con 0x194e740 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d7dffb640 1 -- 172.21.15.53:0/2073590217 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d7000a1a0 con 0x194e740 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.689+0000 7f5d7dffb640 1 -- 172.21.15.53:0/2073590217 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d7002cb40 con 0x194e740 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.690+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/2073590217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 msgr2=0x19620a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.690+0000 7f5d8bf2aec0 1 --2- 172.21.15.53:0/2073590217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x19620a0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.690+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/2073590217 shutdown_connections 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.690+0000 7f5d8bf2aec0 1 --2- 172.21.15.53:0/2073590217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x19620a0 unknown :-1 s=CLOSED pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.690+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/2073590217 >> 172.21.15.53:0/2073590217 conn(0x1886960 msgr2=0x19f6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.690+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/2073590217 shutdown_connections 2024-04-25T09:29:39.676 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.690+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/2073590217 wait complete. 2024-04-25T09:29:39.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.691+0000 7f5d8bf2aec0 1 Processor -- start 2024-04-25T09:29:39.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.691+0000 7f5d8bf2aec0 1 -- start start 2024-04-25T09:29:39.678 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d8bf2aec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x1a833f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.678 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d8bf2aec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x18cd3d0 con 0x194e740 2024-04-25T09:29:39.678 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d7f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x1a833f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d7f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x1a833f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39566/0 (socket says 172.21.15.53:39566) 2024-04-25T09:29:39.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d7f7fe640 1 -- 172.21.15.53:0/3613514973 learned_addr learned my addr 172.21.15.53:0/3613514973 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d7f7fe640 1 -- 172.21.15.53:0/3613514973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1860e30 con 0x194e740 2024-04-25T09:29:39.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d7f7fe640 1 --2- 172.21.15.53:0/3613514973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x1a833f0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d7cff9640 1 -- 172.21.15.53:0/3613514973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d7000a310 con 0x194e740 2024-04-25T09:29:39.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d7cff9640 1 -- 172.21.15.53:0/3613514973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d7002dce0 con 0x194e740 2024-04-25T09:29:39.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d7cff9640 1 -- 172.21.15.53:0/3613514973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d7002ccf0 con 0x194e740 2024-04-25T09:29:39.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1860890 con 0x194e740 2024-04-25T09:29:39.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.693+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x19f6770 con 0x194e740 2024-04-25T09:29:39.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.694+0000 7f5d7cff9640 1 -- 172.21.15.53:0/3613514973 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f5d70035040 con 0x194e740 2024-04-25T09:29:39.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.694+0000 7f5d7cff9640 1 --2- 172.21.15.53:0/3613514973 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d6c037210 0x7f5d6c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.694+0000 7f5d7cff9640 1 -- 172.21.15.53:0/3613514973 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7f5d70032040 con 0x194e740 2024-04-25T09:29:39.681 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.695+0000 7f5d8bf2aec0 1 --2- 172.21.15.53:0/3613514973 >> v2:172.21.15.53:6805/3736905990 conn(0x19f9940 0x1a91780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.681 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.695+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:1 201.5 201:a557efb1:::obj8:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x19e5280 con 0x19f9940 2024-04-25T09:29:39.681 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.695+0000 7f5d7effd640 1 --2- 172.21.15.53:0/3613514973 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d6c037210 0x7f5d6c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.681 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.695+0000 7f5d7effd640 1 --2- 172.21.15.53:0/3613514973 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d6c037210 0x7f5d6c039720 crc :-1 s=READY pgs=3783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.681 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.696+0000 7f5d84b9c640 1 --2- 172.21.15.53:0/3613514973 >> v2:172.21.15.53:6805/3736905990 conn(0x19f9940 0x1a91780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.684 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.699+0000 7f5d84b9c640 1 --2- 172.21.15.53:0/3613514973 >> v2:172.21.15.53:6805/3736905990 conn(0x19f9940 0x1a91780 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.699 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d84b9c640 1 -- 172.21.15.53:0/3613514973 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(1 obj8 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d7800a430 con 0x19f9940 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 >> v2:172.21.15.53:6805/3736905990 conn(0x19f9940 msgr2=0x1a91780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 --2- 172.21.15.53:0/3613514973 >> v2:172.21.15.53:6805/3736905990 conn(0x19f9940 0x1a91780 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d6c037210 msgr2=0x7f5d6c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 --2- 172.21.15.53:0/3613514973 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d6c037210 0x7f5d6c039720 crc :-1 s=READY pgs=3783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 msgr2=0x1a833f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 --2- 172.21.15.53:0/3613514973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x1a833f0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 shutdown_connections 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 --2- 172.21.15.53:0/3613514973 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f5d6c037210 0x7f5d6c039720 unknown :-1 s=CLOSED pgs=3783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 --2- 172.21.15.53:0/3613514973 >> v2:172.21.15.53:6805/3736905990 conn(0x19f9940 0x1a91780 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 --2- 172.21.15.53:0/3613514973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x194e740 0x1a833f0 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 >> 172.21.15.53:0/3613514973 conn(0x1886960 msgr2=0x196ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 shutdown_connections 2024-04-25T09:29:39.700 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.711+0000 7f5d8bf2aec0 1 -- 172.21.15.53:0/3613514973 wait complete. 2024-04-25T09:29:39.701 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.701 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj9 /etc/passwd 2024-04-25T09:29:39.735 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.750+0000 7fae09e3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.741 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.756+0000 7fae09e3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.741 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.756+0000 7fae09e3aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.742 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.757+0000 7fae09e3aec0 1 Processor -- start 2024-04-25T09:29:39.742 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.757+0000 7fae09e3aec0 1 -- start start 2024-04-25T09:29:39.744 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.758+0000 7fae09e3aec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1e6e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.744 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.759+0000 7fae09e3aec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1cbb950 con 0x1d56450 2024-04-25T09:29:39.744 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.759+0000 7fae0179a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1e6e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.745 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.759+0000 7fae0179a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1e6e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39586/0 (socket says 172.21.15.53:39586) 2024-04-25T09:29:39.745 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.759+0000 7fae0179a640 1 -- 172.21.15.53:0/315780818 learned_addr learned my addr 172.21.15.53:0/315780818 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.745 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.759+0000 7fae0179a640 1 -- 172.21.15.53:0/315780818 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c5a1e0 con 0x1d56450 2024-04-25T09:29:39.745 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.759+0000 7fae0179a640 1 --2- 172.21.15.53:0/315780818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1e6e500 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2530cfa8bd0b53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.745 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.759+0000 7fadfb7fe640 1 -- 172.21.15.53:0/315780818 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadec02fab0 con 0x1d56450 2024-04-25T09:29:39.745 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.759+0000 7fadfb7fe640 1 -- 172.21.15.53:0/315780818 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fadec02fc10 con 0x1d56450 2024-04-25T09:29:39.745 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.759+0000 7fadfb7fe640 1 -- 172.21.15.53:0/315780818 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadec02feb0 con 0x1d56450 2024-04-25T09:29:39.746 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.760+0000 7fae09e3aec0 1 -- 172.21.15.53:0/315780818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 msgr2=0x1e6e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.746 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.760+0000 7fae09e3aec0 1 --2- 172.21.15.53:0/315780818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1e6e500 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.746 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.760+0000 7fae09e3aec0 1 -- 172.21.15.53:0/315780818 shutdown_connections 2024-04-25T09:29:39.746 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.760+0000 7fae09e3aec0 1 --2- 172.21.15.53:0/315780818 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1e6e500 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.746 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.760+0000 7fae09e3aec0 1 -- 172.21.15.53:0/315780818 >> 172.21.15.53:0/315780818 conn(0x1c72960 msgr2=0x1d4fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.747 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.760+0000 7fae09e3aec0 1 -- 172.21.15.53:0/315780818 shutdown_connections 2024-04-25T09:29:39.747 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.760+0000 7fae09e3aec0 1 -- 172.21.15.53:0/315780818 wait complete. 2024-04-25T09:29:39.747 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.761+0000 7fae09e3aec0 1 Processor -- start 2024-04-25T09:29:39.747 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.761+0000 7fae09e3aec0 1 -- start start 2024-04-25T09:29:39.748 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.762+0000 7fae09e3aec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1de4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.748 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.762+0000 7fae09e3aec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1cb93d0 con 0x1d56450 2024-04-25T09:29:39.748 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fae0179a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1de4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.748 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fae0179a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1de4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39600/0 (socket says 172.21.15.53:39600) 2024-04-25T09:29:39.749 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fae0179a640 1 -- 172.21.15.53:0/1572133836 learned_addr learned my addr 172.21.15.53:0/1572133836 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.749 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fae0179a640 1 -- 172.21.15.53:0/1572133836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c4ce30 con 0x1d56450 2024-04-25T09:29:39.749 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fae0179a640 1 --2- 172.21.15.53:0/1572133836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1de4b00 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.749 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fadfa7fc640 1 -- 172.21.15.53:0/1572133836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadec02feb0 con 0x1d56450 2024-04-25T09:29:39.749 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fadfa7fc640 1 -- 172.21.15.53:0/1572133836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fadec034c00 con 0x1d56450 2024-04-25T09:29:39.749 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c4c890 con 0x1d56450 2024-04-25T09:29:39.749 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fadfa7fc640 1 -- 172.21.15.53:0/1572133836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fadec034ea0 con 0x1d56450 2024-04-25T09:29:39.749 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.763+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1dd3a60 con 0x1d56450 2024-04-25T09:29:39.750 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.764+0000 7fadfa7fc640 1 -- 172.21.15.53:0/1572133836 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fadec03c040 con 0x1d56450 2024-04-25T09:29:39.750 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.764+0000 7fadfa7fc640 1 --2- 172.21.15.53:0/1572133836 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fade8037260 0x7fade8039770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.750 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.765+0000 7fadfa7fc640 1 -- 172.21.15.53:0/1572133836 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7fadec039040 con 0x1d56450 2024-04-25T09:29:39.750 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.765+0000 7fae09e3aec0 1 --2- 172.21.15.53:0/1572133836 >> v2:172.21.15.151:6806/46311736 conn(0x1de89c0 0x1dd1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.750 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.765+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 --> v2:172.21.15.151:6806/46311736 -- osd_op(unknown.0.0:1 201.7 201:fe351e27:::obj9:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x1dd48b0 con 0x1de89c0 2024-04-25T09:29:39.750 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.765+0000 7fae00f99640 1 --2- 172.21.15.53:0/1572133836 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fade8037260 0x7fade8039770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.751 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.765+0000 7fae00f99640 1 --2- 172.21.15.53:0/1572133836 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fade8037260 0x7fade8039770 crc :-1 s=READY pgs=3784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.751 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.766+0000 7fae01f9b640 1 --2- 172.21.15.53:0/1572133836 >> v2:172.21.15.151:6806/46311736 conn(0x1de89c0 0x1dd1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.755 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.770+0000 7fae01f9b640 1 --2- 172.21.15.53:0/1572133836 >> v2:172.21.15.151:6806/46311736 conn(0x1de89c0 0x1dd1570 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.781+0000 7fae01f9b640 1 -- 172.21.15.53:0/1572133836 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== osd_op_reply(1 obj9 [writefull 0~11876] v706'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf400c430 con 0x1de89c0 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.781+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 >> v2:172.21.15.151:6806/46311736 conn(0x1de89c0 msgr2=0x1dd1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.781+0000 7fae09e3aec0 1 --2- 172.21.15.53:0/1572133836 >> v2:172.21.15.151:6806/46311736 conn(0x1de89c0 0x1dd1570 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.781+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fade8037260 msgr2=0x7fade8039770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.781+0000 7fae09e3aec0 1 --2- 172.21.15.53:0/1572133836 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fade8037260 0x7fade8039770 crc :-1 s=READY pgs=3784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.781+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 msgr2=0x1de4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.781+0000 7fae09e3aec0 1 --2- 172.21.15.53:0/1572133836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1de4b00 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.782+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 shutdown_connections 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.782+0000 7fae09e3aec0 1 --2- 172.21.15.53:0/1572133836 >> v2:172.21.15.151:6806/46311736 conn(0x1de89c0 0x1dd1570 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.767 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.782+0000 7fae09e3aec0 1 --2- 172.21.15.53:0/1572133836 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fade8037260 0x7fade8039770 unknown :-1 s=CLOSED pgs=3784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.782+0000 7fae09e3aec0 1 --2- 172.21.15.53:0/1572133836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d56450 0x1de4b00 unknown :-1 s=CLOSED pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.782+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 >> 172.21.15.53:0/1572133836 conn(0x1c72960 msgr2=0x1d4fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.782+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 shutdown_connections 2024-04-25T09:29:39.768 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.782+0000 7fae09e3aec0 1 -- 172.21.15.53:0/1572133836 wait complete. 2024-04-25T09:29:39.769 INFO:tasks.workunit.client.0.smithi053.stderr:+ for f in `seq 1 10` 2024-04-25T09:29:39.769 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c703408b-a4c5-4118-ba7e-91b1f88f4328 put obj10 /etc/passwd 2024-04-25T09:29:39.805 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.820+0000 7f7572c30ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.811 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.826+0000 7f7572c30ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.811 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.826+0000 7f7572c30ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:39.812 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.827+0000 7f7572c30ec0 1 Processor -- start 2024-04-25T09:29:39.812 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.827+0000 7f7572c30ec0 1 -- start start 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.828+0000 7f7572c30ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x684810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.828+0000 7f7572c30ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x569950 con 0x602eb0 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.828+0000 7f756ad9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x684810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.828+0000 7f756ad9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x684810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39608/0 (socket says 172.21.15.53:39608) 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.828+0000 7f756ad9b640 1 -- 172.21.15.53:0/3564536081 learned_addr learned my addr 172.21.15.53:0/3564536081 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.829+0000 7f756ad9b640 1 -- 172.21.15.53:0/3564536081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5081e0 con 0x602eb0 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.829+0000 7f756ad9b640 1 --2- 172.21.15.53:0/3564536081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x684810 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aac7703d6c2c65a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.829+0000 7f7569598640 1 -- 172.21.15.53:0/3564536081 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f755400b500 con 0x602eb0 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.829+0000 7f7569598640 1 -- 172.21.15.53:0/3564536081 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f755400b660 con 0x602eb0 2024-04-25T09:29:39.821 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.829+0000 7f7569598640 1 -- 172.21.15.53:0/3564536081 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f755400b900 con 0x602eb0 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.830+0000 7f7572c30ec0 1 -- 172.21.15.53:0/3564536081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 msgr2=0x684810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.830+0000 7f7572c30ec0 1 --2- 172.21.15.53:0/3564536081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x684810 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.830+0000 7f7572c30ec0 1 -- 172.21.15.53:0/3564536081 shutdown_connections 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.830+0000 7f7572c30ec0 1 --2- 172.21.15.53:0/3564536081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x684810 unknown :-1 s=CLOSED pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.830+0000 7f7572c30ec0 1 -- 172.21.15.53:0/3564536081 >> 172.21.15.53:0/3564536081 conn(0x520960 msgr2=0x5fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.830+0000 7f7572c30ec0 1 -- 172.21.15.53:0/3564536081 shutdown_connections 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.830+0000 7f7572c30ec0 1 -- 172.21.15.53:0/3564536081 wait complete. 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.831+0000 7f7572c30ec0 1 Processor -- start 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.831+0000 7f7572c30ec0 1 -- start start 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.832+0000 7f7572c30ec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x687d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.832+0000 7f7572c30ec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5673d0 con 0x602eb0 2024-04-25T09:29:39.822 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.832+0000 7f756ad9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x687d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.832+0000 7f756ad9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x687d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:39622/0 (socket says 172.21.15.53:39622) 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.832+0000 7f756ad9b640 1 -- 172.21.15.53:0/1343779797 learned_addr learned my addr 172.21.15.53:0/1343779797 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.833+0000 7f756ad9b640 1 -- 172.21.15.53:0/1343779797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x4fae30 con 0x602eb0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.833+0000 7f756ad9b640 1 --2- 172.21.15.53:0/1343779797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x687d40 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.833+0000 7f75637fe640 1 -- 172.21.15.53:0/1343779797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f75540110b0 con 0x602eb0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.833+0000 7f75637fe640 1 -- 172.21.15.53:0/1343779797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7554011210 con 0x602eb0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.833+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x4fa890 con 0x602eb0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.833+0000 7f75637fe640 1 -- 172.21.15.53:0/1343779797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7554011ab0 con 0x602eb0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.833+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x688e30 con 0x602eb0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.834+0000 7f75637fe640 1 -- 172.21.15.53:0/1343779797 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f7554011cb0 con 0x602eb0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.834+0000 7f75637fe640 1 --2- 172.21.15.53:0/1343779797 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f75500371c0 0x7f75500396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.834+0000 7f75637fe640 1 -- 172.21.15.53:0/1343779797 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(706..706 src has 401..706) ==== 4179+0+0 (crc 0 0 0) 0x7f7554048d30 con 0x602eb0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.834+0000 7f7572c30ec0 1 --2- 172.21.15.53:0/1343779797 >> v2:172.21.15.53:6805/3736905990 conn(0x603860 0x730000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.834+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 --> v2:172.21.15.53:6805/3736905990 -- osd_op(unknown.0.0:1 201.b 201:d1337354:::obj10:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x730540 con 0x603860 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.834+0000 7f756a59a640 1 --2- 172.21.15.53:0/1343779797 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f75500371c0 0x7f75500396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:29:39.823 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.835+0000 7f756a59a640 1 --2- 172.21.15.53:0/1343779797 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f75500371c0 0x7f75500396d0 crc :-1 s=READY pgs=3785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.824 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.835+0000 7f756b59c640 1 --2- 172.21.15.53:0/1343779797 >> v2:172.21.15.53:6805/3736905990 conn(0x603860 0x730000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:29:39.824 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.837+0000 7f756b59c640 1 --2- 172.21.15.53:0/1343779797 >> v2:172.21.15.53:6805/3736905990 conn(0x603860 0x730000 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f756b59c640 1 -- 172.21.15.53:0/1343779797 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== osd_op_reply(1 obj10 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f755c00a430 con 0x603860 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 >> v2:172.21.15.53:6805/3736905990 conn(0x603860 msgr2=0x730000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 --2- 172.21.15.53:0/1343779797 >> v2:172.21.15.53:6805/3736905990 conn(0x603860 0x730000 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f75500371c0 msgr2=0x7f75500396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 --2- 172.21.15.53:0/1343779797 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f75500371c0 0x7f75500396d0 crc :-1 s=READY pgs=3785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 msgr2=0x687d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 --2- 172.21.15.53:0/1343779797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x687d40 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 shutdown_connections 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 --2- 172.21.15.53:0/1343779797 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f75500371c0 0x7f75500396d0 unknown :-1 s=CLOSED pgs=3785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 --2- 172.21.15.53:0/1343779797 >> v2:172.21.15.53:6805/3736905990 conn(0x603860 0x730000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 --2- 172.21.15.53:0/1343779797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x602eb0 0x687d40 unknown :-1 s=CLOSED pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:29:39.835 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 >> 172.21.15.53:0/1343779797 conn(0x520960 msgr2=0x5fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:29:39.836 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 shutdown_connections 2024-04-25T09:29:39.836 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:29:39.848+0000 7f7572c30ec0 1 -- 172.21.15.53:0/1343779797 wait complete. 2024-04-25T09:29:39.836 INFO:tasks.workunit.client.0.smithi053.stderr:+ sleep 30 2024-04-25T09:30:09.838 INFO:tasks.workunit.client.0.smithi053.stderr:+ rados -p c50b9a0b-a761-4651-b0e1-76fe43e4a63b put threemore /etc/passwd 2024-04-25T09:30:09.883 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.898+0000 7f6bd4efeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:09.889 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.904+0000 7f6bd4efeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:09.889 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.904+0000 7f6bd4efeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:09.890 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.905+0000 7f6bd4efeec0 1 Processor -- start 2024-04-25T09:30:09.890 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.905+0000 7f6bd4efeec0 1 -- start start 2024-04-25T09:30:09.892 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.907+0000 7f6bd4efeec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1d9e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:09.892 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.907+0000 7f6bd4efeec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1d0b950 con 0x1d8a740 2024-04-25T09:30:09.892 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.907+0000 7f6bcd39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1d9e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:09.892 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.907+0000 7f6bcd39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1d9e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47482/0 (socket says 172.21.15.53:47482) 2024-04-25T09:30:09.893 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.907+0000 7f6bcd39b640 1 -- 172.21.15.53:0/3697060613 learned_addr learned my addr 172.21.15.53:0/3697060613 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:09.893 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.907+0000 7f6bcd39b640 1 -- 172.21.15.53:0/3697060613 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1caa1e0 con 0x1d8a740 2024-04-25T09:30:09.893 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.907+0000 7f6bcd39b640 1 --2- 172.21.15.53:0/3697060613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1d9e0a0 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6121428b18ac090e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:09.893 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.907+0000 7f6bc6ffd640 1 -- 172.21.15.53:0/3697060613 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6bb80060b0 con 0x1d8a740 2024-04-25T09:30:09.893 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.907+0000 7f6bc6ffd640 1 -- 172.21.15.53:0/3697060613 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6bb8006210 con 0x1d8a740 2024-04-25T09:30:09.893 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.908+0000 7f6bc6ffd640 1 -- 172.21.15.53:0/3697060613 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6bb8001b10 con 0x1d8a740 2024-04-25T09:30:09.894 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.908+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/3697060613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 msgr2=0x1d9e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:09.894 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.908+0000 7f6bd4efeec0 1 --2- 172.21.15.53:0/3697060613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1d9e0a0 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:09.894 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.908+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/3697060613 shutdown_connections 2024-04-25T09:30:09.894 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.908+0000 7f6bd4efeec0 1 --2- 172.21.15.53:0/3697060613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1d9e0a0 unknown :-1 s=CLOSED pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:09.894 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.908+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/3697060613 >> 172.21.15.53:0/3697060613 conn(0x1cc2960 msgr2=0x1da7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:09.894 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.908+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/3697060613 shutdown_connections 2024-04-25T09:30:09.894 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.908+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/3697060613 wait complete. 2024-04-25T09:30:09.894 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.909+0000 7f6bd4efeec0 1 Processor -- start 2024-04-25T09:30:09.894 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.909+0000 7f6bd4efeec0 1 -- start start 2024-04-25T09:30:09.896 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.911+0000 7f6bd4efeec0 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1ebf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.911+0000 7f6bd4efeec0 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x1d093d0 con 0x1d8a740 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.911+0000 7f6bcd39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1ebf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.911+0000 7f6bcd39b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1ebf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47484/0 (socket says 172.21.15.53:47484) 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.911+0000 7f6bcd39b640 1 -- 172.21.15.53:0/1321968328 learned_addr learned my addr 172.21.15.53:0/1321968328 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.911+0000 7f6bcd39b640 1 -- 172.21.15.53:0/1321968328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1c9ce30 con 0x1d8a740 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.911+0000 7f6bcd39b640 1 --2- 172.21.15.53:0/1321968328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1ebf500 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.912+0000 7f6bc5ffb640 1 -- 172.21.15.53:0/1321968328 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6bb8004b20 con 0x1d8a740 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.912+0000 7f6bc5ffb640 1 -- 172.21.15.53:0/1321968328 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6bb8004c80 con 0x1d8a740 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.912+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1c9c890 con 0x1d8a740 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.912+0000 7f6bc5ffb640 1 -- 172.21.15.53:0/1321968328 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6bb8012330 con 0x1d8a740 2024-04-25T09:30:09.897 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.912+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1ec1b20 con 0x1d8a740 2024-04-25T09:30:09.898 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.913+0000 7f6bc5ffb640 1 -- 172.21.15.53:0/1321968328 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f6bb80124e0 con 0x1d8a740 2024-04-25T09:30:09.898 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.913+0000 7f6bc5ffb640 1 --2- 172.21.15.53:0/1321968328 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6bb4037210 0x7f6bb4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:09.898 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.913+0000 7f6bc5ffb640 1 -- 172.21.15.53:0/1321968328 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(708..708 src has 401..708) ==== 4179+0+0 (crc 0 0 0) 0x7f6bb80488b0 con 0x1d8a740 2024-04-25T09:30:09.898 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.913+0000 7f6bc5ffb640 1 -- 172.21.15.53:0/1321968328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f6bb403dbc0 con 0x1d8a740 2024-04-25T09:30:09.899 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.913+0000 7f6bd4efeec0 1 --2- 172.21.15.53:0/1321968328 >> v2:172.21.15.151:6805/3300556569 conn(0x1e35b10 0x1ecd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:09.899 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.913+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 --> v2:172.21.15.151:6805/3300556569 -- osd_op(unknown.0.0:1 200.2 200:47cad802:::threemore:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e708) -- 0x1e21480 con 0x1e35b10 2024-04-25T09:30:09.899 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.913+0000 7f6bccb9a640 1 --2- 172.21.15.53:0/1321968328 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6bb4037210 0x7f6bb4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:09.899 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.914+0000 7f6bccb9a640 1 --2- 172.21.15.53:0/1321968328 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6bb4037210 0x7f6bb4039720 crc :-1 s=READY pgs=3786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:09.899 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.914+0000 7f6bcdb9c640 1 --2- 172.21.15.53:0/1321968328 >> v2:172.21.15.151:6805/3300556569 conn(0x1e35b10 0x1ecd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:30:09.902 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.918+0000 7f6bcdb9c640 1 --2- 172.21.15.53:0/1321968328 >> v2:172.21.15.151:6805/3300556569 conn(0x1e35b10 0x1ecd710 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:09.917 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bcdb9c640 1 -- 172.21.15.53:0/1321968328 <== osd.2 v2:172.21.15.151:6805/3300556569 1 ==== osd_op_reply(1 threemore [writefull 0~11876] v708'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f6bc000c430 con 0x1e35b10 2024-04-25T09:30:09.917 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 >> v2:172.21.15.151:6805/3300556569 conn(0x1e35b10 msgr2=0x1ecd710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:09.917 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 --2- 172.21.15.53:0/1321968328 >> v2:172.21.15.151:6805/3300556569 conn(0x1e35b10 0x1ecd710 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:09.917 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6bb4037210 msgr2=0x7f6bb4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:09.917 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 --2- 172.21.15.53:0/1321968328 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6bb4037210 0x7f6bb4039720 crc :-1 s=READY pgs=3786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:09.917 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 msgr2=0x1ebf500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:09.918 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 --2- 172.21.15.53:0/1321968328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1ebf500 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:09.918 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 shutdown_connections 2024-04-25T09:30:09.918 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 --2- 172.21.15.53:0/1321968328 >> v2:172.21.15.151:6805/3300556569 conn(0x1e35b10 0x1ecd710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:09.918 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 --2- 172.21.15.53:0/1321968328 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6bb4037210 0x7f6bb4039720 unknown :-1 s=CLOSED pgs=3786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:09.918 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 --2- 172.21.15.53:0/1321968328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x1d8a740 0x1ebf500 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:09.918 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 >> 172.21.15.53:0/1321968328 conn(0x1cc2960 msgr2=0x1da7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:09.918 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 shutdown_connections 2024-04-25T09:30:09.918 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:09.932+0000 7f6bd4efeec0 1 -- 172.21.15.53:0/1321968328 wait complete. 2024-04-25T09:30:09.919 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool set-quota c50b9a0b-a761-4651-b0e1-76fe43e4a63b max_bytes 0 2024-04-25T09:30:10.019 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.026+0000 7fa12de2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:10.020 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.036+0000 7fa12de2d640 1 Processor -- start 2024-04-25T09:30:10.021 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.036+0000 7fa12de2d640 1 -- start start 2024-04-25T09:30:10.023 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.037+0000 7fa12de2d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa128137d40 0x7fa12813a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:10.023 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.037+0000 7fa12de2d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12809c8e0 con 0x7fa1281318a0 2024-04-25T09:30:10.023 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.037+0000 7fa12de2d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa12809abe0 con 0x7fa128137d40 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa126ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa128137d40 0x7fa12813a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa1277fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa1281318a0 0x7fa128131cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37352/0 (socket says 172.21.15.53:37352) 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa1277fe640 1 -- 172.21.15.53:0/85810897 learned_addr learned my addr 172.21.15.53:0/85810897 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa126ffd640 1 -- 172.21.15.53:0/85810897 >> v1:172.21.15.53:6789/0 conn(0x7fa1281318a0 legacy=0x7fa128131cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa126ffd640 1 -- 172.21.15.53:0/85810897 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1281323c0 con 0x7fa128137d40 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa1267fc640 1 -- 172.21.15.53:0/85810897 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968126749 0 0) 0x7fa12809c8e0 con 0x7fa1281318a0 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa126ffd640 1 --2- 172.21.15.53:0/85810897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa128137d40 0x7fa12813a160 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f330ffca6088c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa1267fc640 1 -- 172.21.15.53:0/85810897 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa11c009d90 con 0x7fa128137d40 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa1267fc640 1 -- 172.21.15.53:0/85810897 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa11c00e230 con 0x7fa128137d40 2024-04-25T09:30:10.024 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.038+0000 7fa1267fc640 1 -- 172.21.15.53:0/85810897 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa11c00e4d0 con 0x7fa128137d40 2024-04-25T09:30:10.025 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.039+0000 7fa12de2d640 1 -- 172.21.15.53:0/85810897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa128137d40 msgr2=0x7fa12813a160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:10.025 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.039+0000 7fa12de2d640 1 --2- 172.21.15.53:0/85810897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa128137d40 0x7fa12813a160 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:10.025 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.039+0000 7fa12de2d640 1 -- 172.21.15.53:0/85810897 shutdown_connections 2024-04-25T09:30:10.025 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.039+0000 7fa12de2d640 1 --2- 172.21.15.53:0/85810897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa128137d40 0x7fa12813a160 unknown :-1 s=CLOSED pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:10.025 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.039+0000 7fa12de2d640 1 -- 172.21.15.53:0/85810897 >> 172.21.15.53:0/85810897 conn(0x7fa12806d3a0 msgr2=0x7fa12806d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:10.026 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.039+0000 7fa12de2d640 1 -- 172.21.15.53:0/85810897 shutdown_connections 2024-04-25T09:30:10.026 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.039+0000 7fa12de2d640 1 -- 172.21.15.53:0/85810897 wait complete. 2024-04-25T09:30:10.026 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.039+0000 7fa12de2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:10.026 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.041+0000 7fa12de2d640 1 Processor -- start 2024-04-25T09:30:10.026 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.041+0000 7fa12de2d640 1 -- start start 2024-04-25T09:30:10.028 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa12de2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1281318a0 0x7fa12811e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:10.028 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa12de2d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa1281200d0 con 0x7fa1281318a0 2024-04-25T09:30:10.028 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa1277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1281318a0 0x7fa12811e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:10.028 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa1277fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1281318a0 0x7fa12811e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47512/0 (socket says 172.21.15.53:47512) 2024-04-25T09:30:10.028 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa1277fe640 1 -- 172.21.15.53:0/3645360364 learned_addr learned my addr 172.21.15.53:0/3645360364 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:10.029 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa1277fe640 1 -- 172.21.15.53:0/3645360364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12811dd70 con 0x7fa1281318a0 2024-04-25T09:30:10.029 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa1277fe640 1 --2- 172.21.15.53:0/3645360364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1281318a0 0x7fa12811e100 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:10.029 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa118004cf0 con 0x7fa1281318a0 2024-04-25T09:30:10.029 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa118004e50 con 0x7fa1281318a0 2024-04-25T09:30:10.029 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12811fbb0 con 0x7fa1281318a0 2024-04-25T09:30:10.029 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa118007250 con 0x7fa1281318a0 2024-04-25T09:30:10.029 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.043+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa128121750 con 0x7fa1281318a0 2024-04-25T09:30:10.030 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.044+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12811fed0 con 0x7fa1281318a0 2024-04-25T09:30:10.030 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.045+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa118007400 con 0x7fa1281318a0 2024-04-25T09:30:10.030 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.045+0000 7fa10ffff640 1 --2- 172.21.15.53:0/3645360364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa114038980 0x7fa11403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:10.030 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.045+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(708..708 src has 401..708) ==== 4179+0+0 (crc 0 0 0) 0x7fa118049010 con 0x7fa1281318a0 2024-04-25T09:30:10.030 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.045+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7fa11403f330 con 0x7fa1281318a0 2024-04-25T09:30:10.030 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.045+0000 7fa126ffd640 1 --2- 172.21.15.53:0/3645360364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa114038980 0x7fa11403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:10.031 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.046+0000 7fa126ffd640 1 --2- 172.21.15.53:0/3645360364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa114038980 0x7fa11403ae90 crc :-1 s=READY pgs=3787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:10.035 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.050+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fa1180062e0 con 0x7fa1281318a0 2024-04-25T09:30:10.221 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.237+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "0"} v 0) -- 0x7fa1280697f0 con 0x7fa1281318a0 2024-04-25T09:30:10.432 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.447+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v709) ==== 217+0+0 (crc 0 0 0) 0x7fa11800ad00 con 0x7fa1281318a0 2024-04-25T09:30:10.432 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.447+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(709..709 src has 401..709) ==== 628+0+0 (crc 0 0 0) 0x7fa118006e30 con 0x7fa1281318a0 2024-04-25T09:30:10.432 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.447+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7fa114040410 con 0x7fa1281318a0 2024-04-25T09:30:10.662 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:10.677+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "0"} v 0) -- 0x7fa1280008d0 con 0x7fa1281318a0 2024-04-25T09:30:11.440 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.454+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v710) ==== 217+0+0 (crc 0 0 0) 0x7fa1180060b0 con 0x7fa1281318a0 2024-04-25T09:30:11.440 INFO:tasks.workunit.client.0.smithi053.stderr:set-quota max_bytes = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b 2024-04-25T09:30:11.440 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.455+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 <== mon.0 v2:172.21.15.53:3300/0 10 ==== osd_map(710..710 src has 401..710) ==== 628+0+0 (crc 0 0 0) 0x7fa118006ba0 con 0x7fa1281318a0 2024-04-25T09:30:11.440 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.455+0000 7fa10ffff640 1 -- 172.21.15.53:0/3645360364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=711}) -- 0x7fa114040650 con 0x7fa1281318a0 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa114038980 msgr2=0x7fa11403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 --2- 172.21.15.53:0/3645360364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa114038980 0x7fa11403ae90 crc :-1 s=READY pgs=3787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1281318a0 msgr2=0x7fa12811e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 --2- 172.21.15.53:0/3645360364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1281318a0 0x7fa12811e100 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 shutdown_connections 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 --2- 172.21.15.53:0/3645360364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fa114038980 0x7fa11403ae90 unknown :-1 s=CLOSED pgs=3787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 --2- 172.21.15.53:0/3645360364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa1281318a0 0x7fa12811e100 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 >> 172.21.15.53:0/3645360364 conn(0x7fa12806d3a0 msgr2=0x7fa1280a4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 shutdown_connections 2024-04-25T09:30:11.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.458+0000 7fa12de2d640 1 -- 172.21.15.53:0/3645360364 wait complete. 2024-04-25T09:30:11.453 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool set-quota c50b9a0b-a761-4651-b0e1-76fe43e4a63b max_objects 0 2024-04-25T09:30:11.552 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.559+0000 7ff398620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:11.553 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.568+0000 7ff398620640 1 Processor -- start 2024-04-25T09:30:11.553 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.568+0000 7ff398620640 1 -- start start 2024-04-25T09:30:11.555 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.570+0000 7ff398620640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3900707f0 0x7ff390070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.570+0000 7ff398620640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff390072390 con 0x7ff390071140 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.570+0000 7ff398620640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff390071bb0 con 0x7ff3900707f0 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.570+0000 7ff3963bc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff3900707f0 0x7ff390070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.570+0000 7ff395bbb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff390071140 0x7ff39012c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:37358/0 (socket says 172.21.15.53:37358) 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.570+0000 7ff395bbb640 1 -- 172.21.15.53:0/1609964907 learned_addr learned my addr 172.21.15.53:0/1609964907 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.570+0000 7ff3963bc640 1 -- 172.21.15.53:0/1609964907 >> v1:172.21.15.53:6789/0 conn(0x7ff390071140 legacy=0x7ff39012c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.570+0000 7ff3963bc640 1 -- 172.21.15.53:0/1609964907 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff390072050 con 0x7ff3900707f0 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.570+0000 7ff3953ba640 1 -- 172.21.15.53:0/1609964907 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2539194798 0 0) 0x7ff390072390 con 0x7ff390071140 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.571+0000 7ff3963bc640 1 --2- 172.21.15.53:0/1609964907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 0x7ff390070c00 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adb03cdd641e0bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.571+0000 7ff3953ba640 1 -- 172.21.15.53:0/1609964907 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff388009d90 con 0x7ff3900707f0 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.571+0000 7ff3953ba640 1 -- 172.21.15.53:0/1609964907 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff38800e230 con 0x7ff3900707f0 2024-04-25T09:30:11.556 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.571+0000 7ff3953ba640 1 -- 172.21.15.53:0/1609964907 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff38800e4d0 con 0x7ff3900707f0 2024-04-25T09:30:11.557 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.571+0000 7ff398620640 1 -- 172.21.15.53:0/1609964907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 msgr2=0x7ff390070c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:11.557 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.571+0000 7ff398620640 1 --2- 172.21.15.53:0/1609964907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 0x7ff390070c00 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:11.557 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.572+0000 7ff398620640 1 -- 172.21.15.53:0/1609964907 shutdown_connections 2024-04-25T09:30:11.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.572+0000 7ff398620640 1 --2- 172.21.15.53:0/1609964907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 0x7ff390070c00 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:11.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.572+0000 7ff398620640 1 -- 172.21.15.53:0/1609964907 >> 172.21.15.53:0/1609964907 conn(0x7ff3900a1a20 msgr2=0x7ff3900a1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:11.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.572+0000 7ff398620640 1 -- 172.21.15.53:0/1609964907 shutdown_connections 2024-04-25T09:30:11.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.572+0000 7ff398620640 1 -- 172.21.15.53:0/1609964907 wait complete. 2024-04-25T09:30:11.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.572+0000 7ff398620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:11.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.574+0000 7ff398620640 1 Processor -- start 2024-04-25T09:30:11.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.574+0000 7ff398620640 1 -- start start 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.575+0000 7ff398620640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 0x7ff39011bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.575+0000 7ff398620640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff39011fc60 con 0x7ff3900707f0 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.575+0000 7ff3963bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 0x7ff39011bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.575+0000 7ff3963bc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 0x7ff39011bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:47516/0 (socket says 172.21.15.53:47516) 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.575+0000 7ff3963bc640 1 -- 172.21.15.53:0/2023685250 learned_addr learned my addr 172.21.15.53:0/2023685250 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.575+0000 7ff3963bc640 1 -- 172.21.15.53:0/2023685250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39011cf40 con 0x7ff3900707f0 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.576+0000 7ff3963bc640 1 --2- 172.21.15.53:0/2023685250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 0x7ff39011bbd0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.576+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff388013740 con 0x7ff3900707f0 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.576+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff3880138a0 con 0x7ff3900707f0 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.576+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff390068d00 con 0x7ff3900707f0 2024-04-25T09:30:11.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.576+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff388013b40 con 0x7ff3900707f0 2024-04-25T09:30:11.562 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.576+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39011d750 con 0x7ff3900707f0 2024-04-25T09:30:11.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.577+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3900697f0 con 0x7ff3900707f0 2024-04-25T09:30:11.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.577+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff388013cf0 con 0x7ff3900707f0 2024-04-25T09:30:11.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.577+0000 7ff38effd640 1 --2- 172.21.15.53:0/2023685250 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff37c038980 0x7ff37c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:11.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.577+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(710..710 src has 401..710) ==== 4179+0+0 (crc 0 0 0) 0x7ff388018040 con 0x7ff3900707f0 2024-04-25T09:30:11.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.577+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=711}) -- 0x7ff37c03f390 con 0x7ff3900707f0 2024-04-25T09:30:11.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.577+0000 7ff395bbb640 1 --2- 172.21.15.53:0/2023685250 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff37c038980 0x7ff37c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:11.563 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.578+0000 7ff395bbb640 1 --2- 172.21.15.53:0/2023685250 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff37c038980 0x7ff37c03ae90 crc :-1 s=READY pgs=3788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:11.567 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.582+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ff388012390 con 0x7ff3900707f0 2024-04-25T09:30:11.815 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:11.830+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "0"} v 0) -- 0x7ff3900008d0 con 0x7ff3900707f0 2024-04-25T09:30:12.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:12.458+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v711) ==== 221+0+0 (crc 0 0 0) 0x7ff38800f2a0 con 0x7ff3900707f0 2024-04-25T09:30:12.443 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:12.458+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(711..711 src has 401..711) ==== 628+0+0 (crc 0 0 0) 0x7ff388011660 con 0x7ff3900707f0 2024-04-25T09:30:12.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:12.459+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=712}) -- 0x7ff37c040110 con 0x7ff3900707f0 2024-04-25T09:30:12.554 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:12.569+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "0"} v 0) -- 0x7ff390068370 con 0x7ff3900707f0 2024-04-25T09:30:13.113 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.128+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b v712) ==== 221+0+0 (crc 0 0 0) 0x7ff388018dc0 con 0x7ff3900707f0 2024-04-25T09:30:13.113 INFO:tasks.workunit.client.0.smithi053.stderr:set-quota max_objects = 0 for pool c50b9a0b-a761-4651-b0e1-76fe43e4a63b 2024-04-25T09:30:13.113 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.128+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 <== mon.0 v2:172.21.15.53:3300/0 10 ==== osd_map(712..712 src has 401..712) ==== 628+0+0 (crc 0 0 0) 0x7ff388010e30 con 0x7ff3900707f0 2024-04-25T09:30:13.113 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.128+0000 7ff38effd640 1 -- 172.21.15.53:0/2023685250 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7ff37c040380 con 0x7ff3900707f0 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff37c038980 msgr2=0x7ff37c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 --2- 172.21.15.53:0/2023685250 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff37c038980 0x7ff37c03ae90 crc :-1 s=READY pgs=3788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 msgr2=0x7ff39011bbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 --2- 172.21.15.53:0/2023685250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 0x7ff39011bbd0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 shutdown_connections 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 --2- 172.21.15.53:0/2023685250 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7ff37c038980 0x7ff37c03ae90 unknown :-1 s=CLOSED pgs=3788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 --2- 172.21.15.53:0/2023685250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3900707f0 0x7ff39011bbd0 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 >> 172.21.15.53:0/2023685250 conn(0x7ff3900a1a20 msgr2=0x7ff3900a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 shutdown_connections 2024-04-25T09:30:13.116 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:13.131+0000 7ff398620640 1 -- 172.21.15.53:0/2023685250 wait complete. 2024-04-25T09:30:13.131 INFO:tasks.workunit.client.0.smithi053.stderr:+ sleep 30 2024-04-25T09:30:43.133 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool delete c50b9a0b-a761-4651-b0e1-76fe43e4a63b c50b9a0b-a761-4651-b0e1-76fe43e4a63b --yes-i-really-really-mean-it 2024-04-25T09:30:43.241 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.248+0000 7fc6f2624640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:43.243 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.258+0000 7fc6f2624640 1 Processor -- start 2024-04-25T09:30:43.243 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.258+0000 7fc6f2624640 1 -- start start 2024-04-25T09:30:43.245 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6f2624640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc6ec137d40 0x7fc6ec13a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:43.245 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6f2624640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec09c8e0 con 0x7fc6ec1318a0 2024-04-25T09:30:43.245 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6f2624640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ec09abe0 con 0x7fc6ec137d40 2024-04-25T09:30:43.245 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6eb7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc6ec137d40 0x7fc6ec13a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:43.245 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6ebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc6ec1318a0 0x7fc6ec131cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54184/0 (socket says 172.21.15.53:54184) 2024-04-25T09:30:43.245 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6ebfff640 1 -- 172.21.15.53:0/2435489005 learned_addr learned my addr 172.21.15.53:0/2435489005 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:43.245 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6eb7fe640 1 -- 172.21.15.53:0/2435489005 >> v1:172.21.15.53:6789/0 conn(0x7fc6ec1318a0 legacy=0x7fc6ec131cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:43.246 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6eb7fe640 1 -- 172.21.15.53:0/2435489005 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec1323c0 con 0x7fc6ec137d40 2024-04-25T09:30:43.246 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6eb7fe640 1 --2- 172.21.15.53:0/2435489005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec137d40 0x7fc6ec13a160 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3056bdc7dc30e8b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:43.246 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6eaffd640 1 -- 172.21.15.53:0/2435489005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6e0009d90 con 0x7fc6ec137d40 2024-04-25T09:30:43.246 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6eaffd640 1 -- 172.21.15.53:0/2435489005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc6e000e230 con 0x7fc6ec137d40 2024-04-25T09:30:43.246 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.260+0000 7fc6eaffd640 1 -- 172.21.15.53:0/2435489005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6e000e4d0 con 0x7fc6ec137d40 2024-04-25T09:30:43.247 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.261+0000 7fc6f2624640 1 -- 172.21.15.53:0/2435489005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec137d40 msgr2=0x7fc6ec13a160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:43.247 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.261+0000 7fc6f2624640 1 --2- 172.21.15.53:0/2435489005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec137d40 0x7fc6ec13a160 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:43.247 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.261+0000 7fc6f2624640 1 -- 172.21.15.53:0/2435489005 shutdown_connections 2024-04-25T09:30:43.247 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.261+0000 7fc6f2624640 1 --2- 172.21.15.53:0/2435489005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec137d40 0x7fc6ec13a160 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:43.247 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.261+0000 7fc6f2624640 1 -- 172.21.15.53:0/2435489005 >> 172.21.15.53:0/2435489005 conn(0x7fc6ec06d3a0 msgr2=0x7fc6ec06d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:43.247 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.261+0000 7fc6f2624640 1 -- 172.21.15.53:0/2435489005 shutdown_connections 2024-04-25T09:30:43.247 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.261+0000 7fc6f2624640 1 -- 172.21.15.53:0/2435489005 wait complete. 2024-04-25T09:30:43.247 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.261+0000 7fc6f2624640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:43.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.263+0000 7fc6f2624640 1 Processor -- start 2024-04-25T09:30:43.248 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.263+0000 7fc6f2624640 1 -- start start 2024-04-25T09:30:43.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.265+0000 7fc6f2624640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec1318a0 0x7fc6ec1c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:43.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.265+0000 7fc6f2624640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec1c9310 con 0x7fc6ec1318a0 2024-04-25T09:30:43.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.265+0000 7fc6ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec1318a0 0x7fc6ec1c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:43.253 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.265+0000 7fc6ebfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec1318a0 0x7fc6ec1c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44458/0 (socket says 172.21.15.53:44458) 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.265+0000 7fc6ebfff640 1 -- 172.21.15.53:0/2273476364 learned_addr learned my addr 172.21.15.53:0/2273476364 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.266+0000 7fc6ebfff640 1 -- 172.21.15.53:0/2273476364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec06be20 con 0x7fc6ec1318a0 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.266+0000 7fc6ebfff640 1 --2- 172.21.15.53:0/2273476364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec1318a0 0x7fc6ec1c9860 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.266+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6dc005a60 con 0x7fc6ec1318a0 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.266+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc6dc005bc0 con 0x7fc6ec1318a0 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.266+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ec11fc90 con 0x7fc6ec1318a0 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.266+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6dc005e60 con 0x7fc6ec1318a0 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.266+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ec1205e0 con 0x7fc6ec1318a0 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.267+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ec11fe80 con 0x7fc6ec1318a0 2024-04-25T09:30:43.254 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.267+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc6dc0070b0 con 0x7fc6ec1318a0 2024-04-25T09:30:43.255 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.267+0000 7fc6e8ff9640 1 --2- 172.21.15.53:0/2273476364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc6d8038980 0x7fc6d803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:43.255 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.267+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(712..712 src has 401..712) ==== 4179+0+0 (crc 0 0 0) 0x7fc6dc048680 con 0x7fc6ec1318a0 2024-04-25T09:30:43.255 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.268+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7fc6d803f330 con 0x7fc6ec1318a0 2024-04-25T09:30:43.255 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.268+0000 7fc6eb7fe640 1 --2- 172.21.15.53:0/2273476364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc6d8038980 0x7fc6d803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:43.255 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.268+0000 7fc6eb7fe640 1 --2- 172.21.15.53:0/2273476364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc6d8038980 0x7fc6d803ae90 crc :-1 s=READY pgs=3789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:43.257 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.273+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fc6dc00d330 con 0x7fc6ec1318a0 2024-04-25T09:30:43.446 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:43.461+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "pool2": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc6ec0697f0 con 0x7fc6ec1318a0 2024-04-25T09:30:44.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.459+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "pool2": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "yes_i_really_really_mean_it": true}]=0 pool 'c50b9a0b-a761-4651-b0e1-76fe43e4a63b' removed v713) ==== 248+0+0 (crc 0 0 0) 0x7fc6dc00d150 con 0x7fc6ec1318a0 2024-04-25T09:30:44.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.459+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(713..713 src has 401..713) ==== 296+0+0 (crc 0 0 0) 0x7fc6dc00d510 con 0x7fc6ec1318a0 2024-04-25T09:30:44.444 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.459+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7fc6d803fdb0 con 0x7fc6ec1318a0 2024-04-25T09:30:44.557 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.572+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "pool2": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc6ec11ee80 con 0x7fc6ec1318a0 2024-04-25T09:30:44.558 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.573+0000 7fc6e8ff9640 1 -- 172.21.15.53:0/2273476364 <== mon.0 v2:172.21.15.53:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "pool2": "c50b9a0b-a761-4651-b0e1-76fe43e4a63b", "yes_i_really_really_mean_it": true}]=0 pool 'c50b9a0b-a761-4651-b0e1-76fe43e4a63b' does not exist v713) ==== 255+0+0 (crc 0 0 0) 0x7fc6dc00d720 con 0x7fc6ec1318a0 2024-04-25T09:30:44.558 INFO:tasks.workunit.client.0.smithi053.stderr:pool 'c50b9a0b-a761-4651-b0e1-76fe43e4a63b' does not exist 2024-04-25T09:30:44.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc6d8038980 msgr2=0x7fc6d803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:44.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 --2- 172.21.15.53:0/2273476364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc6d8038980 0x7fc6d803ae90 crc :-1 s=READY pgs=3789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:44.560 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec1318a0 msgr2=0x7fc6ec1c9860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:44.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 --2- 172.21.15.53:0/2273476364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec1318a0 0x7fc6ec1c9860 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:44.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 shutdown_connections 2024-04-25T09:30:44.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 --2- 172.21.15.53:0/2273476364 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fc6d8038980 0x7fc6d803ae90 unknown :-1 s=CLOSED pgs=3789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:44.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 --2- 172.21.15.53:0/2273476364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6ec1318a0 0x7fc6ec1c9860 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:44.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 >> 172.21.15.53:0/2273476364 conn(0x7fc6ec06d3a0 msgr2=0x7fc6ec1347e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:44.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 shutdown_connections 2024-04-25T09:30:44.561 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.575+0000 7fc6f2624640 1 -- 172.21.15.53:0/2273476364 wait complete. 2024-04-25T09:30:44.572 INFO:tasks.workunit.client.0.smithi053.stderr:+ ceph osd pool delete c703408b-a4c5-4118-ba7e-91b1f88f4328 c703408b-a4c5-4118-ba7e-91b1f88f4328 --yes-i-really-really-mean-it 2024-04-25T09:30:44.669 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.675+0000 7fdca8d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:44.670 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.685+0000 7fdca8d9d640 1 Processor -- start 2024-04-25T09:30:44.670 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.685+0000 7fdca8d9d640 1 -- start start 2024-04-25T09:30:44.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.687+0000 7fdca8d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdca4135a30 0x7fdca4137e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:44.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.687+0000 7fdca8d9d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca40720d0 con 0x7fdca412e510 2024-04-25T09:30:44.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.687+0000 7fdca8d9d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdca412f030 con 0x7fdca4135a30 2024-04-25T09:30:44.672 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.687+0000 7fdca1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdca4135a30 0x7fdca4137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:44.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.687+0000 7fdca259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdca412e510 0x7fdca412e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54186/0 (socket says 172.21.15.53:54186) 2024-04-25T09:30:44.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.687+0000 7fdca259c640 1 -- 172.21.15.53:0/749800666 learned_addr learned my addr 172.21.15.53:0/749800666 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:44.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.687+0000 7fdca1d9b640 1 -- 172.21.15.53:0/749800666 >> v1:172.21.15.53:6789/0 conn(0x7fdca412e510 legacy=0x7fdca412e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:44.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.687+0000 7fdca1d9b640 1 -- 172.21.15.53:0/749800666 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca4073a00 con 0x7fdca4135a30 2024-04-25T09:30:44.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.687+0000 7fdca159a640 1 -- 172.21.15.53:0/749800666 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138724431 0 0) 0x7fdca40720d0 con 0x7fdca412e510 2024-04-25T09:30:44.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.688+0000 7fdca1d9b640 1 --2- 172.21.15.53:0/749800666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca4135a30 0x7fdca4137e50 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00f2f0fa97c515b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:44.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.688+0000 7fdca159a640 1 -- 172.21.15.53:0/749800666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc8c009d90 con 0x7fdca4135a30 2024-04-25T09:30:44.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.688+0000 7fdca159a640 1 -- 172.21.15.53:0/749800666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc8c00e230 con 0x7fdca4135a30 2024-04-25T09:30:44.673 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.688+0000 7fdca159a640 1 -- 172.21.15.53:0/749800666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc8c00e4d0 con 0x7fdca4135a30 2024-04-25T09:30:44.674 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.688+0000 7fdca8d9d640 1 -- 172.21.15.53:0/749800666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca4135a30 msgr2=0x7fdca4137e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:44.674 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.688+0000 7fdca8d9d640 1 --2- 172.21.15.53:0/749800666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca4135a30 0x7fdca4137e50 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:44.674 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.688+0000 7fdca8d9d640 1 -- 172.21.15.53:0/749800666 shutdown_connections 2024-04-25T09:30:44.674 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.689+0000 7fdca8d9d640 1 --2- 172.21.15.53:0/749800666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca4135a30 0x7fdca4137e50 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:44.674 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.689+0000 7fdca8d9d640 1 -- 172.21.15.53:0/749800666 >> 172.21.15.53:0/749800666 conn(0x7fdca40a1850 msgr2=0x7fdca40a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:44.674 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.689+0000 7fdca8d9d640 1 -- 172.21.15.53:0/749800666 shutdown_connections 2024-04-25T09:30:44.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.689+0000 7fdca8d9d640 1 -- 172.21.15.53:0/749800666 wait complete. 2024-04-25T09:30:44.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.689+0000 7fdca8d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:44.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.691+0000 7fdca8d9d640 1 Processor -- start 2024-04-25T09:30:44.675 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.691+0000 7fdca8d9d640 1 -- start start 2024-04-25T09:30:44.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.692+0000 7fdca8d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca412e510 0x7fdca41c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:44.677 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.692+0000 7fdca8d9d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdca41c6e10 con 0x7fdca412e510 2024-04-25T09:30:44.678 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdca259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca412e510 0x7fdca41c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:44.678 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdca259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca412e510 0x7fdca41c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44470/0 (socket says 172.21.15.53:44470) 2024-04-25T09:30:44.678 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdca259c640 1 -- 172.21.15.53:0/2226841516 learned_addr learned my addr 172.21.15.53:0/2226841516 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:44.678 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdca259c640 1 -- 172.21.15.53:0/2226841516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca411c1b0 con 0x7fdca412e510 2024-04-25T09:30:44.678 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdca259c640 1 --2- 172.21.15.53:0/2226841516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca412e510 0x7fdca41c71d0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:44.678 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc9c004b80 con 0x7fdca412e510 2024-04-25T09:30:44.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc9c004ce0 con 0x7fdca412e510 2024-04-25T09:30:44.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc9c007120 con 0x7fdca412e510 2024-04-25T09:30:44.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca411ca90 con 0x7fdca412e510 2024-04-25T09:30:44.679 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.693+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca411d7b0 con 0x7fdca412e510 2024-04-25T09:30:44.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.694+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fdc9c0072d0 con 0x7fdca412e510 2024-04-25T09:30:44.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.694+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca40697f0 con 0x7fdca412e510 2024-04-25T09:30:44.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.695+0000 7fdc9affd640 1 --2- 172.21.15.53:0/2226841516 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc84038980 0x7fdc8403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:44.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.695+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(713..713 src has 401..713) ==== 3791+0+0 (crc 0 0 0) 0x7fdc9c048830 con 0x7fdca412e510 2024-04-25T09:30:44.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.695+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7fdc8403eb90 con 0x7fdca412e510 2024-04-25T09:30:44.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.695+0000 7fdca1d9b640 1 --2- 172.21.15.53:0/2226841516 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc84038980 0x7fdc8403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:44.680 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.695+0000 7fdca1d9b640 1 --2- 172.21.15.53:0/2226841516 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc84038980 0x7fdc8403ae90 crc :-1 s=READY pgs=3790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:44.684 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.700+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fdc9c00f230 con 0x7fdca412e510 2024-04-25T09:30:44.871 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:44.886+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "pool2": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdca4068370 con 0x7fdca412e510 2024-04-25T09:30:45.448 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.463+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "pool2": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "yes_i_really_really_mean_it": true}]=0 pool 'c703408b-a4c5-4118-ba7e-91b1f88f4328' removed v714) ==== 248+0+0 (crc 0 0 0) 0x7fdc9c00a5d0 con 0x7fdca412e510 2024-04-25T09:30:45.448 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.463+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 <== mon.0 v2:172.21.15.53:3300/0 8 ==== osd_map(714..714 src has 401..714) ==== 296+0+0 (crc 0 0 0) 0x7fdc9c006310 con 0x7fdca412e510 2024-04-25T09:30:45.448 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.463+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7fdc8403f8e0 con 0x7fdca412e510 2024-04-25T09:30:45.681 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.696+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "pool2": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdca411e590 con 0x7fdca412e510 2024-04-25T09:30:45.682 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.697+0000 7fdc9affd640 1 -- 172.21.15.53:0/2226841516 <== mon.0 v2:172.21.15.53:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "pool2": "c703408b-a4c5-4118-ba7e-91b1f88f4328", "yes_i_really_really_mean_it": true}]=0 pool 'c703408b-a4c5-4118-ba7e-91b1f88f4328' does not exist v714) ==== 255+0+0 (crc 0 0 0) 0x7fdc9c00a7b0 con 0x7fdca412e510 2024-04-25T09:30:45.682 INFO:tasks.workunit.client.0.smithi053.stderr:pool 'c703408b-a4c5-4118-ba7e-91b1f88f4328' does not exist 2024-04-25T09:30:45.686 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc84038980 msgr2=0x7fdc8403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:45.686 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 --2- 172.21.15.53:0/2226841516 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc84038980 0x7fdc8403ae90 crc :-1 s=READY pgs=3790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:45.686 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca412e510 msgr2=0x7fdca41c71d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:45.686 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 --2- 172.21.15.53:0/2226841516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca412e510 0x7fdca41c71d0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:45.686 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 shutdown_connections 2024-04-25T09:30:45.687 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 --2- 172.21.15.53:0/2226841516 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc84038980 0x7fdc8403ae90 unknown :-1 s=CLOSED pgs=3790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:45.687 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 --2- 172.21.15.53:0/2226841516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdca412e510 0x7fdca41c71d0 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:45.687 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 >> 172.21.15.53:0/2226841516 conn(0x7fdca40a1850 msgr2=0x7fdca4070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:45.687 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 shutdown_connections 2024-04-25T09:30:45.687 INFO:tasks.workunit.client.0.smithi053.stderr:2024-04-25T09:30:45.701+0000 7fdca8d9d640 1 -- 172.21.15.53:0/2226841516 wait complete. 2024-04-25T09:30:45.703 INFO:tasks.workunit.client.0.smithi053.stderr:+ echo OK 2024-04-25T09:30:45.704 INFO:tasks.workunit.client.0.smithi053.stdout:OK 2024-04-25T09:30:45.704 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T09:30:45.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T09:30:45.772 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-04-25T09:30:45.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T09:30:46.125 DEBUG:teuthology.parallel:result is None 2024-04-25T09:30:46.125 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T09:30:46.150 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T09:30:46.150 DEBUG:teuthology.orchestra.run.smithi053:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-25T09:30:46.211 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T09:30:46.211 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T09:30:46.224 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:30:46.224 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:46.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.374+0000 7f900c71d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.379+0000 7f900c71d640 1 Processor -- start 2024-04-25T09:30:46.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.379+0000 7f900c71d640 1 -- start start 2024-04-25T09:30:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f900c71d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f900406ec40 0x7f900413a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f900c71d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90041321e0 con 0x7f90040a11e0 2024-04-25T09:30:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f900c71d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f90040a0d90 con 0x7f900406ec40 2024-04-25T09:30:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f9009cb8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f900406ec40 0x7f900413a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f900a4b9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f90040a11e0 0x7f900409fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54196/0 (socket says 172.21.15.53:54196) 2024-04-25T09:30:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f900a4b9640 1 -- 172.21.15.53:0/2906280084 learned_addr learned my addr 172.21.15.53:0/2906280084 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:46.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f9009cb8640 1 -- 172.21.15.53:0/2906280084 >> v1:172.21.15.53:6789/0 conn(0x7f90040a11e0 legacy=0x7f900409fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:46.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f90094b7640 1 -- 172.21.15.53:0/2906280084 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377737668 0 0) 0x7f90041321e0 con 0x7f90040a11e0 2024-04-25T09:30:46.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f9009cb8640 1 -- 172.21.15.53:0/2906280084 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900406f050 con 0x7f900406ec40 2024-04-25T09:30:46.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f9009cb8640 1 --2- 172.21.15.53:0/2906280084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 0x7f900413a140 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a827025c919f4f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:46.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f90094b7640 1 -- 172.21.15.53:0/2906280084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ff4009d90 con 0x7f900406ec40 2024-04-25T09:30:46.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f90094b7640 1 -- 172.21.15.53:0/2906280084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ff400e230 con 0x7f900406ec40 2024-04-25T09:30:46.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.381+0000 7f90094b7640 1 -- 172.21.15.53:0/2906280084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ff400e4d0 con 0x7f900406ec40 2024-04-25T09:30:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.382+0000 7f900c71d640 1 -- 172.21.15.53:0/2906280084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 msgr2=0x7f900413a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.382+0000 7f900c71d640 1 --2- 172.21.15.53:0/2906280084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 0x7f900413a140 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.382+0000 7f900c71d640 1 -- 172.21.15.53:0/2906280084 shutdown_connections 2024-04-25T09:30:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.382+0000 7f900c71d640 1 --2- 172.21.15.53:0/2906280084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 0x7f900413a140 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.382+0000 7f900c71d640 1 -- 172.21.15.53:0/2906280084 >> 172.21.15.53:0/2906280084 conn(0x7f90040a5050 msgr2=0x7f90040a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.382+0000 7f900c71d640 1 -- 172.21.15.53:0/2906280084 shutdown_connections 2024-04-25T09:30:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.382+0000 7f900c71d640 1 -- 172.21.15.53:0/2906280084 wait complete. 2024-04-25T09:30:46.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.383+0000 7f900c71d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:46.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.384+0000 7f900c71d640 1 Processor -- start 2024-04-25T09:30:46.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.384+0000 7f900c71d640 1 -- start start 2024-04-25T09:30:46.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.386+0000 7f900c71d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 0x7f90041c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:46.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.386+0000 7f900c71d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9004072d90 con 0x7f900406ec40 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.386+0000 7f900a4b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 0x7f90041c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.386+0000 7f900a4b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 0x7f90041c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:44490/0 (socket says 172.21.15.53:44490) 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.386+0000 7f900a4b9640 1 -- 172.21.15.53:0/2561012488 learned_addr learned my addr 172.21.15.53:0/2561012488 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.386+0000 7f900a4b9640 1 -- 172.21.15.53:0/2561012488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9004072fc0 con 0x7f900406ec40 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.386+0000 7f900a4b9640 1 --2- 172.21.15.53:0/2561012488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 0x7f90041c9c70 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.386+0000 7f8ffaffd640 1 -- 172.21.15.53:0/2561012488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9000005a60 con 0x7f900406ec40 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.387+0000 7f8ffaffd640 1 -- 172.21.15.53:0/2561012488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9000005bc0 con 0x7f900406ec40 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.387+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90040717f0 con 0x7f900406ec40 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.387+0000 7f8ffaffd640 1 -- 172.21.15.53:0/2561012488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9000005e60 con 0x7f900406ec40 2024-04-25T09:30:46.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.387+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9004072060 con 0x7f900406ec40 2024-04-25T09:30:46.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.388+0000 7f8ffaffd640 1 -- 172.21.15.53:0/2561012488 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f900000c770 con 0x7f900406ec40 2024-04-25T09:30:46.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.388+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9004063880 con 0x7f900406ec40 2024-04-25T09:30:46.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.388+0000 7f8ffaffd640 1 --2- 172.21.15.53:0/2561012488 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8fe8038980 0x7f8fe803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:46.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.388+0000 7f8ffaffd640 1 -- 172.21.15.53:0/2561012488 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 401..714) ==== 3403+0+0 (crc 0 0 0) 0x7f9000048460 con 0x7f900406ec40 2024-04-25T09:30:46.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.388+0000 7f9009cb8640 1 --2- 172.21.15.53:0/2561012488 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8fe8038980 0x7f8fe803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:46.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.389+0000 7f9009cb8640 1 --2- 172.21.15.53:0/2561012488 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8fe8038980 0x7f8fe803ae90 crc :-1 s=READY pgs=3791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:46.377 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.393+0000 7f8ffaffd640 1 -- 172.21.15.53:0/2561012488 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f900000d330 con 0x7f900406ec40 2024-04-25T09:30:46.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.577+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9004067fd0 con 0x7f8fe8038980 2024-04-25T09:30:46.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.581+0000 7f8ffaffd640 1 -- 172.21.15.53:0/2561012488 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109148 (crc 0 0 0) 0x7f9004067fd0 con 0x7f8fe8038980 2024-04-25T09:30:46.566 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:30:46.567 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-25T09:30:46.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8fe8038980 msgr2=0x7f8fe803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:46.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 --2- 172.21.15.53:0/2561012488 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8fe8038980 0x7f8fe803ae90 crc :-1 s=READY pgs=3791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 msgr2=0x7f90041c9c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:46.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 --2- 172.21.15.53:0/2561012488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 0x7f90041c9c70 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 shutdown_connections 2024-04-25T09:30:46.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 --2- 172.21.15.53:0/2561012488 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8fe8038980 0x7f8fe803ae90 unknown :-1 s=CLOSED pgs=3791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 --2- 172.21.15.53:0/2561012488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f900406ec40 0x7f90041c9c70 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 >> 172.21.15.53:0/2561012488 conn(0x7f90040a5050 msgr2=0x7f900409fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:46.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 shutdown_connections 2024-04-25T09:30:46.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.583+0000 7f900c71d640 1 -- 172.21.15.53:0/2561012488 wait complete. 2024-04-25T09:30:46.579 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":1265,"stamp":"2024-04-25T09:30:45.464607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":292356,"kb_used_data":15204,"kb_used_omap":0,"kb_used_meta":277120,"kb_avail":419138044,"statfs":{"total":429496729600,"available":429197357056,"internally_reserved":0,"allocated":15568896,"data_stored":6995742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":283770880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.066063"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.504584+0000","last_change":"2024-04-25T09:17:07.201124+0000","last_active":"2024-04-25T09:30:14.504584+0000","last_peered":"2024-04-25T09:30:14.504584+0000","last_clean":"2024-04-25T09:30:14.504584+0000","last_became_active":"2024-04-25T09:17:07.189673+0000","last_became_peered":"2024-04-25T09:17:07.189673+0000","last_unstale":"2024-04-25T09:30:14.504584+0000","last_undegraded":"2024-04-25T09:30:14.504584+0000","last_fullsized":"2024-04-25T09:30:14.504584+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.221909+0000","last_change":"2024-04-25T09:17:07.224428+0000","last_active":"2024-04-25T09:30:13.221909+0000","last_peered":"2024-04-25T09:30:13.221909+0000","last_clean":"2024-04-25T09:30:13.221909+0000","last_became_active":"2024-04-25T09:17:07.216422+0000","last_became_peered":"2024-04-25T09:17:07.216422+0000","last_unstale":"2024-04-25T09:30:13.221909+0000","last_undegraded":"2024-04-25T09:30:13.221909+0000","last_fullsized":"2024-04-25T09:30:13.221909+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.306825+0000","last_change":"2024-04-25T09:17:07.221368+0000","last_active":"2024-04-25T09:30:14.306825+0000","last_peered":"2024-04-25T09:30:14.306825+0000","last_clean":"2024-04-25T09:30:14.306825+0000","last_became_active":"2024-04-25T09:17:07.210105+0000","last_became_peered":"2024-04-25T09:17:07.210105+0000","last_unstale":"2024-04-25T09:30:14.306825+0000","last_undegraded":"2024-04-25T09:30:14.306825+0000","last_fullsized":"2024-04-25T09:30:14.306825+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.317729+0000","last_change":"2024-04-25T09:17:07.259390+0000","last_active":"2024-04-25T09:30:14.317729+0000","last_peered":"2024-04-25T09:30:14.317729+0000","last_clean":"2024-04-25T09:30:14.317729+0000","last_became_active":"2024-04-25T09:17:07.245112+0000","last_became_peered":"2024-04-25T09:17:07.245112+0000","last_unstale":"2024-04-25T09:30:14.317729+0000","last_undegraded":"2024-04-25T09:30:14.317729+0000","last_fullsized":"2024-04-25T09:30:14.317729+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.498167+0000","last_change":"2024-04-25T09:17:07.282257+0000","last_active":"2024-04-25T09:30:14.498167+0000","last_peered":"2024-04-25T09:30:14.498167+0000","last_clean":"2024-04-25T09:30:14.498167+0000","last_became_active":"2024-04-25T09:17:07.266007+0000","last_became_peered":"2024-04-25T09:17:07.266007+0000","last_unstale":"2024-04-25T09:30:14.498167+0000","last_undegraded":"2024-04-25T09:30:14.498167+0000","last_fullsized":"2024-04-25T09:30:14.498167+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.248562+0000","last_change":"2024-04-25T09:17:07.164825+0000","last_active":"2024-04-25T09:30:13.248562+0000","last_peered":"2024-04-25T09:30:13.248562+0000","last_clean":"2024-04-25T09:30:13.248562+0000","last_became_active":"2024-04-25T09:17:07.160621+0000","last_became_peered":"2024-04-25T09:17:07.160621+0000","last_unstale":"2024-04-25T09:30:13.248562+0000","last_undegraded":"2024-04-25T09:30:13.248562+0000","last_fullsized":"2024-04-25T09:30:13.248562+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.257208+0000","last_change":"2024-04-25T09:17:07.330453+0000","last_active":"2024-04-25T09:30:13.257208+0000","last_peered":"2024-04-25T09:30:13.257208+0000","last_clean":"2024-04-25T09:30:13.257208+0000","last_became_active":"2024-04-25T09:17:07.321872+0000","last_became_peered":"2024-04-25T09:17:07.321872+0000","last_unstale":"2024-04-25T09:30:13.257208+0000","last_undegraded":"2024-04-25T09:30:13.257208+0000","last_fullsized":"2024-04-25T09:30:13.257208+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.245474+0000","last_change":"2024-04-25T09:17:07.278297+0000","last_active":"2024-04-25T09:30:13.245474+0000","last_peered":"2024-04-25T09:30:13.245474+0000","last_clean":"2024-04-25T09:30:13.245474+0000","last_became_active":"2024-04-25T09:17:07.266913+0000","last_became_peered":"2024-04-25T09:17:07.266913+0000","last_unstale":"2024-04-25T09:30:13.245474+0000","last_undegraded":"2024-04-25T09:30:13.245474+0000","last_fullsized":"2024-04-25T09:30:13.245474+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.358596+0000","last_change":"2024-04-25T09:17:07.242083+0000","last_active":"2024-04-25T09:30:14.358596+0000","last_peered":"2024-04-25T09:30:14.358596+0000","last_clean":"2024-04-25T09:30:14.358596+0000","last_became_active":"2024-04-25T09:17:07.229886+0000","last_became_peered":"2024-04-25T09:17:07.229886+0000","last_unstale":"2024-04-25T09:30:14.358596+0000","last_undegraded":"2024-04-25T09:30:14.358596+0000","last_fullsized":"2024-04-25T09:30:14.358596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.308238+0000","last_change":"2024-04-25T09:17:07.206231+0000","last_active":"2024-04-25T09:30:14.308238+0000","last_peered":"2024-04-25T09:30:14.308238+0000","last_clean":"2024-04-25T09:30:14.308238+0000","last_became_active":"2024-04-25T09:17:07.191533+0000","last_became_peered":"2024-04-25T09:17:07.191533+0000","last_unstale":"2024-04-25T09:30:14.308238+0000","last_undegraded":"2024-04-25T09:30:14.308238+0000","last_fullsized":"2024-04-25T09:30:14.308238+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.329103+0000","last_change":"2024-04-25T09:17:07.266661+0000","last_active":"2024-04-25T09:30:14.329103+0000","last_peered":"2024-04-25T09:30:14.329103+0000","last_clean":"2024-04-25T09:30:14.329103+0000","last_became_active":"2024-04-25T09:17:07.251853+0000","last_became_peered":"2024-04-25T09:17:07.251853+0000","last_unstale":"2024-04-25T09:30:14.329103+0000","last_undegraded":"2024-04-25T09:30:14.329103+0000","last_fullsized":"2024-04-25T09:30:14.329103+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.251752+0000","last_change":"2024-04-25T09:17:07.345678+0000","last_active":"2024-04-25T09:30:13.251752+0000","last_peered":"2024-04-25T09:30:13.251752+0000","last_clean":"2024-04-25T09:30:13.251752+0000","last_became_active":"2024-04-25T09:17:07.337829+0000","last_became_peered":"2024-04-25T09:17:07.337829+0000","last_unstale":"2024-04-25T09:30:13.251752+0000","last_undegraded":"2024-04-25T09:30:13.251752+0000","last_fullsized":"2024-04-25T09:30:13.251752+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.339701+0000","last_change":"2024-04-25T09:17:07.285325+0000","last_active":"2024-04-25T09:30:14.339701+0000","last_peered":"2024-04-25T09:30:14.339701+0000","last_clean":"2024-04-25T09:30:14.339701+0000","last_became_active":"2024-04-25T09:17:07.279403+0000","last_became_peered":"2024-04-25T09:17:07.279403+0000","last_unstale":"2024-04-25T09:30:14.339701+0000","last_undegraded":"2024-04-25T09:30:14.339701+0000","last_fullsized":"2024-04-25T09:30:14.339701+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.342204+0000","last_change":"2024-04-25T09:17:07.319308+0000","last_active":"2024-04-25T09:30:14.342204+0000","last_peered":"2024-04-25T09:30:14.342204+0000","last_clean":"2024-04-25T09:30:14.342204+0000","last_became_active":"2024-04-25T09:17:07.313695+0000","last_became_peered":"2024-04-25T09:17:07.313695+0000","last_unstale":"2024-04-25T09:30:14.342204+0000","last_undegraded":"2024-04-25T09:30:14.342204+0000","last_fullsized":"2024-04-25T09:30:14.342204+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.423971+0000","last_change":"2024-04-25T09:17:07.361467+0000","last_active":"2024-04-25T09:30:13.423971+0000","last_peered":"2024-04-25T09:30:13.423971+0000","last_clean":"2024-04-25T09:30:13.423971+0000","last_became_active":"2024-04-25T09:17:07.356955+0000","last_became_peered":"2024-04-25T09:17:07.356955+0000","last_unstale":"2024-04-25T09:30:13.423971+0000","last_undegraded":"2024-04-25T09:30:13.423971+0000","last_fullsized":"2024-04-25T09:30:13.423971+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.218341+0000","last_change":"2024-04-25T09:17:07.285671+0000","last_active":"2024-04-25T09:30:13.218341+0000","last_peered":"2024-04-25T09:30:13.218341+0000","last_clean":"2024-04-25T09:30:13.218341+0000","last_became_active":"2024-04-25T09:17:07.273692+0000","last_became_peered":"2024-04-25T09:17:07.273692+0000","last_unstale":"2024-04-25T09:30:13.218341+0000","last_undegraded":"2024-04-25T09:30:13.218341+0000","last_fullsized":"2024-04-25T09:30:13.218341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.202405+0000","last_change":"2024-04-25T09:17:07.264380+0000","last_active":"2024-04-25T09:30:13.202405+0000","last_peered":"2024-04-25T09:30:13.202405+0000","last_clean":"2024-04-25T09:30:13.202405+0000","last_became_active":"2024-04-25T09:17:07.258228+0000","last_became_peered":"2024-04-25T09:17:07.258228+0000","last_unstale":"2024-04-25T09:30:13.202405+0000","last_undegraded":"2024-04-25T09:30:13.202405+0000","last_fullsized":"2024-04-25T09:30:13.202405+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.286465+0000","last_change":"2024-04-25T09:17:07.216743+0000","last_active":"2024-04-25T09:30:14.286465+0000","last_peered":"2024-04-25T09:30:14.286465+0000","last_clean":"2024-04-25T09:30:14.286465+0000","last_became_active":"2024-04-25T09:17:07.207791+0000","last_became_peered":"2024-04-25T09:17:07.207791+0000","last_unstale":"2024-04-25T09:30:14.286465+0000","last_undegraded":"2024-04-25T09:30:14.286465+0000","last_fullsized":"2024-04-25T09:30:14.286465+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.324802+0000","last_change":"2024-04-25T09:17:07.216193+0000","last_active":"2024-04-25T09:30:14.324802+0000","last_peered":"2024-04-25T09:30:14.324802+0000","last_clean":"2024-04-25T09:30:14.324802+0000","last_became_active":"2024-04-25T09:17:07.198934+0000","last_became_peered":"2024-04-25T09:17:07.198934+0000","last_unstale":"2024-04-25T09:30:14.324802+0000","last_undegraded":"2024-04-25T09:30:14.324802+0000","last_fullsized":"2024-04-25T09:30:14.324802+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.477465+0000","last_change":"2024-04-25T09:17:07.289029+0000","last_active":"2024-04-25T09:30:14.477465+0000","last_peered":"2024-04-25T09:30:14.477465+0000","last_clean":"2024-04-25T09:30:14.477465+0000","last_became_active":"2024-04-25T09:17:07.274194+0000","last_became_peered":"2024-04-25T09:17:07.274194+0000","last_unstale":"2024-04-25T09:30:14.477465+0000","last_undegraded":"2024-04-25T09:30:14.477465+0000","last_fullsized":"2024-04-25T09:30:14.477465+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.491389+0000","last_change":"2024-04-25T09:17:07.270278+0000","last_active":"2024-04-25T09:30:14.491389+0000","last_peered":"2024-04-25T09:30:14.491389+0000","last_clean":"2024-04-25T09:30:14.491389+0000","last_became_active":"2024-04-25T09:17:07.258040+0000","last_became_peered":"2024-04-25T09:17:07.258040+0000","last_unstale":"2024-04-25T09:30:14.491389+0000","last_undegraded":"2024-04-25T09:30:14.491389+0000","last_fullsized":"2024-04-25T09:30:14.491389+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.468241+0000","last_change":"2024-04-25T09:17:07.293534+0000","last_active":"2024-04-25T09:30:14.468241+0000","last_peered":"2024-04-25T09:30:14.468241+0000","last_clean":"2024-04-25T09:30:14.468241+0000","last_became_active":"2024-04-25T09:17:07.285972+0000","last_became_peered":"2024-04-25T09:17:07.285972+0000","last_unstale":"2024-04-25T09:30:14.468241+0000","last_undegraded":"2024-04-25T09:30:14.468241+0000","last_fullsized":"2024-04-25T09:30:14.468241+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.310165+0000","last_change":"2024-04-25T09:17:07.239436+0000","last_active":"2024-04-25T09:30:14.310165+0000","last_peered":"2024-04-25T09:30:14.310165+0000","last_clean":"2024-04-25T09:30:14.310165+0000","last_became_active":"2024-04-25T09:17:07.232151+0000","last_became_peered":"2024-04-25T09:17:07.232151+0000","last_unstale":"2024-04-25T09:30:14.310165+0000","last_undegraded":"2024-04-25T09:30:14.310165+0000","last_fullsized":"2024-04-25T09:30:14.310165+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.364726+0000","last_change":"2024-04-25T09:17:07.308904+0000","last_active":"2024-04-25T09:30:14.364726+0000","last_peered":"2024-04-25T09:30:14.364726+0000","last_clean":"2024-04-25T09:30:14.364726+0000","last_became_active":"2024-04-25T09:17:07.302869+0000","last_became_peered":"2024-04-25T09:17:07.302869+0000","last_unstale":"2024-04-25T09:30:14.364726+0000","last_undegraded":"2024-04-25T09:30:14.364726+0000","last_fullsized":"2024-04-25T09:30:14.364726+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.322859+0000","last_change":"2024-04-25T09:17:07.272067+0000","last_active":"2024-04-25T09:30:14.322859+0000","last_peered":"2024-04-25T09:30:14.322859+0000","last_clean":"2024-04-25T09:30:14.322859+0000","last_became_active":"2024-04-25T09:17:07.262656+0000","last_became_peered":"2024-04-25T09:17:07.262656+0000","last_unstale":"2024-04-25T09:30:14.322859+0000","last_undegraded":"2024-04-25T09:30:14.322859+0000","last_fullsized":"2024-04-25T09:30:14.322859+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.246669+0000","last_change":"2024-04-25T09:17:07.292436+0000","last_active":"2024-04-25T09:30:13.246669+0000","last_peered":"2024-04-25T09:30:13.246669+0000","last_clean":"2024-04-25T09:30:13.246669+0000","last_became_active":"2024-04-25T09:17:07.282946+0000","last_became_peered":"2024-04-25T09:17:07.282946+0000","last_unstale":"2024-04-25T09:30:13.246669+0000","last_undegraded":"2024-04-25T09:30:13.246669+0000","last_fullsized":"2024-04-25T09:30:13.246669+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.344452+0000","last_change":"2024-04-25T09:17:07.247974+0000","last_active":"2024-04-25T09:30:14.344452+0000","last_peered":"2024-04-25T09:30:14.344452+0000","last_clean":"2024-04-25T09:30:14.344452+0000","last_became_active":"2024-04-25T09:17:07.233194+0000","last_became_peered":"2024-04-25T09:17:07.233194+0000","last_unstale":"2024-04-25T09:30:14.344452+0000","last_undegraded":"2024-04-25T09:30:14.344452+0000","last_fullsized":"2024-04-25T09:30:14.344452+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.234244+0000","last_change":"2024-04-25T09:17:07.304053+0000","last_active":"2024-04-25T09:30:13.234244+0000","last_peered":"2024-04-25T09:30:13.234244+0000","last_clean":"2024-04-25T09:30:13.234244+0000","last_became_active":"2024-04-25T09:17:07.297538+0000","last_became_peered":"2024-04-25T09:17:07.297538+0000","last_unstale":"2024-04-25T09:30:13.234244+0000","last_undegraded":"2024-04-25T09:30:13.234244+0000","last_fullsized":"2024-04-25T09:30:13.234244+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.236582+0000","last_change":"2024-04-25T09:17:07.249279+0000","last_active":"2024-04-25T09:30:13.236582+0000","last_peered":"2024-04-25T09:30:13.236582+0000","last_clean":"2024-04-25T09:30:13.236582+0000","last_became_active":"2024-04-25T09:17:07.241694+0000","last_became_peered":"2024-04-25T09:17:07.241694+0000","last_unstale":"2024-04-25T09:30:13.236582+0000","last_undegraded":"2024-04-25T09:30:13.236582+0000","last_fullsized":"2024-04-25T09:30:13.236582+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.214403+0000","last_change":"2024-04-25T09:17:07.317393+0000","last_active":"2024-04-25T09:30:13.214403+0000","last_peered":"2024-04-25T09:30:13.214403+0000","last_clean":"2024-04-25T09:30:13.214403+0000","last_became_active":"2024-04-25T09:17:07.311173+0000","last_became_peered":"2024-04-25T09:17:07.311173+0000","last_unstale":"2024-04-25T09:30:13.214403+0000","last_undegraded":"2024-04-25T09:30:13.214403+0000","last_fullsized":"2024-04-25T09:30:13.214403+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1308,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.499421+0000","last_change":"2024-04-25T09:17:07.199203+0000","last_active":"2024-04-25T09:30:14.499421+0000","last_peered":"2024-04-25T09:30:14.499421+0000","last_clean":"2024-04-25T09:30:14.499421+0000","last_became_active":"2024-04-25T09:17:07.185148+0000","last_became_peered":"2024-04-25T09:17:07.185148+0000","last_unstale":"2024-04-25T09:30:14.499421+0000","last_undegraded":"2024-04-25T09:30:14.499421+0000","last_fullsized":"2024-04-25T09:30:14.499421+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.271785+0000","last_change":"2024-04-25T09:17:07.204194+0000","last_active":"2024-04-25T09:30:14.271785+0000","last_peered":"2024-04-25T09:30:14.271785+0000","last_clean":"2024-04-25T09:30:14.271785+0000","last_became_active":"2024-04-25T09:17:07.194953+0000","last_became_peered":"2024-04-25T09:17:07.194953+0000","last_unstale":"2024-04-25T09:30:14.271785+0000","last_undegraded":"2024-04-25T09:30:14.271785+0000","last_fullsized":"2024-04-25T09:30:14.271785+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1892,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.478600+0000","last_change":"2024-04-25T09:12:15.261642+0000","last_active":"2024-04-25T09:30:14.478600+0000","last_peered":"2024-04-25T09:30:14.478600+0000","last_clean":"2024-04-25T09:30:14.478600+0000","last_became_active":"2024-04-25T09:12:15.255284+0000","last_became_peered":"2024-04-25T09:12:15.255284+0000","last_unstale":"2024-04-25T09:30:14.478600+0000","last_undegraded":"2024-04-25T09:30:14.478600+0000","last_fullsized":"2024-04-25T09:30:14.478600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1886,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.399829+0000","last_change":"2024-04-25T09:12:15.237133+0000","last_active":"2024-04-25T09:30:14.399829+0000","last_peered":"2024-04-25T09:30:14.399829+0000","last_clean":"2024-04-25T09:30:14.399829+0000","last_became_active":"2024-04-25T09:12:15.231593+0000","last_became_peered":"2024-04-25T09:12:15.231593+0000","last_unstale":"2024-04-25T09:30:14.399829+0000","last_undegraded":"2024-04-25T09:30:14.399829+0000","last_fullsized":"2024-04-25T09:30:14.399829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1874,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.483111+0000","last_change":"2024-04-25T09:12:15.244463+0000","last_active":"2024-04-25T09:30:14.483111+0000","last_peered":"2024-04-25T09:30:14.483111+0000","last_clean":"2024-04-25T09:30:14.483111+0000","last_became_active":"2024-04-25T09:12:15.239187+0000","last_became_peered":"2024-04-25T09:12:15.239187+0000","last_unstale":"2024-04-25T09:30:14.483111+0000","last_undegraded":"2024-04-25T09:30:14.483111+0000","last_fullsized":"2024-04-25T09:30:14.483111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1886,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.299442+0000","last_change":"2024-04-25T09:12:15.226592+0000","last_active":"2024-04-25T09:30:14.299442+0000","last_peered":"2024-04-25T09:30:14.299442+0000","last_clean":"2024-04-25T09:30:14.299442+0000","last_became_active":"2024-04-25T09:12:15.221443+0000","last_became_peered":"2024-04-25T09:12:15.221443+0000","last_unstale":"2024-04-25T09:30:14.299442+0000","last_undegraded":"2024-04-25T09:30:14.299442+0000","last_fullsized":"2024-04-25T09:30:14.299442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1888,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.429097+0000","last_change":"2024-04-25T09:12:15.242605+0000","last_active":"2024-04-25T09:30:13.429097+0000","last_peered":"2024-04-25T09:30:13.429097+0000","last_clean":"2024-04-25T09:30:13.429097+0000","last_became_active":"2024-04-25T09:12:15.236080+0000","last_became_peered":"2024-04-25T09:12:15.236080+0000","last_unstale":"2024-04-25T09:30:13.429097+0000","last_undegraded":"2024-04-25T09:30:13.429097+0000","last_fullsized":"2024-04-25T09:30:13.429097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1892,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.467499+0000","last_change":"2024-04-25T09:12:15.245278+0000","last_active":"2024-04-25T09:30:14.467499+0000","last_peered":"2024-04-25T09:30:14.467499+0000","last_clean":"2024-04-25T09:30:14.467499+0000","last_became_active":"2024-04-25T09:12:15.239643+0000","last_became_peered":"2024-04-25T09:12:15.239643+0000","last_unstale":"2024-04-25T09:30:14.467499+0000","last_undegraded":"2024-04-25T09:30:14.467499+0000","last_fullsized":"2024-04-25T09:30:14.467499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1888,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.433486+0000","last_change":"2024-04-25T09:12:15.247151+0000","last_active":"2024-04-25T09:30:13.433486+0000","last_peered":"2024-04-25T09:30:13.433486+0000","last_clean":"2024-04-25T09:30:13.433486+0000","last_became_active":"2024-04-25T09:12:15.241282+0000","last_became_peered":"2024-04-25T09:12:15.241282+0000","last_unstale":"2024-04-25T09:30:13.433486+0000","last_undegraded":"2024-04-25T09:30:13.433486+0000","last_fullsized":"2024-04-25T09:30:13.433486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1892,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.579268+0000","last_change":"2024-04-25T09:12:15.257926+0000","last_active":"2024-04-25T09:30:14.579268+0000","last_peered":"2024-04-25T09:30:14.579268+0000","last_clean":"2024-04-25T09:30:14.579268+0000","last_became_active":"2024-04-25T09:12:15.252630+0000","last_became_peered":"2024-04-25T09:12:15.252630+0000","last_unstale":"2024-04-25T09:30:14.579268+0000","last_undegraded":"2024-04-25T09:30:14.579268+0000","last_fullsized":"2024-04-25T09:30:14.579268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2010,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.332173+0000","last_change":"2024-04-25T09:12:12.208622+0000","last_active":"2024-04-25T09:30:14.332173+0000","last_peered":"2024-04-25T09:30:14.332173+0000","last_clean":"2024-04-25T09:30:14.332173+0000","last_became_active":"2024-04-25T09:12:12.203665+0000","last_became_peered":"2024-04-25T09:12:12.203665+0000","last_unstale":"2024-04-25T09:30:14.332173+0000","last_undegraded":"2024-04-25T09:30:14.332173+0000","last_fullsized":"2024-04-25T09:30:14.332173+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_clean_scrub_stamp":"2024-04-25T09:12:11.160311+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79588,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778012,"statfs":{"total":107374182400,"available":107292684288,"internally_reserved":0,"allocated":4157440,"data_stored":2027392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":74904,"kb_used_data":3536,"kb_used_omap":0,"kb_used_meta":71360,"kb_avail":104782696,"statfs":{"total":107374182400,"available":107297480704,"internally_reserved":0,"allocated":3620864,"data_stored":1461028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73072640},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":66552,"kb_used_data":3504,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104791048,"statfs":{"total":107374182400,"available":107306033152,"internally_reserved":0,"allocated":3588096,"data_stored":1452184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71312,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786288,"statfs":{"total":107374182400,"available":107301158912,"internally_reserved":0,"allocated":4202496,"data_stored":2055138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:46.581 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:46.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.704+0000 7f4d146ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:46.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.709+0000 7f4d146ad640 1 Processor -- start 2024-04-25T09:30:46.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.709+0000 7f4d146ad640 1 -- start start 2024-04-25T09:30:46.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.710+0000 7f4d146ad640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d0c0a01e0 0x7f4d0c138120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:46.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.710+0000 7f4d146ad640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c06dda0 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.710+0000 7f4d146ad640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0c06e2e0 con 0x7f4d0c0a01e0 2024-04-25T09:30:46.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.711+0000 7f4d11c48640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4d0c0a01e0 0x7f4d0c138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:46.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.711+0000 7f4d12449640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4d0c09f6c0 0x7f4d0c09fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46422/0 (socket says 172.21.15.53:46422) 2024-04-25T09:30:46.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.711+0000 7f4d12449640 1 -- 172.21.15.53:0/226319294 learned_addr learned my addr 172.21.15.53:0/226319294 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:46.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.711+0000 7f4d11c48640 1 -- 172.21.15.53:0/226319294 >> v1:172.21.15.53:6789/0 conn(0x7f4d0c09f6c0 legacy=0x7f4d0c09fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:46.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.711+0000 7f4d11c48640 1 -- 172.21.15.53:0/226319294 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c06d920 con 0x7f4d0c0a01e0 2024-04-25T09:30:46.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.711+0000 7f4d11c48640 1 --2- 172.21.15.53:0/226319294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c0a01e0 0x7f4d0c138120 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2ce5333c46ae6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:46.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.711+0000 7f4d11447640 1 -- 172.21.15.53:0/226319294 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d08009d90 con 0x7f4d0c0a01e0 2024-04-25T09:30:46.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.711+0000 7f4d11447640 1 -- 172.21.15.53:0/226319294 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d0800e230 con 0x7f4d0c0a01e0 2024-04-25T09:30:46.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.711+0000 7f4d11447640 1 -- 172.21.15.53:0/226319294 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d0800e4d0 con 0x7f4d0c0a01e0 2024-04-25T09:30:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.712+0000 7f4d146ad640 1 -- 172.21.15.53:0/226319294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c0a01e0 msgr2=0x7f4d0c138120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.712+0000 7f4d146ad640 1 --2- 172.21.15.53:0/226319294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c0a01e0 0x7f4d0c138120 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.712+0000 7f4d146ad640 1 -- 172.21.15.53:0/226319294 shutdown_connections 2024-04-25T09:30:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.712+0000 7f4d146ad640 1 --2- 172.21.15.53:0/226319294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c0a01e0 0x7f4d0c138120 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.712+0000 7f4d146ad640 1 -- 172.21.15.53:0/226319294 >> 172.21.15.53:0/226319294 conn(0x7f4d0c0a0950 msgr2=0x7f4d0c0a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.712+0000 7f4d146ad640 1 -- 172.21.15.53:0/226319294 shutdown_connections 2024-04-25T09:30:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.712+0000 7f4d146ad640 1 -- 172.21.15.53:0/226319294 wait complete. 2024-04-25T09:30:46.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.712+0000 7f4d146ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:46.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.714+0000 7f4d146ad640 1 Processor -- start 2024-04-25T09:30:46.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.714+0000 7f4d146ad640 1 -- start start 2024-04-25T09:30:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d146ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c09f6c0 0x7f4d0c1c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d146ad640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c09c640 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d12449640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c09f6c0 0x7f4d0c1c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d12449640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c09f6c0 0x7f4d0c1c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40708/0 (socket says 172.21.15.53:40708) 2024-04-25T09:30:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d12449640 1 -- 172.21.15.53:0/802334982 learned_addr learned my addr 172.21.15.53:0/802334982 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d12449640 1 -- 172.21.15.53:0/802334982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c1202e0 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d12449640 1 --2- 172.21.15.53:0/802334982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c09f6c0 0x7f4d0c1c9a90 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d02ffd640 1 -- 172.21.15.53:0/802334982 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cfc005a60 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d02ffd640 1 -- 172.21.15.53:0/802334982 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4cfc005bc0 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c1c9780 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d02ffd640 1 -- 172.21.15.53:0/802334982 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cfc005e60 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.716+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c121a00 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.718+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c063880 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.718+0000 7f4d02ffd640 1 -- 172.21.15.53:0/802334982 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4cfc00c780 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.718+0000 7f4d02ffd640 1 --2- 172.21.15.53:0/802334982 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4cf0038980 0x7f4cf003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:46.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.718+0000 7f4d02ffd640 1 -- 172.21.15.53:0/802334982 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 401..714) ==== 3403+0+0 (crc 0 0 0) 0x7f4cfc0484e0 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.718+0000 7f4d11c48640 1 --2- 172.21.15.53:0/802334982 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4cf0038980 0x7f4cf003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:46.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.719+0000 7f4d11c48640 1 --2- 172.21.15.53:0/802334982 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4cf0038980 0x7f4cf003ae90 crc :-1 s=READY pgs=3792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:46.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.723+0000 7f4d02ffd640 1 -- 172.21.15.53:0/802334982 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f4cfc00d330 con 0x7f4d0c09f6c0 2024-04-25T09:30:46.892 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.907+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d0c122040 con 0x7f4cf0038980 2024-04-25T09:30:46.895 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.911+0000 7f4d02ffd640 1 -- 172.21.15.53:0/802334982 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109148 (crc 0 0 0) 0x7f4d0c122040 con 0x7f4cf0038980 2024-04-25T09:30:46.896 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:30:46.897 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-25T09:30:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.913+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4cf0038980 msgr2=0x7f4cf003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.913+0000 7f4d146ad640 1 --2- 172.21.15.53:0/802334982 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4cf0038980 0x7f4cf003ae90 crc :-1 s=READY pgs=3792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.913+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c09f6c0 msgr2=0x7f4d0c1c9a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.913+0000 7f4d146ad640 1 --2- 172.21.15.53:0/802334982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c09f6c0 0x7f4d0c1c9a90 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.914+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 shutdown_connections 2024-04-25T09:30:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.914+0000 7f4d146ad640 1 --2- 172.21.15.53:0/802334982 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4cf0038980 0x7f4cf003ae90 unknown :-1 s=CLOSED pgs=3792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.914+0000 7f4d146ad640 1 --2- 172.21.15.53:0/802334982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d0c09f6c0 0x7f4d0c1c9a90 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.914+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 >> 172.21.15.53:0/802334982 conn(0x7f4d0c0a0950 msgr2=0x7f4d0c1bad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:46.899 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.914+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 shutdown_connections 2024-04-25T09:30:46.900 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:46.914+0000 7f4d146ad640 1 -- 172.21.15.53:0/802334982 wait complete. 2024-04-25T09:30:46.909 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":1265,"stamp":"2024-04-25T09:30:45.464607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":292356,"kb_used_data":15204,"kb_used_omap":0,"kb_used_meta":277120,"kb_avail":419138044,"statfs":{"total":429496729600,"available":429197357056,"internally_reserved":0,"allocated":15568896,"data_stored":6995742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":283770880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.066063"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.504584+0000","last_change":"2024-04-25T09:17:07.201124+0000","last_active":"2024-04-25T09:30:14.504584+0000","last_peered":"2024-04-25T09:30:14.504584+0000","last_clean":"2024-04-25T09:30:14.504584+0000","last_became_active":"2024-04-25T09:17:07.189673+0000","last_became_peered":"2024-04-25T09:17:07.189673+0000","last_unstale":"2024-04-25T09:30:14.504584+0000","last_undegraded":"2024-04-25T09:30:14.504584+0000","last_fullsized":"2024-04-25T09:30:14.504584+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.221909+0000","last_change":"2024-04-25T09:17:07.224428+0000","last_active":"2024-04-25T09:30:13.221909+0000","last_peered":"2024-04-25T09:30:13.221909+0000","last_clean":"2024-04-25T09:30:13.221909+0000","last_became_active":"2024-04-25T09:17:07.216422+0000","last_became_peered":"2024-04-25T09:17:07.216422+0000","last_unstale":"2024-04-25T09:30:13.221909+0000","last_undegraded":"2024-04-25T09:30:13.221909+0000","last_fullsized":"2024-04-25T09:30:13.221909+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.306825+0000","last_change":"2024-04-25T09:17:07.221368+0000","last_active":"2024-04-25T09:30:14.306825+0000","last_peered":"2024-04-25T09:30:14.306825+0000","last_clean":"2024-04-25T09:30:14.306825+0000","last_became_active":"2024-04-25T09:17:07.210105+0000","last_became_peered":"2024-04-25T09:17:07.210105+0000","last_unstale":"2024-04-25T09:30:14.306825+0000","last_undegraded":"2024-04-25T09:30:14.306825+0000","last_fullsized":"2024-04-25T09:30:14.306825+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.317729+0000","last_change":"2024-04-25T09:17:07.259390+0000","last_active":"2024-04-25T09:30:14.317729+0000","last_peered":"2024-04-25T09:30:14.317729+0000","last_clean":"2024-04-25T09:30:14.317729+0000","last_became_active":"2024-04-25T09:17:07.245112+0000","last_became_peered":"2024-04-25T09:17:07.245112+0000","last_unstale":"2024-04-25T09:30:14.317729+0000","last_undegraded":"2024-04-25T09:30:14.317729+0000","last_fullsized":"2024-04-25T09:30:14.317729+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.498167+0000","last_change":"2024-04-25T09:17:07.282257+0000","last_active":"2024-04-25T09:30:14.498167+0000","last_peered":"2024-04-25T09:30:14.498167+0000","last_clean":"2024-04-25T09:30:14.498167+0000","last_became_active":"2024-04-25T09:17:07.266007+0000","last_became_peered":"2024-04-25T09:17:07.266007+0000","last_unstale":"2024-04-25T09:30:14.498167+0000","last_undegraded":"2024-04-25T09:30:14.498167+0000","last_fullsized":"2024-04-25T09:30:14.498167+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.248562+0000","last_change":"2024-04-25T09:17:07.164825+0000","last_active":"2024-04-25T09:30:13.248562+0000","last_peered":"2024-04-25T09:30:13.248562+0000","last_clean":"2024-04-25T09:30:13.248562+0000","last_became_active":"2024-04-25T09:17:07.160621+0000","last_became_peered":"2024-04-25T09:17:07.160621+0000","last_unstale":"2024-04-25T09:30:13.248562+0000","last_undegraded":"2024-04-25T09:30:13.248562+0000","last_fullsized":"2024-04-25T09:30:13.248562+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.257208+0000","last_change":"2024-04-25T09:17:07.330453+0000","last_active":"2024-04-25T09:30:13.257208+0000","last_peered":"2024-04-25T09:30:13.257208+0000","last_clean":"2024-04-25T09:30:13.257208+0000","last_became_active":"2024-04-25T09:17:07.321872+0000","last_became_peered":"2024-04-25T09:17:07.321872+0000","last_unstale":"2024-04-25T09:30:13.257208+0000","last_undegraded":"2024-04-25T09:30:13.257208+0000","last_fullsized":"2024-04-25T09:30:13.257208+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.245474+0000","last_change":"2024-04-25T09:17:07.278297+0000","last_active":"2024-04-25T09:30:13.245474+0000","last_peered":"2024-04-25T09:30:13.245474+0000","last_clean":"2024-04-25T09:30:13.245474+0000","last_became_active":"2024-04-25T09:17:07.266913+0000","last_became_peered":"2024-04-25T09:17:07.266913+0000","last_unstale":"2024-04-25T09:30:13.245474+0000","last_undegraded":"2024-04-25T09:30:13.245474+0000","last_fullsized":"2024-04-25T09:30:13.245474+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.358596+0000","last_change":"2024-04-25T09:17:07.242083+0000","last_active":"2024-04-25T09:30:14.358596+0000","last_peered":"2024-04-25T09:30:14.358596+0000","last_clean":"2024-04-25T09:30:14.358596+0000","last_became_active":"2024-04-25T09:17:07.229886+0000","last_became_peered":"2024-04-25T09:17:07.229886+0000","last_unstale":"2024-04-25T09:30:14.358596+0000","last_undegraded":"2024-04-25T09:30:14.358596+0000","last_fullsized":"2024-04-25T09:30:14.358596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.308238+0000","last_change":"2024-04-25T09:17:07.206231+0000","last_active":"2024-04-25T09:30:14.308238+0000","last_peered":"2024-04-25T09:30:14.308238+0000","last_clean":"2024-04-25T09:30:14.308238+0000","last_became_active":"2024-04-25T09:17:07.191533+0000","last_became_peered":"2024-04-25T09:17:07.191533+0000","last_unstale":"2024-04-25T09:30:14.308238+0000","last_undegraded":"2024-04-25T09:30:14.308238+0000","last_fullsized":"2024-04-25T09:30:14.308238+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.329103+0000","last_change":"2024-04-25T09:17:07.266661+0000","last_active":"2024-04-25T09:30:14.329103+0000","last_peered":"2024-04-25T09:30:14.329103+0000","last_clean":"2024-04-25T09:30:14.329103+0000","last_became_active":"2024-04-25T09:17:07.251853+0000","last_became_peered":"2024-04-25T09:17:07.251853+0000","last_unstale":"2024-04-25T09:30:14.329103+0000","last_undegraded":"2024-04-25T09:30:14.329103+0000","last_fullsized":"2024-04-25T09:30:14.329103+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.251752+0000","last_change":"2024-04-25T09:17:07.345678+0000","last_active":"2024-04-25T09:30:13.251752+0000","last_peered":"2024-04-25T09:30:13.251752+0000","last_clean":"2024-04-25T09:30:13.251752+0000","last_became_active":"2024-04-25T09:17:07.337829+0000","last_became_peered":"2024-04-25T09:17:07.337829+0000","last_unstale":"2024-04-25T09:30:13.251752+0000","last_undegraded":"2024-04-25T09:30:13.251752+0000","last_fullsized":"2024-04-25T09:30:13.251752+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.339701+0000","last_change":"2024-04-25T09:17:07.285325+0000","last_active":"2024-04-25T09:30:14.339701+0000","last_peered":"2024-04-25T09:30:14.339701+0000","last_clean":"2024-04-25T09:30:14.339701+0000","last_became_active":"2024-04-25T09:17:07.279403+0000","last_became_peered":"2024-04-25T09:17:07.279403+0000","last_unstale":"2024-04-25T09:30:14.339701+0000","last_undegraded":"2024-04-25T09:30:14.339701+0000","last_fullsized":"2024-04-25T09:30:14.339701+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.342204+0000","last_change":"2024-04-25T09:17:07.319308+0000","last_active":"2024-04-25T09:30:14.342204+0000","last_peered":"2024-04-25T09:30:14.342204+0000","last_clean":"2024-04-25T09:30:14.342204+0000","last_became_active":"2024-04-25T09:17:07.313695+0000","last_became_peered":"2024-04-25T09:17:07.313695+0000","last_unstale":"2024-04-25T09:30:14.342204+0000","last_undegraded":"2024-04-25T09:30:14.342204+0000","last_fullsized":"2024-04-25T09:30:14.342204+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.423971+0000","last_change":"2024-04-25T09:17:07.361467+0000","last_active":"2024-04-25T09:30:13.423971+0000","last_peered":"2024-04-25T09:30:13.423971+0000","last_clean":"2024-04-25T09:30:13.423971+0000","last_became_active":"2024-04-25T09:17:07.356955+0000","last_became_peered":"2024-04-25T09:17:07.356955+0000","last_unstale":"2024-04-25T09:30:13.423971+0000","last_undegraded":"2024-04-25T09:30:13.423971+0000","last_fullsized":"2024-04-25T09:30:13.423971+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.218341+0000","last_change":"2024-04-25T09:17:07.285671+0000","last_active":"2024-04-25T09:30:13.218341+0000","last_peered":"2024-04-25T09:30:13.218341+0000","last_clean":"2024-04-25T09:30:13.218341+0000","last_became_active":"2024-04-25T09:17:07.273692+0000","last_became_peered":"2024-04-25T09:17:07.273692+0000","last_unstale":"2024-04-25T09:30:13.218341+0000","last_undegraded":"2024-04-25T09:30:13.218341+0000","last_fullsized":"2024-04-25T09:30:13.218341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.202405+0000","last_change":"2024-04-25T09:17:07.264380+0000","last_active":"2024-04-25T09:30:13.202405+0000","last_peered":"2024-04-25T09:30:13.202405+0000","last_clean":"2024-04-25T09:30:13.202405+0000","last_became_active":"2024-04-25T09:17:07.258228+0000","last_became_peered":"2024-04-25T09:17:07.258228+0000","last_unstale":"2024-04-25T09:30:13.202405+0000","last_undegraded":"2024-04-25T09:30:13.202405+0000","last_fullsized":"2024-04-25T09:30:13.202405+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.286465+0000","last_change":"2024-04-25T09:17:07.216743+0000","last_active":"2024-04-25T09:30:14.286465+0000","last_peered":"2024-04-25T09:30:14.286465+0000","last_clean":"2024-04-25T09:30:14.286465+0000","last_became_active":"2024-04-25T09:17:07.207791+0000","last_became_peered":"2024-04-25T09:17:07.207791+0000","last_unstale":"2024-04-25T09:30:14.286465+0000","last_undegraded":"2024-04-25T09:30:14.286465+0000","last_fullsized":"2024-04-25T09:30:14.286465+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.324802+0000","last_change":"2024-04-25T09:17:07.216193+0000","last_active":"2024-04-25T09:30:14.324802+0000","last_peered":"2024-04-25T09:30:14.324802+0000","last_clean":"2024-04-25T09:30:14.324802+0000","last_became_active":"2024-04-25T09:17:07.198934+0000","last_became_peered":"2024-04-25T09:17:07.198934+0000","last_unstale":"2024-04-25T09:30:14.324802+0000","last_undegraded":"2024-04-25T09:30:14.324802+0000","last_fullsized":"2024-04-25T09:30:14.324802+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.477465+0000","last_change":"2024-04-25T09:17:07.289029+0000","last_active":"2024-04-25T09:30:14.477465+0000","last_peered":"2024-04-25T09:30:14.477465+0000","last_clean":"2024-04-25T09:30:14.477465+0000","last_became_active":"2024-04-25T09:17:07.274194+0000","last_became_peered":"2024-04-25T09:17:07.274194+0000","last_unstale":"2024-04-25T09:30:14.477465+0000","last_undegraded":"2024-04-25T09:30:14.477465+0000","last_fullsized":"2024-04-25T09:30:14.477465+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.491389+0000","last_change":"2024-04-25T09:17:07.270278+0000","last_active":"2024-04-25T09:30:14.491389+0000","last_peered":"2024-04-25T09:30:14.491389+0000","last_clean":"2024-04-25T09:30:14.491389+0000","last_became_active":"2024-04-25T09:17:07.258040+0000","last_became_peered":"2024-04-25T09:17:07.258040+0000","last_unstale":"2024-04-25T09:30:14.491389+0000","last_undegraded":"2024-04-25T09:30:14.491389+0000","last_fullsized":"2024-04-25T09:30:14.491389+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.468241+0000","last_change":"2024-04-25T09:17:07.293534+0000","last_active":"2024-04-25T09:30:14.468241+0000","last_peered":"2024-04-25T09:30:14.468241+0000","last_clean":"2024-04-25T09:30:14.468241+0000","last_became_active":"2024-04-25T09:17:07.285972+0000","last_became_peered":"2024-04-25T09:17:07.285972+0000","last_unstale":"2024-04-25T09:30:14.468241+0000","last_undegraded":"2024-04-25T09:30:14.468241+0000","last_fullsized":"2024-04-25T09:30:14.468241+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.310165+0000","last_change":"2024-04-25T09:17:07.239436+0000","last_active":"2024-04-25T09:30:14.310165+0000","last_peered":"2024-04-25T09:30:14.310165+0000","last_clean":"2024-04-25T09:30:14.310165+0000","last_became_active":"2024-04-25T09:17:07.232151+0000","last_became_peered":"2024-04-25T09:17:07.232151+0000","last_unstale":"2024-04-25T09:30:14.310165+0000","last_undegraded":"2024-04-25T09:30:14.310165+0000","last_fullsized":"2024-04-25T09:30:14.310165+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.364726+0000","last_change":"2024-04-25T09:17:07.308904+0000","last_active":"2024-04-25T09:30:14.364726+0000","last_peered":"2024-04-25T09:30:14.364726+0000","last_clean":"2024-04-25T09:30:14.364726+0000","last_became_active":"2024-04-25T09:17:07.302869+0000","last_became_peered":"2024-04-25T09:17:07.302869+0000","last_unstale":"2024-04-25T09:30:14.364726+0000","last_undegraded":"2024-04-25T09:30:14.364726+0000","last_fullsized":"2024-04-25T09:30:14.364726+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.322859+0000","last_change":"2024-04-25T09:17:07.272067+0000","last_active":"2024-04-25T09:30:14.322859+0000","last_peered":"2024-04-25T09:30:14.322859+0000","last_clean":"2024-04-25T09:30:14.322859+0000","last_became_active":"2024-04-25T09:17:07.262656+0000","last_became_peered":"2024-04-25T09:17:07.262656+0000","last_unstale":"2024-04-25T09:30:14.322859+0000","last_undegraded":"2024-04-25T09:30:14.322859+0000","last_fullsized":"2024-04-25T09:30:14.322859+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.246669+0000","last_change":"2024-04-25T09:17:07.292436+0000","last_active":"2024-04-25T09:30:13.246669+0000","last_peered":"2024-04-25T09:30:13.246669+0000","last_clean":"2024-04-25T09:30:13.246669+0000","last_became_active":"2024-04-25T09:17:07.282946+0000","last_became_peered":"2024-04-25T09:17:07.282946+0000","last_unstale":"2024-04-25T09:30:13.246669+0000","last_undegraded":"2024-04-25T09:30:13.246669+0000","last_fullsized":"2024-04-25T09:30:13.246669+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.344452+0000","last_change":"2024-04-25T09:17:07.247974+0000","last_active":"2024-04-25T09:30:14.344452+0000","last_peered":"2024-04-25T09:30:14.344452+0000","last_clean":"2024-04-25T09:30:14.344452+0000","last_became_active":"2024-04-25T09:17:07.233194+0000","last_became_peered":"2024-04-25T09:17:07.233194+0000","last_unstale":"2024-04-25T09:30:14.344452+0000","last_undegraded":"2024-04-25T09:30:14.344452+0000","last_fullsized":"2024-04-25T09:30:14.344452+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.234244+0000","last_change":"2024-04-25T09:17:07.304053+0000","last_active":"2024-04-25T09:30:13.234244+0000","last_peered":"2024-04-25T09:30:13.234244+0000","last_clean":"2024-04-25T09:30:13.234244+0000","last_became_active":"2024-04-25T09:17:07.297538+0000","last_became_peered":"2024-04-25T09:17:07.297538+0000","last_unstale":"2024-04-25T09:30:13.234244+0000","last_undegraded":"2024-04-25T09:30:13.234244+0000","last_fullsized":"2024-04-25T09:30:13.234244+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.236582+0000","last_change":"2024-04-25T09:17:07.249279+0000","last_active":"2024-04-25T09:30:13.236582+0000","last_peered":"2024-04-25T09:30:13.236582+0000","last_clean":"2024-04-25T09:30:13.236582+0000","last_became_active":"2024-04-25T09:17:07.241694+0000","last_became_peered":"2024-04-25T09:17:07.241694+0000","last_unstale":"2024-04-25T09:30:13.236582+0000","last_undegraded":"2024-04-25T09:30:13.236582+0000","last_fullsized":"2024-04-25T09:30:13.236582+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.214403+0000","last_change":"2024-04-25T09:17:07.317393+0000","last_active":"2024-04-25T09:30:13.214403+0000","last_peered":"2024-04-25T09:30:13.214403+0000","last_clean":"2024-04-25T09:30:13.214403+0000","last_became_active":"2024-04-25T09:17:07.311173+0000","last_became_peered":"2024-04-25T09:17:07.311173+0000","last_unstale":"2024-04-25T09:30:13.214403+0000","last_undegraded":"2024-04-25T09:30:13.214403+0000","last_fullsized":"2024-04-25T09:30:13.214403+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1308,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.499421+0000","last_change":"2024-04-25T09:17:07.199203+0000","last_active":"2024-04-25T09:30:14.499421+0000","last_peered":"2024-04-25T09:30:14.499421+0000","last_clean":"2024-04-25T09:30:14.499421+0000","last_became_active":"2024-04-25T09:17:07.185148+0000","last_became_peered":"2024-04-25T09:17:07.185148+0000","last_unstale":"2024-04-25T09:30:14.499421+0000","last_undegraded":"2024-04-25T09:30:14.499421+0000","last_fullsized":"2024-04-25T09:30:14.499421+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.271785+0000","last_change":"2024-04-25T09:17:07.204194+0000","last_active":"2024-04-25T09:30:14.271785+0000","last_peered":"2024-04-25T09:30:14.271785+0000","last_clean":"2024-04-25T09:30:14.271785+0000","last_became_active":"2024-04-25T09:17:07.194953+0000","last_became_peered":"2024-04-25T09:17:07.194953+0000","last_unstale":"2024-04-25T09:30:14.271785+0000","last_undegraded":"2024-04-25T09:30:14.271785+0000","last_fullsized":"2024-04-25T09:30:14.271785+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1892,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.478600+0000","last_change":"2024-04-25T09:12:15.261642+0000","last_active":"2024-04-25T09:30:14.478600+0000","last_peered":"2024-04-25T09:30:14.478600+0000","last_clean":"2024-04-25T09:30:14.478600+0000","last_became_active":"2024-04-25T09:12:15.255284+0000","last_became_peered":"2024-04-25T09:12:15.255284+0000","last_unstale":"2024-04-25T09:30:14.478600+0000","last_undegraded":"2024-04-25T09:30:14.478600+0000","last_fullsized":"2024-04-25T09:30:14.478600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1886,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.399829+0000","last_change":"2024-04-25T09:12:15.237133+0000","last_active":"2024-04-25T09:30:14.399829+0000","last_peered":"2024-04-25T09:30:14.399829+0000","last_clean":"2024-04-25T09:30:14.399829+0000","last_became_active":"2024-04-25T09:12:15.231593+0000","last_became_peered":"2024-04-25T09:12:15.231593+0000","last_unstale":"2024-04-25T09:30:14.399829+0000","last_undegraded":"2024-04-25T09:30:14.399829+0000","last_fullsized":"2024-04-25T09:30:14.399829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1874,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.483111+0000","last_change":"2024-04-25T09:12:15.244463+0000","last_active":"2024-04-25T09:30:14.483111+0000","last_peered":"2024-04-25T09:30:14.483111+0000","last_clean":"2024-04-25T09:30:14.483111+0000","last_became_active":"2024-04-25T09:12:15.239187+0000","last_became_peered":"2024-04-25T09:12:15.239187+0000","last_unstale":"2024-04-25T09:30:14.483111+0000","last_undegraded":"2024-04-25T09:30:14.483111+0000","last_fullsized":"2024-04-25T09:30:14.483111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1886,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.299442+0000","last_change":"2024-04-25T09:12:15.226592+0000","last_active":"2024-04-25T09:30:14.299442+0000","last_peered":"2024-04-25T09:30:14.299442+0000","last_clean":"2024-04-25T09:30:14.299442+0000","last_became_active":"2024-04-25T09:12:15.221443+0000","last_became_peered":"2024-04-25T09:12:15.221443+0000","last_unstale":"2024-04-25T09:30:14.299442+0000","last_undegraded":"2024-04-25T09:30:14.299442+0000","last_fullsized":"2024-04-25T09:30:14.299442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1888,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.429097+0000","last_change":"2024-04-25T09:12:15.242605+0000","last_active":"2024-04-25T09:30:13.429097+0000","last_peered":"2024-04-25T09:30:13.429097+0000","last_clean":"2024-04-25T09:30:13.429097+0000","last_became_active":"2024-04-25T09:12:15.236080+0000","last_became_peered":"2024-04-25T09:12:15.236080+0000","last_unstale":"2024-04-25T09:30:13.429097+0000","last_undegraded":"2024-04-25T09:30:13.429097+0000","last_fullsized":"2024-04-25T09:30:13.429097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1892,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.467499+0000","last_change":"2024-04-25T09:12:15.245278+0000","last_active":"2024-04-25T09:30:14.467499+0000","last_peered":"2024-04-25T09:30:14.467499+0000","last_clean":"2024-04-25T09:30:14.467499+0000","last_became_active":"2024-04-25T09:12:15.239643+0000","last_became_peered":"2024-04-25T09:12:15.239643+0000","last_unstale":"2024-04-25T09:30:14.467499+0000","last_undegraded":"2024-04-25T09:30:14.467499+0000","last_fullsized":"2024-04-25T09:30:14.467499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1888,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.433486+0000","last_change":"2024-04-25T09:12:15.247151+0000","last_active":"2024-04-25T09:30:13.433486+0000","last_peered":"2024-04-25T09:30:13.433486+0000","last_clean":"2024-04-25T09:30:13.433486+0000","last_became_active":"2024-04-25T09:12:15.241282+0000","last_became_peered":"2024-04-25T09:12:15.241282+0000","last_unstale":"2024-04-25T09:30:13.433486+0000","last_undegraded":"2024-04-25T09:30:13.433486+0000","last_fullsized":"2024-04-25T09:30:13.433486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1892,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.579268+0000","last_change":"2024-04-25T09:12:15.257926+0000","last_active":"2024-04-25T09:30:14.579268+0000","last_peered":"2024-04-25T09:30:14.579268+0000","last_clean":"2024-04-25T09:30:14.579268+0000","last_became_active":"2024-04-25T09:12:15.252630+0000","last_became_peered":"2024-04-25T09:12:15.252630+0000","last_unstale":"2024-04-25T09:30:14.579268+0000","last_undegraded":"2024-04-25T09:30:14.579268+0000","last_fullsized":"2024-04-25T09:30:14.579268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2010,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.332173+0000","last_change":"2024-04-25T09:12:12.208622+0000","last_active":"2024-04-25T09:30:14.332173+0000","last_peered":"2024-04-25T09:30:14.332173+0000","last_clean":"2024-04-25T09:30:14.332173+0000","last_became_active":"2024-04-25T09:12:12.203665+0000","last_became_peered":"2024-04-25T09:12:12.203665+0000","last_unstale":"2024-04-25T09:30:14.332173+0000","last_undegraded":"2024-04-25T09:30:14.332173+0000","last_fullsized":"2024-04-25T09:30:14.332173+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_clean_scrub_stamp":"2024-04-25T09:12:11.160311+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79588,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778012,"statfs":{"total":107374182400,"available":107292684288,"internally_reserved":0,"allocated":4157440,"data_stored":2027392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":74904,"kb_used_data":3536,"kb_used_omap":0,"kb_used_meta":71360,"kb_avail":104782696,"statfs":{"total":107374182400,"available":107297480704,"internally_reserved":0,"allocated":3620864,"data_stored":1461028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73072640},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":66552,"kb_used_data":3504,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104791048,"statfs":{"total":107374182400,"available":107306033152,"internally_reserved":0,"allocated":3588096,"data_stored":1452184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71312,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786288,"statfs":{"total":107374182400,"available":107301158912,"internally_reserved":0,"allocated":4202496,"data_stored":2055138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:46.911 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:30:46.911 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:47.022 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.033+0000 7faf53e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:47.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.038+0000 7faf53e6d640 1 Processor -- start 2024-04-25T09:30:47.023 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.039+0000 7faf53e6d640 1 -- start start 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.040+0000 7faf53e6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faf4c138070 0x7faf4c13a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.040+0000 7faf53e6d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf4c134e00 con 0x7faf4c1351e0 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.040+0000 7faf53e6d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7faf4c135d00 con 0x7faf4c138070 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.040+0000 7faf51408640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7faf4c138070 0x7faf4c13a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.040+0000 7faf51c09640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7faf4c1351e0 0x7faf4c1355f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46430/0 (socket says 172.21.15.53:46430) 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.040+0000 7faf51c09640 1 -- 172.21.15.53:0/157500843 learned_addr learned my addr 172.21.15.53:0/157500843 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.041+0000 7faf51408640 1 -- 172.21.15.53:0/157500843 >> v1:172.21.15.53:6789/0 conn(0x7faf4c1351e0 legacy=0x7faf4c1355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.041+0000 7faf51408640 1 -- 172.21.15.53:0/157500843 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c09cb50 con 0x7faf4c138070 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.041+0000 7faf51408640 1 --2- 172.21.15.53:0/157500843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c138070 0x7faf4c13a490 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49ed4f89ce81381 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.041+0000 7faf50c07640 1 -- 172.21.15.53:0/157500843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faf40009d90 con 0x7faf4c138070 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.041+0000 7faf50c07640 1 -- 172.21.15.53:0/157500843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faf4000e230 con 0x7faf4c138070 2024-04-25T09:30:47.026 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.041+0000 7faf50c07640 1 -- 172.21.15.53:0/157500843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faf4000e4d0 con 0x7faf4c138070 2024-04-25T09:30:47.027 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.042+0000 7faf53e6d640 1 -- 172.21.15.53:0/157500843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c138070 msgr2=0x7faf4c13a490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:47.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.042+0000 7faf53e6d640 1 --2- 172.21.15.53:0/157500843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c138070 0x7faf4c13a490 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.042+0000 7faf53e6d640 1 -- 172.21.15.53:0/157500843 shutdown_connections 2024-04-25T09:30:47.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.042+0000 7faf53e6d640 1 --2- 172.21.15.53:0/157500843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c138070 0x7faf4c13a490 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.042+0000 7faf53e6d640 1 -- 172.21.15.53:0/157500843 >> 172.21.15.53:0/157500843 conn(0x7faf4c0a0950 msgr2=0x7faf4c0a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:47.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.042+0000 7faf53e6d640 1 -- 172.21.15.53:0/157500843 shutdown_connections 2024-04-25T09:30:47.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.042+0000 7faf53e6d640 1 -- 172.21.15.53:0/157500843 wait complete. 2024-04-25T09:30:47.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.042+0000 7faf53e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:47.028 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.044+0000 7faf53e6d640 1 Processor -- start 2024-04-25T09:30:47.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.044+0000 7faf53e6d640 1 -- start start 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.045+0000 7faf53e6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c1351e0 0x7faf4c11b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.045+0000 7faf53e6d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7faf4c11e9e0 con 0x7faf4c1351e0 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.045+0000 7faf51c09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c1351e0 0x7faf4c11b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.045+0000 7faf51c09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c1351e0 0x7faf4c11b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40728/0 (socket says 172.21.15.53:40728) 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.045+0000 7faf51c09640 1 -- 172.21.15.53:0/3002472393 learned_addr learned my addr 172.21.15.53:0/3002472393 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.046+0000 7faf51c09640 1 -- 172.21.15.53:0/3002472393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4c11b0b0 con 0x7faf4c1351e0 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.046+0000 7faf51c09640 1 --2- 172.21.15.53:0/3002472393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c1351e0 0x7faf4c11b440 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.046+0000 7faf4a7fc640 1 -- 172.21.15.53:0/3002472393 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faf44005a60 con 0x7faf4c1351e0 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.046+0000 7faf4a7fc640 1 -- 172.21.15.53:0/3002472393 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7faf44005bc0 con 0x7faf4c1351e0 2024-04-25T09:30:47.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.046+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4c11d280 con 0x7faf4c1351e0 2024-04-25T09:30:47.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.046+0000 7faf4a7fc640 1 -- 172.21.15.53:0/3002472393 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7faf44005e60 con 0x7faf4c1351e0 2024-04-25T09:30:47.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.046+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf4c11ce10 con 0x7faf4c1351e0 2024-04-25T09:30:47.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.047+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf4c11eb20 con 0x7faf4c1351e0 2024-04-25T09:30:47.032 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.047+0000 7faf4a7fc640 1 -- 172.21.15.53:0/3002472393 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7faf4400c780 con 0x7faf4c1351e0 2024-04-25T09:30:47.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.047+0000 7faf4a7fc640 1 --2- 172.21.15.53:0/3002472393 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7faf38038980 0x7faf3803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:47.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.047+0000 7faf4a7fc640 1 -- 172.21.15.53:0/3002472393 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 401..714) ==== 3403+0+0 (crc 0 0 0) 0x7faf44048460 con 0x7faf4c1351e0 2024-04-25T09:30:47.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.048+0000 7faf51408640 1 --2- 172.21.15.53:0/3002472393 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7faf38038980 0x7faf3803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:47.033 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.048+0000 7faf51408640 1 --2- 172.21.15.53:0/3002472393 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7faf38038980 0x7faf3803ae90 crc :-1 s=READY pgs=3793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:47.037 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.052+0000 7faf4a7fc640 1 -- 172.21.15.53:0/3002472393 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7faf4400d330 con 0x7faf4c1351e0 2024-04-25T09:30:47.221 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.236+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf4c11af40 con 0x7faf38038980 2024-04-25T09:30:47.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.241+0000 7faf4a7fc640 1 -- 172.21.15.53:0/3002472393 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109148 (crc 0 0 0) 0x7faf4c11af40 con 0x7faf38038980 2024-04-25T09:30:47.226 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:30:47.227 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-25T09:30:47.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7faf38038980 msgr2=0x7faf3803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:47.228 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 --2- 172.21.15.53:0/3002472393 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7faf38038980 0x7faf3803ae90 crc :-1 s=READY pgs=3793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c1351e0 msgr2=0x7faf4c11b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:47.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 --2- 172.21.15.53:0/3002472393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c1351e0 0x7faf4c11b440 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 shutdown_connections 2024-04-25T09:30:47.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 --2- 172.21.15.53:0/3002472393 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7faf38038980 0x7faf3803ae90 unknown :-1 s=CLOSED pgs=3793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 --2- 172.21.15.53:0/3002472393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf4c1351e0 0x7faf4c11b440 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 >> 172.21.15.53:0/3002472393 conn(0x7faf4c0a0950 msgr2=0x7faf4c1bd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:47.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 shutdown_connections 2024-04-25T09:30:47.229 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.243+0000 7faf53e6d640 1 -- 172.21.15.53:0/3002472393 wait complete. 2024-04-25T09:30:47.239 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":1265,"stamp":"2024-04-25T09:30:45.464607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":292356,"kb_used_data":15204,"kb_used_omap":0,"kb_used_meta":277120,"kb_avail":419138044,"statfs":{"total":429496729600,"available":429197357056,"internally_reserved":0,"allocated":15568896,"data_stored":6995742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":283770880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.066063"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.504584+0000","last_change":"2024-04-25T09:17:07.201124+0000","last_active":"2024-04-25T09:30:14.504584+0000","last_peered":"2024-04-25T09:30:14.504584+0000","last_clean":"2024-04-25T09:30:14.504584+0000","last_became_active":"2024-04-25T09:17:07.189673+0000","last_became_peered":"2024-04-25T09:17:07.189673+0000","last_unstale":"2024-04-25T09:30:14.504584+0000","last_undegraded":"2024-04-25T09:30:14.504584+0000","last_fullsized":"2024-04-25T09:30:14.504584+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.221909+0000","last_change":"2024-04-25T09:17:07.224428+0000","last_active":"2024-04-25T09:30:13.221909+0000","last_peered":"2024-04-25T09:30:13.221909+0000","last_clean":"2024-04-25T09:30:13.221909+0000","last_became_active":"2024-04-25T09:17:07.216422+0000","last_became_peered":"2024-04-25T09:17:07.216422+0000","last_unstale":"2024-04-25T09:30:13.221909+0000","last_undegraded":"2024-04-25T09:30:13.221909+0000","last_fullsized":"2024-04-25T09:30:13.221909+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.306825+0000","last_change":"2024-04-25T09:17:07.221368+0000","last_active":"2024-04-25T09:30:14.306825+0000","last_peered":"2024-04-25T09:30:14.306825+0000","last_clean":"2024-04-25T09:30:14.306825+0000","last_became_active":"2024-04-25T09:17:07.210105+0000","last_became_peered":"2024-04-25T09:17:07.210105+0000","last_unstale":"2024-04-25T09:30:14.306825+0000","last_undegraded":"2024-04-25T09:30:14.306825+0000","last_fullsized":"2024-04-25T09:30:14.306825+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.317729+0000","last_change":"2024-04-25T09:17:07.259390+0000","last_active":"2024-04-25T09:30:14.317729+0000","last_peered":"2024-04-25T09:30:14.317729+0000","last_clean":"2024-04-25T09:30:14.317729+0000","last_became_active":"2024-04-25T09:17:07.245112+0000","last_became_peered":"2024-04-25T09:17:07.245112+0000","last_unstale":"2024-04-25T09:30:14.317729+0000","last_undegraded":"2024-04-25T09:30:14.317729+0000","last_fullsized":"2024-04-25T09:30:14.317729+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.498167+0000","last_change":"2024-04-25T09:17:07.282257+0000","last_active":"2024-04-25T09:30:14.498167+0000","last_peered":"2024-04-25T09:30:14.498167+0000","last_clean":"2024-04-25T09:30:14.498167+0000","last_became_active":"2024-04-25T09:17:07.266007+0000","last_became_peered":"2024-04-25T09:17:07.266007+0000","last_unstale":"2024-04-25T09:30:14.498167+0000","last_undegraded":"2024-04-25T09:30:14.498167+0000","last_fullsized":"2024-04-25T09:30:14.498167+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.248562+0000","last_change":"2024-04-25T09:17:07.164825+0000","last_active":"2024-04-25T09:30:13.248562+0000","last_peered":"2024-04-25T09:30:13.248562+0000","last_clean":"2024-04-25T09:30:13.248562+0000","last_became_active":"2024-04-25T09:17:07.160621+0000","last_became_peered":"2024-04-25T09:17:07.160621+0000","last_unstale":"2024-04-25T09:30:13.248562+0000","last_undegraded":"2024-04-25T09:30:13.248562+0000","last_fullsized":"2024-04-25T09:30:13.248562+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.257208+0000","last_change":"2024-04-25T09:17:07.330453+0000","last_active":"2024-04-25T09:30:13.257208+0000","last_peered":"2024-04-25T09:30:13.257208+0000","last_clean":"2024-04-25T09:30:13.257208+0000","last_became_active":"2024-04-25T09:17:07.321872+0000","last_became_peered":"2024-04-25T09:17:07.321872+0000","last_unstale":"2024-04-25T09:30:13.257208+0000","last_undegraded":"2024-04-25T09:30:13.257208+0000","last_fullsized":"2024-04-25T09:30:13.257208+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.245474+0000","last_change":"2024-04-25T09:17:07.278297+0000","last_active":"2024-04-25T09:30:13.245474+0000","last_peered":"2024-04-25T09:30:13.245474+0000","last_clean":"2024-04-25T09:30:13.245474+0000","last_became_active":"2024-04-25T09:17:07.266913+0000","last_became_peered":"2024-04-25T09:17:07.266913+0000","last_unstale":"2024-04-25T09:30:13.245474+0000","last_undegraded":"2024-04-25T09:30:13.245474+0000","last_fullsized":"2024-04-25T09:30:13.245474+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.358596+0000","last_change":"2024-04-25T09:17:07.242083+0000","last_active":"2024-04-25T09:30:14.358596+0000","last_peered":"2024-04-25T09:30:14.358596+0000","last_clean":"2024-04-25T09:30:14.358596+0000","last_became_active":"2024-04-25T09:17:07.229886+0000","last_became_peered":"2024-04-25T09:17:07.229886+0000","last_unstale":"2024-04-25T09:30:14.358596+0000","last_undegraded":"2024-04-25T09:30:14.358596+0000","last_fullsized":"2024-04-25T09:30:14.358596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.308238+0000","last_change":"2024-04-25T09:17:07.206231+0000","last_active":"2024-04-25T09:30:14.308238+0000","last_peered":"2024-04-25T09:30:14.308238+0000","last_clean":"2024-04-25T09:30:14.308238+0000","last_became_active":"2024-04-25T09:17:07.191533+0000","last_became_peered":"2024-04-25T09:17:07.191533+0000","last_unstale":"2024-04-25T09:30:14.308238+0000","last_undegraded":"2024-04-25T09:30:14.308238+0000","last_fullsized":"2024-04-25T09:30:14.308238+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.329103+0000","last_change":"2024-04-25T09:17:07.266661+0000","last_active":"2024-04-25T09:30:14.329103+0000","last_peered":"2024-04-25T09:30:14.329103+0000","last_clean":"2024-04-25T09:30:14.329103+0000","last_became_active":"2024-04-25T09:17:07.251853+0000","last_became_peered":"2024-04-25T09:17:07.251853+0000","last_unstale":"2024-04-25T09:30:14.329103+0000","last_undegraded":"2024-04-25T09:30:14.329103+0000","last_fullsized":"2024-04-25T09:30:14.329103+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.251752+0000","last_change":"2024-04-25T09:17:07.345678+0000","last_active":"2024-04-25T09:30:13.251752+0000","last_peered":"2024-04-25T09:30:13.251752+0000","last_clean":"2024-04-25T09:30:13.251752+0000","last_became_active":"2024-04-25T09:17:07.337829+0000","last_became_peered":"2024-04-25T09:17:07.337829+0000","last_unstale":"2024-04-25T09:30:13.251752+0000","last_undegraded":"2024-04-25T09:30:13.251752+0000","last_fullsized":"2024-04-25T09:30:13.251752+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.339701+0000","last_change":"2024-04-25T09:17:07.285325+0000","last_active":"2024-04-25T09:30:14.339701+0000","last_peered":"2024-04-25T09:30:14.339701+0000","last_clean":"2024-04-25T09:30:14.339701+0000","last_became_active":"2024-04-25T09:17:07.279403+0000","last_became_peered":"2024-04-25T09:17:07.279403+0000","last_unstale":"2024-04-25T09:30:14.339701+0000","last_undegraded":"2024-04-25T09:30:14.339701+0000","last_fullsized":"2024-04-25T09:30:14.339701+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.342204+0000","last_change":"2024-04-25T09:17:07.319308+0000","last_active":"2024-04-25T09:30:14.342204+0000","last_peered":"2024-04-25T09:30:14.342204+0000","last_clean":"2024-04-25T09:30:14.342204+0000","last_became_active":"2024-04-25T09:17:07.313695+0000","last_became_peered":"2024-04-25T09:17:07.313695+0000","last_unstale":"2024-04-25T09:30:14.342204+0000","last_undegraded":"2024-04-25T09:30:14.342204+0000","last_fullsized":"2024-04-25T09:30:14.342204+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.423971+0000","last_change":"2024-04-25T09:17:07.361467+0000","last_active":"2024-04-25T09:30:13.423971+0000","last_peered":"2024-04-25T09:30:13.423971+0000","last_clean":"2024-04-25T09:30:13.423971+0000","last_became_active":"2024-04-25T09:17:07.356955+0000","last_became_peered":"2024-04-25T09:17:07.356955+0000","last_unstale":"2024-04-25T09:30:13.423971+0000","last_undegraded":"2024-04-25T09:30:13.423971+0000","last_fullsized":"2024-04-25T09:30:13.423971+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.218341+0000","last_change":"2024-04-25T09:17:07.285671+0000","last_active":"2024-04-25T09:30:13.218341+0000","last_peered":"2024-04-25T09:30:13.218341+0000","last_clean":"2024-04-25T09:30:13.218341+0000","last_became_active":"2024-04-25T09:17:07.273692+0000","last_became_peered":"2024-04-25T09:17:07.273692+0000","last_unstale":"2024-04-25T09:30:13.218341+0000","last_undegraded":"2024-04-25T09:30:13.218341+0000","last_fullsized":"2024-04-25T09:30:13.218341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.202405+0000","last_change":"2024-04-25T09:17:07.264380+0000","last_active":"2024-04-25T09:30:13.202405+0000","last_peered":"2024-04-25T09:30:13.202405+0000","last_clean":"2024-04-25T09:30:13.202405+0000","last_became_active":"2024-04-25T09:17:07.258228+0000","last_became_peered":"2024-04-25T09:17:07.258228+0000","last_unstale":"2024-04-25T09:30:13.202405+0000","last_undegraded":"2024-04-25T09:30:13.202405+0000","last_fullsized":"2024-04-25T09:30:13.202405+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.286465+0000","last_change":"2024-04-25T09:17:07.216743+0000","last_active":"2024-04-25T09:30:14.286465+0000","last_peered":"2024-04-25T09:30:14.286465+0000","last_clean":"2024-04-25T09:30:14.286465+0000","last_became_active":"2024-04-25T09:17:07.207791+0000","last_became_peered":"2024-04-25T09:17:07.207791+0000","last_unstale":"2024-04-25T09:30:14.286465+0000","last_undegraded":"2024-04-25T09:30:14.286465+0000","last_fullsized":"2024-04-25T09:30:14.286465+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.324802+0000","last_change":"2024-04-25T09:17:07.216193+0000","last_active":"2024-04-25T09:30:14.324802+0000","last_peered":"2024-04-25T09:30:14.324802+0000","last_clean":"2024-04-25T09:30:14.324802+0000","last_became_active":"2024-04-25T09:17:07.198934+0000","last_became_peered":"2024-04-25T09:17:07.198934+0000","last_unstale":"2024-04-25T09:30:14.324802+0000","last_undegraded":"2024-04-25T09:30:14.324802+0000","last_fullsized":"2024-04-25T09:30:14.324802+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.477465+0000","last_change":"2024-04-25T09:17:07.289029+0000","last_active":"2024-04-25T09:30:14.477465+0000","last_peered":"2024-04-25T09:30:14.477465+0000","last_clean":"2024-04-25T09:30:14.477465+0000","last_became_active":"2024-04-25T09:17:07.274194+0000","last_became_peered":"2024-04-25T09:17:07.274194+0000","last_unstale":"2024-04-25T09:30:14.477465+0000","last_undegraded":"2024-04-25T09:30:14.477465+0000","last_fullsized":"2024-04-25T09:30:14.477465+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.491389+0000","last_change":"2024-04-25T09:17:07.270278+0000","last_active":"2024-04-25T09:30:14.491389+0000","last_peered":"2024-04-25T09:30:14.491389+0000","last_clean":"2024-04-25T09:30:14.491389+0000","last_became_active":"2024-04-25T09:17:07.258040+0000","last_became_peered":"2024-04-25T09:17:07.258040+0000","last_unstale":"2024-04-25T09:30:14.491389+0000","last_undegraded":"2024-04-25T09:30:14.491389+0000","last_fullsized":"2024-04-25T09:30:14.491389+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1295,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.468241+0000","last_change":"2024-04-25T09:17:07.293534+0000","last_active":"2024-04-25T09:30:14.468241+0000","last_peered":"2024-04-25T09:30:14.468241+0000","last_clean":"2024-04-25T09:30:14.468241+0000","last_became_active":"2024-04-25T09:17:07.285972+0000","last_became_peered":"2024-04-25T09:17:07.285972+0000","last_unstale":"2024-04-25T09:30:14.468241+0000","last_undegraded":"2024-04-25T09:30:14.468241+0000","last_fullsized":"2024-04-25T09:30:14.468241+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.310165+0000","last_change":"2024-04-25T09:17:07.239436+0000","last_active":"2024-04-25T09:30:14.310165+0000","last_peered":"2024-04-25T09:30:14.310165+0000","last_clean":"2024-04-25T09:30:14.310165+0000","last_became_active":"2024-04-25T09:17:07.232151+0000","last_became_peered":"2024-04-25T09:17:07.232151+0000","last_unstale":"2024-04-25T09:30:14.310165+0000","last_undegraded":"2024-04-25T09:30:14.310165+0000","last_fullsized":"2024-04-25T09:30:14.310165+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.364726+0000","last_change":"2024-04-25T09:17:07.308904+0000","last_active":"2024-04-25T09:30:14.364726+0000","last_peered":"2024-04-25T09:30:14.364726+0000","last_clean":"2024-04-25T09:30:14.364726+0000","last_became_active":"2024-04-25T09:17:07.302869+0000","last_became_peered":"2024-04-25T09:17:07.302869+0000","last_unstale":"2024-04-25T09:30:14.364726+0000","last_undegraded":"2024-04-25T09:30:14.364726+0000","last_fullsized":"2024-04-25T09:30:14.364726+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.322859+0000","last_change":"2024-04-25T09:17:07.272067+0000","last_active":"2024-04-25T09:30:14.322859+0000","last_peered":"2024-04-25T09:30:14.322859+0000","last_clean":"2024-04-25T09:30:14.322859+0000","last_became_active":"2024-04-25T09:17:07.262656+0000","last_became_peered":"2024-04-25T09:17:07.262656+0000","last_unstale":"2024-04-25T09:30:14.322859+0000","last_undegraded":"2024-04-25T09:30:14.322859+0000","last_fullsized":"2024-04-25T09:30:14.322859+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.246669+0000","last_change":"2024-04-25T09:17:07.292436+0000","last_active":"2024-04-25T09:30:13.246669+0000","last_peered":"2024-04-25T09:30:13.246669+0000","last_clean":"2024-04-25T09:30:13.246669+0000","last_became_active":"2024-04-25T09:17:07.282946+0000","last_became_peered":"2024-04-25T09:17:07.282946+0000","last_unstale":"2024-04-25T09:30:13.246669+0000","last_undegraded":"2024-04-25T09:30:13.246669+0000","last_fullsized":"2024-04-25T09:30:13.246669+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1277,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.344452+0000","last_change":"2024-04-25T09:17:07.247974+0000","last_active":"2024-04-25T09:30:14.344452+0000","last_peered":"2024-04-25T09:30:14.344452+0000","last_clean":"2024-04-25T09:30:14.344452+0000","last_became_active":"2024-04-25T09:17:07.233194+0000","last_became_peered":"2024-04-25T09:17:07.233194+0000","last_unstale":"2024-04-25T09:30:14.344452+0000","last_undegraded":"2024-04-25T09:30:14.344452+0000","last_fullsized":"2024-04-25T09:30:14.344452+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.234244+0000","last_change":"2024-04-25T09:17:07.304053+0000","last_active":"2024-04-25T09:30:13.234244+0000","last_peered":"2024-04-25T09:30:13.234244+0000","last_clean":"2024-04-25T09:30:13.234244+0000","last_became_active":"2024-04-25T09:17:07.297538+0000","last_became_peered":"2024-04-25T09:17:07.297538+0000","last_unstale":"2024-04-25T09:30:13.234244+0000","last_undegraded":"2024-04-25T09:30:13.234244+0000","last_fullsized":"2024-04-25T09:30:13.234244+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.236582+0000","last_change":"2024-04-25T09:17:07.249279+0000","last_active":"2024-04-25T09:30:13.236582+0000","last_peered":"2024-04-25T09:30:13.236582+0000","last_clean":"2024-04-25T09:30:13.236582+0000","last_became_active":"2024-04-25T09:17:07.241694+0000","last_became_peered":"2024-04-25T09:17:07.241694+0000","last_unstale":"2024-04-25T09:30:13.236582+0000","last_undegraded":"2024-04-25T09:30:13.236582+0000","last_fullsized":"2024-04-25T09:30:13.236582+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1281,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.214403+0000","last_change":"2024-04-25T09:17:07.317393+0000","last_active":"2024-04-25T09:30:13.214403+0000","last_peered":"2024-04-25T09:30:13.214403+0000","last_clean":"2024-04-25T09:30:13.214403+0000","last_became_active":"2024-04-25T09:17:07.311173+0000","last_became_peered":"2024-04-25T09:17:07.311173+0000","last_unstale":"2024-04-25T09:30:13.214403+0000","last_undegraded":"2024-04-25T09:30:13.214403+0000","last_fullsized":"2024-04-25T09:30:13.214403+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1308,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.499421+0000","last_change":"2024-04-25T09:17:07.199203+0000","last_active":"2024-04-25T09:30:14.499421+0000","last_peered":"2024-04-25T09:30:14.499421+0000","last_clean":"2024-04-25T09:30:14.499421+0000","last_became_active":"2024-04-25T09:17:07.185148+0000","last_became_peered":"2024-04-25T09:17:07.185148+0000","last_unstale":"2024-04-25T09:30:14.499421+0000","last_undegraded":"2024-04-25T09:30:14.499421+0000","last_fullsized":"2024-04-25T09:30:14.499421+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1287,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.271785+0000","last_change":"2024-04-25T09:17:07.204194+0000","last_active":"2024-04-25T09:30:14.271785+0000","last_peered":"2024-04-25T09:30:14.271785+0000","last_clean":"2024-04-25T09:30:14.271785+0000","last_became_active":"2024-04-25T09:17:07.194953+0000","last_became_peered":"2024-04-25T09:17:07.194953+0000","last_unstale":"2024-04-25T09:30:14.271785+0000","last_undegraded":"2024-04-25T09:30:14.271785+0000","last_fullsized":"2024-04-25T09:30:14.271785+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1892,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.478600+0000","last_change":"2024-04-25T09:12:15.261642+0000","last_active":"2024-04-25T09:30:14.478600+0000","last_peered":"2024-04-25T09:30:14.478600+0000","last_clean":"2024-04-25T09:30:14.478600+0000","last_became_active":"2024-04-25T09:12:15.255284+0000","last_became_peered":"2024-04-25T09:12:15.255284+0000","last_unstale":"2024-04-25T09:30:14.478600+0000","last_undegraded":"2024-04-25T09:30:14.478600+0000","last_fullsized":"2024-04-25T09:30:14.478600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1886,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.399829+0000","last_change":"2024-04-25T09:12:15.237133+0000","last_active":"2024-04-25T09:30:14.399829+0000","last_peered":"2024-04-25T09:30:14.399829+0000","last_clean":"2024-04-25T09:30:14.399829+0000","last_became_active":"2024-04-25T09:12:15.231593+0000","last_became_peered":"2024-04-25T09:12:15.231593+0000","last_unstale":"2024-04-25T09:30:14.399829+0000","last_undegraded":"2024-04-25T09:30:14.399829+0000","last_fullsized":"2024-04-25T09:30:14.399829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1874,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.483111+0000","last_change":"2024-04-25T09:12:15.244463+0000","last_active":"2024-04-25T09:30:14.483111+0000","last_peered":"2024-04-25T09:30:14.483111+0000","last_clean":"2024-04-25T09:30:14.483111+0000","last_became_active":"2024-04-25T09:12:15.239187+0000","last_became_peered":"2024-04-25T09:12:15.239187+0000","last_unstale":"2024-04-25T09:30:14.483111+0000","last_undegraded":"2024-04-25T09:30:14.483111+0000","last_fullsized":"2024-04-25T09:30:14.483111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1886,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.299442+0000","last_change":"2024-04-25T09:12:15.226592+0000","last_active":"2024-04-25T09:30:14.299442+0000","last_peered":"2024-04-25T09:30:14.299442+0000","last_clean":"2024-04-25T09:30:14.299442+0000","last_became_active":"2024-04-25T09:12:15.221443+0000","last_became_peered":"2024-04-25T09:12:15.221443+0000","last_unstale":"2024-04-25T09:30:14.299442+0000","last_undegraded":"2024-04-25T09:30:14.299442+0000","last_fullsized":"2024-04-25T09:30:14.299442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1888,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.429097+0000","last_change":"2024-04-25T09:12:15.242605+0000","last_active":"2024-04-25T09:30:13.429097+0000","last_peered":"2024-04-25T09:30:13.429097+0000","last_clean":"2024-04-25T09:30:13.429097+0000","last_became_active":"2024-04-25T09:12:15.236080+0000","last_became_peered":"2024-04-25T09:12:15.236080+0000","last_unstale":"2024-04-25T09:30:13.429097+0000","last_undegraded":"2024-04-25T09:30:13.429097+0000","last_fullsized":"2024-04-25T09:30:13.429097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1892,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.467499+0000","last_change":"2024-04-25T09:12:15.245278+0000","last_active":"2024-04-25T09:30:14.467499+0000","last_peered":"2024-04-25T09:30:14.467499+0000","last_clean":"2024-04-25T09:30:14.467499+0000","last_became_active":"2024-04-25T09:12:15.239643+0000","last_became_peered":"2024-04-25T09:12:15.239643+0000","last_unstale":"2024-04-25T09:30:14.467499+0000","last_undegraded":"2024-04-25T09:30:14.467499+0000","last_fullsized":"2024-04-25T09:30:14.467499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1888,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:13.433486+0000","last_change":"2024-04-25T09:12:15.247151+0000","last_active":"2024-04-25T09:30:13.433486+0000","last_peered":"2024-04-25T09:30:13.433486+0000","last_clean":"2024-04-25T09:30:13.433486+0000","last_became_active":"2024-04-25T09:12:15.241282+0000","last_became_peered":"2024-04-25T09:12:15.241282+0000","last_unstale":"2024-04-25T09:30:13.433486+0000","last_undegraded":"2024-04-25T09:30:13.433486+0000","last_fullsized":"2024-04-25T09:30:13.433486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1892,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.579268+0000","last_change":"2024-04-25T09:12:15.257926+0000","last_active":"2024-04-25T09:30:14.579268+0000","last_peered":"2024-04-25T09:30:14.579268+0000","last_clean":"2024-04-25T09:30:14.579268+0000","last_became_active":"2024-04-25T09:12:15.252630+0000","last_became_peered":"2024-04-25T09:12:15.252630+0000","last_unstale":"2024-04-25T09:30:14.579268+0000","last_undegraded":"2024-04-25T09:30:14.579268+0000","last_fullsized":"2024-04-25T09:30:14.579268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2010,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.332173+0000","last_change":"2024-04-25T09:12:12.208622+0000","last_active":"2024-04-25T09:30:14.332173+0000","last_peered":"2024-04-25T09:30:14.332173+0000","last_clean":"2024-04-25T09:30:14.332173+0000","last_became_active":"2024-04-25T09:12:12.203665+0000","last_became_peered":"2024-04-25T09:12:12.203665+0000","last_unstale":"2024-04-25T09:30:14.332173+0000","last_undegraded":"2024-04-25T09:30:14.332173+0000","last_fullsized":"2024-04-25T09:30:14.332173+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_clean_scrub_stamp":"2024-04-25T09:12:11.160311+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79588,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778012,"statfs":{"total":107374182400,"available":107292684288,"internally_reserved":0,"allocated":4157440,"data_stored":2027392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":74904,"kb_used_data":3536,"kb_used_omap":0,"kb_used_meta":71360,"kb_avail":104782696,"statfs":{"total":107374182400,"available":107297480704,"internally_reserved":0,"allocated":3620864,"data_stored":1461028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":73072640},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":66552,"kb_used_data":3504,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104791048,"statfs":{"total":107374182400,"available":107306033152,"internally_reserved":0,"allocated":3588096,"data_stored":1452184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71312,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786288,"statfs":{"total":107374182400,"available":107301158912,"internally_reserved":0,"allocated":4202496,"data_stored":2055138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:47.241 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:30:47.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.363+0000 7fd25a80f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:47.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.368+0000 7fd25a80f640 1 Processor -- start 2024-04-25T09:30:47.353 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.368+0000 7fd25a80f640 1 -- start start 2024-04-25T09:30:47.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd25a80f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd25409f960 0x7fd25413a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:47.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd25a80f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25406f0b0 con 0x7fd25409ee40 2024-04-25T09:30:47.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd25a80f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd254073c50 con 0x7fd25409f960 2024-04-25T09:30:47.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd2537fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd25409f960 0x7fd25413a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:47.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd253fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd25409ee40 0x7fd25409f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46436/0 (socket says 172.21.15.53:46436) 2024-04-25T09:30:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd253fff640 1 -- 172.21.15.53:0/1592770927 learned_addr learned my addr 172.21.15.53:0/1592770927 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd252ffd640 1 -- 172.21.15.53:0/1592770927 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144581459 0 0) 0x7fd25406f0b0 con 0x7fd25409ee40 2024-04-25T09:30:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd252ffd640 1 -- 172.21.15.53:0/1592770927 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd23c003580 con 0x7fd25409ee40 2024-04-25T09:30:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd2537fe640 1 -- 172.21.15.53:0/1592770927 >> v1:172.21.15.53:6789/0 conn(0x7fd25409ee40 legacy=0x7fd25409f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd2537fe640 1 -- 172.21.15.53:0/1592770927 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2540a1120 con 0x7fd25409f960 2024-04-25T09:30:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd2537fe640 1 --2- 172.21.15.53:0/1592770927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409f960 0x7fd25413a090 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f39f6c5d00a6192 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd252ffd640 1 -- 172.21.15.53:0/1592770927 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd244009d90 con 0x7fd25409f960 2024-04-25T09:30:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd252ffd640 1 -- 172.21.15.53:0/1592770927 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd24400e230 con 0x7fd25409f960 2024-04-25T09:30:47.356 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.370+0000 7fd252ffd640 1 -- 172.21.15.53:0/1592770927 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd24400e4d0 con 0x7fd25409f960 2024-04-25T09:30:47.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.371+0000 7fd25a80f640 1 -- 172.21.15.53:0/1592770927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409f960 msgr2=0x7fd25413a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:47.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.371+0000 7fd25a80f640 1 --2- 172.21.15.53:0/1592770927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409f960 0x7fd25413a090 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.371+0000 7fd25a80f640 1 -- 172.21.15.53:0/1592770927 shutdown_connections 2024-04-25T09:30:47.357 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.371+0000 7fd25a80f640 1 --2- 172.21.15.53:0/1592770927 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409f960 0x7fd25413a090 unknown :-1 s=CLOSED pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.371+0000 7fd25a80f640 1 -- 172.21.15.53:0/1592770927 >> 172.21.15.53:0/1592770927 conn(0x7fd2540a3be0 msgr2=0x7fd2540a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.371+0000 7fd25a80f640 1 -- 172.21.15.53:0/1592770927 shutdown_connections 2024-04-25T09:30:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.371+0000 7fd25a80f640 1 -- 172.21.15.53:0/1592770927 wait complete. 2024-04-25T09:30:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.371+0000 7fd25a80f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.374+0000 7fd25a80f640 1 Processor -- start 2024-04-25T09:30:47.358 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.374+0000 7fd25a80f640 1 -- start start 2024-04-25T09:30:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.375+0000 7fd25a80f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409ee40 0x7fd2541c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.375+0000 7fd25a80f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd254120050 con 0x7fd25409ee40 2024-04-25T09:30:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd253fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409ee40 0x7fd2541c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd253fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409ee40 0x7fd2541c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40758/0 (socket says 172.21.15.53:40758) 2024-04-25T09:30:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd253fff640 1 -- 172.21.15.53:0/310605412 learned_addr learned my addr 172.21.15.53:0/310605412 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd253fff640 1 -- 172.21.15.53:0/310605412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25411fc80 con 0x7fd25409ee40 2024-04-25T09:30:47.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd253fff640 1 --2- 172.21.15.53:0/310605412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409ee40 0x7fd2541c6450 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd250ff9640 1 -- 172.21.15.53:0/310605412 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd248005a60 con 0x7fd25409ee40 2024-04-25T09:30:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd250ff9640 1 -- 172.21.15.53:0/310605412 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd248005bc0 con 0x7fd25409ee40 2024-04-25T09:30:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd250ff9640 1 -- 172.21.15.53:0/310605412 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd248005e60 con 0x7fd25409ee40 2024-04-25T09:30:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2541205a0 con 0x7fd25409ee40 2024-04-25T09:30:47.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.376+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd254121bf0 con 0x7fd25409ee40 2024-04-25T09:30:47.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.377+0000 7fd250ff9640 1 -- 172.21.15.53:0/310605412 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fd24800c7a0 con 0x7fd25409ee40 2024-04-25T09:30:47.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.377+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2541c6250 con 0x7fd25409ee40 2024-04-25T09:30:47.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.378+0000 7fd250ff9640 1 --2- 172.21.15.53:0/310605412 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd240038980 0x7fd24003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:47.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.378+0000 7fd250ff9640 1 -- 172.21.15.53:0/310605412 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 401..714) ==== 3403+0+0 (crc 0 0 0) 0x7fd248048480 con 0x7fd25409ee40 2024-04-25T09:30:47.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.378+0000 7fd2537fe640 1 --2- 172.21.15.53:0/310605412 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd240038980 0x7fd24003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:47.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.379+0000 7fd2537fe640 1 --2- 172.21.15.53:0/310605412 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd240038980 0x7fd24003ae90 crc :-1 s=READY pgs=3794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:47.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.383+0000 7fd250ff9640 1 -- 172.21.15.53:0/310605412 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fd24800d4d0 con 0x7fd25409ee40 2024-04-25T09:30:47.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.570+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd254063880 con 0x7fd25409ee40 2024-04-25T09:30:47.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.571+0000 7fd250ff9640 1 -- 172.21.15.53:0/310605412 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v714) ==== 74+0+11127 (crc 0 0 0) 0x7fd24800d4d0 con 0x7fd25409ee40 2024-04-25T09:30:47.556 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:30:47.556 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":714,"fsid":"12417946-fe70-462a-890a-9259fe1aeb83","created":"2024-04-25T09:12:02.900066+0000","modified":"2024-04-25T09:30:45.460797+0000","last_up_change":"2024-04-25T09:12:09.155255+0000","last_in_change":"2024-04-25T09:12:05.054144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":201,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:12:11.143000+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T09:12:13.273451+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-04-25T09:17:05.071714+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"238","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1f07b6c3-dbda-4185-b49a-db14623145f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6801","nonce":3778022725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3778022725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6803","nonce":3778022725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3778022725}]},"public_addr":"172.21.15.53:6801/3778022725","cluster_addr":"172.21.15.53:6802/3778022725","heartbeat_back_addr":"172.21.15.53:6803/3778022725","heartbeat_front_addr":"172.21.15.53:6806/3778022725","state":["exists","up"]},{"osd":1,"uuid":"b2fcfcb4-83c0-4dac-bb3f-2f82dc63d670","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6805","nonce":3736905990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3736905990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3736905990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6809","nonce":3736905990}]},"public_addr":"172.21.15.53:6805/3736905990","cluster_addr":"172.21.15.53:6804/3736905990","heartbeat_back_addr":"172.21.15.53:6808/3736905990","heartbeat_front_addr":"172.21.15.53:6809/3736905990","state":["exists","up"]},{"osd":2,"uuid":"71a08380-1b88-46bf-88ed-1d1f06dac230","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":3300556569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3300556569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6815","nonce":3300556569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":3300556569}]},"public_addr":"172.21.15.151:6805/3300556569","cluster_addr":"172.21.15.151:6804/3300556569","heartbeat_back_addr":"172.21.15.151:6815/3300556569","heartbeat_front_addr":"172.21.15.151:6816/3300556569","state":["exists","up"]},{"osd":3,"uuid":"a59b2717-6d15-45cd-acf1-73867afba713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":46311736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6807","nonce":46311736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":46311736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":46311736}]},"public_addr":"172.21.15.151:6806/46311736","cluster_addr":"172.21.15.151:6807/46311736","heartbeat_back_addr":"172.21.15.151:6818/46311736","heartbeat_front_addr":"172.21.15.151:6819/46311736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":4},{"begin":9,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":181,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":1}]},{"pool":184,"snaps":[{"begin":1,"length":2}]},{"pool":185,"snaps":[{"begin":3,"length":1}]},{"pool":188,"snaps":[{"begin":2,"length":2}]},{"pool":190,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:30:47.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd240038980 msgr2=0x7fd24003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:47.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 --2- 172.21.15.53:0/310605412 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd240038980 0x7fd24003ae90 crc :-1 s=READY pgs=3794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409ee40 msgr2=0x7fd2541c6450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:47.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 --2- 172.21.15.53:0/310605412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409ee40 0x7fd2541c6450 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 shutdown_connections 2024-04-25T09:30:47.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 --2- 172.21.15.53:0/310605412 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd240038980 0x7fd24003ae90 unknown :-1 s=CLOSED pgs=3794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 --2- 172.21.15.53:0/310605412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd25409ee40 0x7fd2541c6450 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:47.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 >> 172.21.15.53:0/310605412 conn(0x7fd2540a3be0 msgr2=0x7fd2541bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:47.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 shutdown_connections 2024-04-25T09:30:47.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:47.573+0000 7fd25a80f640 1 -- 172.21.15.53:0/310605412 wait complete. 2024-04-25T09:30:48.570 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T09:30:48.570 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:30:48.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.706+0000 7f3f79464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.715+0000 7f3f79464640 1 Processor -- start 2024-04-25T09:30:48.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.715+0000 7f3f79464640 1 -- start start 2024-04-25T09:30:48.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.717+0000 7f3f79464640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f74135760 0x7f3f7413a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.717+0000 7f3f79464640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7406e820 con 0x7f3f74134c40 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.717+0000 7f3f79464640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3f7406d870 con 0x7f3f74135760 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.717+0000 7f3f727fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3f74135760 0x7f3f7413a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.717+0000 7f3f72ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3f74134c40 0x7f3f74135050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46450/0 (socket says 172.21.15.53:46450) 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.717+0000 7f3f72ffd640 1 -- 172.21.15.53:0/3379780334 learned_addr learned my addr 172.21.15.53:0/3379780334 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.717+0000 7f3f727fc640 1 -- 172.21.15.53:0/3379780334 >> v1:172.21.15.53:6789/0 conn(0x7f3f74134c40 legacy=0x7f3f74135050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.718+0000 7f3f727fc640 1 -- 172.21.15.53:0/3379780334 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7406f440 con 0x7f3f74135760 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.718+0000 7f3f727fc640 1 --2- 172.21.15.53:0/3379780334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74135760 0x7f3f7413a170 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa42824d5feb25be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.718+0000 7f3f71ffb640 1 -- 172.21.15.53:0/3379780334 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f68009d90 con 0x7f3f74135760 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.718+0000 7f3f71ffb640 1 -- 172.21.15.53:0/3379780334 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3f6800e230 con 0x7f3f74135760 2024-04-25T09:30:48.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.718+0000 7f3f71ffb640 1 -- 172.21.15.53:0/3379780334 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f6800e4d0 con 0x7f3f74135760 2024-04-25T09:30:48.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.719+0000 7f3f79464640 1 -- 172.21.15.53:0/3379780334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74135760 msgr2=0x7f3f7413a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:48.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.719+0000 7f3f79464640 1 --2- 172.21.15.53:0/3379780334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74135760 0x7f3f7413a170 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.719+0000 7f3f79464640 1 -- 172.21.15.53:0/3379780334 shutdown_connections 2024-04-25T09:30:48.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.719+0000 7f3f79464640 1 --2- 172.21.15.53:0/3379780334 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74135760 0x7f3f7413a170 unknown :-1 s=CLOSED pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.719+0000 7f3f79464640 1 -- 172.21.15.53:0/3379780334 >> 172.21.15.53:0/3379780334 conn(0x7f3f740a5da0 msgr2=0x7f3f740a61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.719+0000 7f3f79464640 1 -- 172.21.15.53:0/3379780334 shutdown_connections 2024-04-25T09:30:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.719+0000 7f3f79464640 1 -- 172.21.15.53:0/3379780334 wait complete. 2024-04-25T09:30:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.719+0000 7f3f79464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.721+0000 7f3f79464640 1 Processor -- start 2024-04-25T09:30:48.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.721+0000 7f3f79464640 1 -- start start 2024-04-25T09:30:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.722+0000 7f3f79464640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74134c40 0x7f3f741c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.722+0000 7f3f79464640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3f74121170 con 0x7f3f74134c40 2024-04-25T09:30:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74134c40 0x7f3f741c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f72ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74134c40 0x7f3f741c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40774/0 (socket says 172.21.15.53:40774) 2024-04-25T09:30:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f72ffd640 1 -- 172.21.15.53:0/1880740255 learned_addr learned my addr 172.21.15.53:0/1880740255 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f72ffd640 1 -- 172.21.15.53:0/1880740255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f74074f80 con 0x7f3f74134c40 2024-04-25T09:30:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f72ffd640 1 --2- 172.21.15.53:0/1880740255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74134c40 0x7f3f741c63e0 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:48.708 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f5b7fe640 1 -- 172.21.15.53:0/1880740255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f640070b0 con 0x7f3f74134c40 2024-04-25T09:30:48.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f5b7fe640 1 -- 172.21.15.53:0/1880740255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3f64007210 con 0x7f3f74134c40 2024-04-25T09:30:48.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f741c6080 con 0x7f3f74134c40 2024-04-25T09:30:48.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f5b7fe640 1 -- 172.21.15.53:0/1880740255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3f64007380 con 0x7f3f74134c40 2024-04-25T09:30:48.709 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.723+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7411fd10 con 0x7f3f74134c40 2024-04-25T09:30:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.724+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f740a6b20 con 0x7f3f74134c40 2024-04-25T09:30:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.724+0000 7f3f5b7fe640 1 -- 172.21.15.53:0/1880740255 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f3f64007530 con 0x7f3f74134c40 2024-04-25T09:30:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.724+0000 7f3f5b7fe640 1 --2- 172.21.15.53:0/1880740255 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3f60038980 0x7f3f6003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.724+0000 7f3f5b7fe640 1 -- 172.21.15.53:0/1880740255 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7f3f64048c40 con 0x7f3f74134c40 2024-04-25T09:30:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.725+0000 7f3f5b7fe640 1 --2- 172.21.15.53:0/1880740255 >> v2:172.21.15.53:6801/3778022725 conn(0x7f3f6003eaa0 0x7f3f60040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:48.710 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.725+0000 7f3f5b7fe640 1 -- 172.21.15.53:0/1880740255 --> v2:172.21.15.53:6801/3778022725 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f60041620 con 0x7f3f6003eaa0 2024-04-25T09:30:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.725+0000 7f3f5b7fe640 1 -- 172.21.15.53:0/1880740255 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7f3f6404b0b0 con 0x7f3f74134c40 2024-04-25T09:30:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.725+0000 7f3f727fc640 1 --2- 172.21.15.53:0/1880740255 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3f60038980 0x7f3f6003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.725+0000 7f3f737fe640 1 --2- 172.21.15.53:0/1880740255 >> v2:172.21.15.53:6801/3778022725 conn(0x7f3f6003eaa0 0x7f3f60040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:30:48.711 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.725+0000 7f3f727fc640 1 --2- 172.21.15.53:0/1880740255 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3f60038980 0x7f3f6003ae90 crc :-1 s=READY pgs=3795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:48.712 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.728+0000 7f3f737fe640 1 --2- 172.21.15.53:0/1880740255 >> v2:172.21.15.53:6801/3778022725 conn(0x7f3f6003eaa0 0x7f3f60040f90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:48.713 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.729+0000 7f3f5b7fe640 1 -- 172.21.15.53:0/1880740255 <== osd.0 v2:172.21.15.53:6801/3778022725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f3f60041620 con 0x7f3f6003eaa0 2024-04-25T09:30:48.717 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.732+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 --> v2:172.21.15.53:6801/3778022725 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3f74074f80 con 0x7f3f6003eaa0 2024-04-25T09:30:48.718 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.734+0000 7f3f5b7fe640 1 -- 172.21.15.53:0/1880740255 <== osd.0 v2:172.21.15.53:6801/3778022725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f3f74074f80 con 0x7f3f6003eaa0 2024-04-25T09:30:48.718 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-25T09:30:48.719 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "" 2024-04-25T09:30:48.719 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.734+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 >> v2:172.21.15.53:6801/3778022725 conn(0x7f3f6003eaa0 msgr2=0x7f3f60040f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.734+0000 7f3f79464640 1 --2- 172.21.15.53:0/1880740255 >> v2:172.21.15.53:6801/3778022725 conn(0x7f3f6003eaa0 0x7f3f60040f90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3f60038980 msgr2=0x7f3f6003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 --2- 172.21.15.53:0/1880740255 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3f60038980 0x7f3f6003ae90 crc :-1 s=READY pgs=3795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74134c40 msgr2=0x7f3f741c63e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 --2- 172.21.15.53:0/1880740255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74134c40 0x7f3f741c63e0 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 shutdown_connections 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 --2- 172.21.15.53:0/1880740255 >> v2:172.21.15.53:6801/3778022725 conn(0x7f3f6003eaa0 0x7f3f60040f90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 --2- 172.21.15.53:0/1880740255 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f3f60038980 0x7f3f6003ae90 unknown :-1 s=CLOSED pgs=3795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.720 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 --2- 172.21.15.53:0/1880740255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f74134c40 0x7f3f741c63e0 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 >> 172.21.15.53:0/1880740255 conn(0x7f3f740a5da0 msgr2=0x7f3f741bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:48.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 shutdown_connections 2024-04-25T09:30:48.721 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.735+0000 7f3f79464640 1 -- 172.21.15.53:0/1880740255 wait complete. 2024-04-25T09:30:48.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T09:30:48.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.853+0000 7f6ca8806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.860+0000 7f6ca8806640 1 Processor -- start 2024-04-25T09:30:48.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.860+0000 7f6ca8806640 1 -- start start 2024-04-25T09:30:48.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.861+0000 7f6ca8806640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ca40a01e0 0x7f6ca4137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:48.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.861+0000 7f6ca8806640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca4070d80 con 0x7f6ca409f6c0 2024-04-25T09:30:48.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.861+0000 7f6ca8806640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca40717b0 con 0x7f6ca40a01e0 2024-04-25T09:30:48.847 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.861+0000 7f6ca1d9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6ca40a01e0 0x7f6ca4137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:48.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.861+0000 7f6ca259c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6ca409f6c0 0x7f6ca409fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46462/0 (socket says 172.21.15.53:46462) 2024-04-25T09:30:48.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.861+0000 7f6ca259c640 1 -- 172.21.15.53:0/387711690 learned_addr learned my addr 172.21.15.53:0/387711690 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:48.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.862+0000 7f6ca1d9b640 1 -- 172.21.15.53:0/387711690 >> v1:172.21.15.53:6789/0 conn(0x7f6ca409f6c0 legacy=0x7f6ca409fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:48.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.862+0000 7f6ca1d9b640 1 -- 172.21.15.53:0/387711690 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca4072330 con 0x7f6ca40a01e0 2024-04-25T09:30:48.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.862+0000 7f6ca1d9b640 1 --2- 172.21.15.53:0/387711690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca40a01e0 0x7f6ca4137c40 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9935782325f14d76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:48.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.862+0000 7f6ca159a640 1 -- 172.21.15.53:0/387711690 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6c8c009d90 con 0x7f6ca40a01e0 2024-04-25T09:30:48.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.862+0000 7f6ca159a640 1 -- 172.21.15.53:0/387711690 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6c8c00e230 con 0x7f6ca40a01e0 2024-04-25T09:30:48.848 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.862+0000 7f6ca159a640 1 -- 172.21.15.53:0/387711690 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6c8c00e4d0 con 0x7f6ca40a01e0 2024-04-25T09:30:48.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.863+0000 7f6ca8806640 1 -- 172.21.15.53:0/387711690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca40a01e0 msgr2=0x7f6ca4137c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:48.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.863+0000 7f6ca8806640 1 --2- 172.21.15.53:0/387711690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca40a01e0 0x7f6ca4137c40 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.863+0000 7f6ca8806640 1 -- 172.21.15.53:0/387711690 shutdown_connections 2024-04-25T09:30:48.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.863+0000 7f6ca8806640 1 --2- 172.21.15.53:0/387711690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca40a01e0 0x7f6ca4137c40 unknown :-1 s=CLOSED pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:48.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.863+0000 7f6ca8806640 1 -- 172.21.15.53:0/387711690 >> 172.21.15.53:0/387711690 conn(0x7f6ca40a1960 msgr2=0x7f6ca40a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:48.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.863+0000 7f6ca8806640 1 -- 172.21.15.53:0/387711690 shutdown_connections 2024-04-25T09:30:48.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.863+0000 7f6ca8806640 1 -- 172.21.15.53:0/387711690 wait complete. 2024-04-25T09:30:48.849 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.863+0000 7f6ca8806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.865+0000 7f6ca8806640 1 Processor -- start 2024-04-25T09:30:48.850 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.865+0000 7f6ca8806640 1 -- start start 2024-04-25T09:30:48.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6ca8806640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca409f6c0 0x7f6ca411be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:48.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6ca8806640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca411f280 con 0x7f6ca409f6c0 2024-04-25T09:30:48.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6ca259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca409f6c0 0x7f6ca411be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:48.852 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6ca259c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca409f6c0 0x7f6ca411be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40796/0 (socket says 172.21.15.53:40796) 2024-04-25T09:30:48.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6ca259c640 1 -- 172.21.15.53:0/1949053822 learned_addr learned my addr 172.21.15.53:0/1949053822 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:48.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6ca259c640 1 -- 172.21.15.53:0/1949053822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca4076860 con 0x7f6ca409f6c0 2024-04-25T09:30:48.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6ca259c640 1 --2- 172.21.15.53:0/1949053822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca409f6c0 0x7f6ca411be00 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:48.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6c9affd640 1 -- 172.21.15.53:0/1949053822 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6c940070b0 con 0x7f6ca409f6c0 2024-04-25T09:30:48.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca411ef90 con 0x7f6ca409f6c0 2024-04-25T09:30:48.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6c9affd640 1 -- 172.21.15.53:0/1949053822 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6c94007210 con 0x7f6ca409f6c0 2024-04-25T09:30:48.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6c9affd640 1 -- 172.21.15.53:0/1949053822 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6c940074b0 con 0x7f6ca409f6c0 2024-04-25T09:30:48.853 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.867+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca41302f0 con 0x7f6ca409f6c0 2024-04-25T09:30:48.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.868+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca40692b0 con 0x7f6ca409f6c0 2024-04-25T09:30:48.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.868+0000 7f6c9affd640 1 -- 172.21.15.53:0/1949053822 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f6c940076f0 con 0x7f6ca409f6c0 2024-04-25T09:30:48.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.869+0000 7f6c9affd640 1 --2- 172.21.15.53:0/1949053822 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6c84038930 0x7f6c8403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:48.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.869+0000 7f6c9affd640 1 -- 172.21.15.53:0/1949053822 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7f6c94048cf0 con 0x7f6ca409f6c0 2024-04-25T09:30:48.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.869+0000 7f6ca1d9b640 1 --2- 172.21.15.53:0/1949053822 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6c84038930 0x7f6c8403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:48.854 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.870+0000 7f6ca1d9b640 1 --2- 172.21.15.53:0/1949053822 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6c84038930 0x7f6c8403ae40 crc :-1 s=READY pgs=3796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:48.858 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:48.874+0000 7f6c9affd640 1 -- 172.21.15.53:0/1949053822 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f6c940092e0 con 0x7f6ca409f6c0 2024-04-25T09:30:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.062+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f6ca4076860 con 0x7f6c84038930 2024-04-25T09:30:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.063+0000 7f6c9affd640 1 -- 172.21.15.53:0/1949053822 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f6ca4076860 con 0x7f6c84038930 2024-04-25T09:30:49.048 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T09:30:49.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.066+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6c84038930 msgr2=0x7f6c8403ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.066+0000 7f6ca8806640 1 --2- 172.21.15.53:0/1949053822 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6c84038930 0x7f6c8403ae40 crc :-1 s=READY pgs=3796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.066+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca409f6c0 msgr2=0x7f6ca411be00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.066+0000 7f6ca8806640 1 --2- 172.21.15.53:0/1949053822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca409f6c0 0x7f6ca411be00 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.067+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 shutdown_connections 2024-04-25T09:30:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.067+0000 7f6ca8806640 1 --2- 172.21.15.53:0/1949053822 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f6c84038930 0x7f6c8403ae40 unknown :-1 s=CLOSED pgs=3796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.067+0000 7f6ca8806640 1 --2- 172.21.15.53:0/1949053822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6ca409f6c0 0x7f6ca411be00 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.067+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 >> 172.21.15.53:0/1949053822 conn(0x7f6ca40a1960 msgr2=0x7f6ca41bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.067+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 shutdown_connections 2024-04-25T09:30:49.052 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.067+0000 7f6ca8806640 1 -- 172.21.15.53:0/1949053822 wait complete. 2024-04-25T09:30:49.070 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T09:30:49.070 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:30:49.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.200+0000 7fdcb0d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.209+0000 7fdcb0d9d640 1 Processor -- start 2024-04-25T09:30:49.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.209+0000 7fdcb0d9d640 1 -- start start 2024-04-25T09:30:49.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.211+0000 7fdcb0d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdcac12f880 0x7fdcac12fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.211+0000 7fdcb0d9d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcac06ece0 con 0x7fdcac06d8b0 2024-04-25T09:30:49.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.211+0000 7fdcb0d9d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdcac12f430 con 0x7fdcac12f880 2024-04-25T09:30:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.211+0000 7fdca9d9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdcac06d8b0 0x7fdcac06dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46464/0 (socket says 172.21.15.53:46464) 2024-04-25T09:30:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.211+0000 7fdcaa59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdcac12f880 0x7fdcac12fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.211+0000 7fdca9d9b640 1 -- 172.21.15.53:0/3265100448 learned_addr learned my addr 172.21.15.53:0/3265100448 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.211+0000 7fdcaa59c640 1 -- 172.21.15.53:0/3265100448 >> v1:172.21.15.53:6789/0 conn(0x7fdcac06d8b0 legacy=0x7fdcac06dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.211+0000 7fdcaa59c640 1 -- 172.21.15.53:0/3265100448 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac06e9e0 con 0x7fdcac12f880 2024-04-25T09:30:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.212+0000 7fdcaa59c640 1 --2- 172.21.15.53:0/3265100448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac12f880 0x7fdcac12fc90 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880187bd98e98c54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.212+0000 7fdca959a640 1 -- 172.21.15.53:0/3265100448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc9c009d90 con 0x7fdcac12f880 2024-04-25T09:30:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.212+0000 7fdca959a640 1 -- 172.21.15.53:0/3265100448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc9c00e230 con 0x7fdcac12f880 2024-04-25T09:30:49.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.212+0000 7fdca959a640 1 -- 172.21.15.53:0/3265100448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc9c00e4d0 con 0x7fdcac12f880 2024-04-25T09:30:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.212+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/3265100448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac12f880 msgr2=0x7fdcac12fc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.212+0000 7fdcb0d9d640 1 --2- 172.21.15.53:0/3265100448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac12f880 0x7fdcac12fc90 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.213+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/3265100448 shutdown_connections 2024-04-25T09:30:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.213+0000 7fdcb0d9d640 1 --2- 172.21.15.53:0/3265100448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac12f880 0x7fdcac12fc90 unknown :-1 s=CLOSED pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.213+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/3265100448 >> 172.21.15.53:0/3265100448 conn(0x7fdcac0a1e50 msgr2=0x7fdcac0a2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:49.198 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.213+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/3265100448 shutdown_connections 2024-04-25T09:30:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.213+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/3265100448 wait complete. 2024-04-25T09:30:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.213+0000 7fdcb0d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.215+0000 7fdcb0d9d640 1 Processor -- start 2024-04-25T09:30:49.199 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.215+0000 7fdcb0d9d640 1 -- start start 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.216+0000 7fdcb0d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac06d8b0 0x7fdcac09ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.216+0000 7fdcb0d9d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac09bdb0 con 0x7fdcac06d8b0 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.216+0000 7fdcaa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac06d8b0 0x7fdcac09ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.216+0000 7fdcaa59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac06d8b0 0x7fdcac09ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40806/0 (socket says 172.21.15.53:40806) 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.216+0000 7fdcaa59c640 1 -- 172.21.15.53:0/1976763382 learned_addr learned my addr 172.21.15.53:0/1976763382 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.217+0000 7fdcaa59c640 1 -- 172.21.15.53:0/1976763382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac09c960 con 0x7fdcac06d8b0 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.217+0000 7fdcaa59c640 1 --2- 172.21.15.53:0/1976763382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac06d8b0 0x7fdcac09ad00 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.217+0000 7fdc9affd640 1 -- 172.21.15.53:0/1976763382 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc9c014620 con 0x7fdcac06d8b0 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.217+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcac1210d0 con 0x7fdcac06d8b0 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.217+0000 7fdc9affd640 1 -- 172.21.15.53:0/1976763382 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc9c014780 con 0x7fdcac06d8b0 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.217+0000 7fdc9affd640 1 -- 172.21.15.53:0/1976763382 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc9c014a20 con 0x7fdcac06d8b0 2024-04-25T09:30:49.202 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.217+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcac12f050 con 0x7fdcac06d8b0 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.218+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdcac09d1f0 con 0x7fdcac06d8b0 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.218+0000 7fdc9affd640 1 -- 172.21.15.53:0/1976763382 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fdc9c014c20 con 0x7fdcac06d8b0 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.218+0000 7fdc9affd640 1 --2- 172.21.15.53:0/1976763382 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc8c038930 0x7fdc8c03ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.218+0000 7fdc9affd640 1 -- 172.21.15.53:0/1976763382 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7fdc9c019040 con 0x7fdcac06d8b0 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.218+0000 7fdc9affd640 1 --2- 172.21.15.53:0/1976763382 >> v2:172.21.15.53:6805/3736905990 conn(0x7fdc8c03e9f0 0x7fdc8c040ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.218+0000 7fdc9affd640 1 -- 172.21.15.53:0/1976763382 --> v2:172.21.15.53:6805/3736905990 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc8c041570 con 0x7fdc8c03e9f0 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.218+0000 7fdc9affd640 1 -- 172.21.15.53:0/1976763382 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7fdc9c04c280 con 0x7fdcac06d8b0 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.219+0000 7fdca9d9b640 1 --2- 172.21.15.53:0/1976763382 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc8c038930 0x7fdc8c03ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.219+0000 7fdca9d9b640 1 --2- 172.21.15.53:0/1976763382 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc8c038930 0x7fdc8c03ae40 crc :-1 s=READY pgs=3797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.204 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.219+0000 7fdcaad9d640 1 --2- 172.21.15.53:0/1976763382 >> v2:172.21.15.53:6805/3736905990 conn(0x7fdc8c03e9f0 0x7fdc8c040ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:30:49.207 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.223+0000 7fdcaad9d640 1 --2- 172.21.15.53:0/1976763382 >> v2:172.21.15.53:6805/3736905990 conn(0x7fdc8c03e9f0 0x7fdc8c040ee0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.209 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.224+0000 7fdc9affd640 1 -- 172.21.15.53:0/1976763382 <== osd.1 v2:172.21.15.53:6805/3736905990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7fdc8c041570 con 0x7fdc8c03e9f0 2024-04-25T09:30:49.212 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.228+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 --> v2:172.21.15.53:6805/3736905990 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdcac1301d0 con 0x7fdc8c03e9f0 2024-04-25T09:30:49.214 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.229+0000 7fdc9affd640 1 -- 172.21.15.53:0/1976763382 <== osd.1 v2:172.21.15.53:6805/3736905990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fdca400a820 con 0x7fdc8c03e9f0 2024-04-25T09:30:49.214 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-25T09:30:49.214 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "" 2024-04-25T09:30:49.214 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-25T09:30:49.215 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 >> v2:172.21.15.53:6805/3736905990 conn(0x7fdc8c03e9f0 msgr2=0x7fdc8c040ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 --2- 172.21.15.53:0/1976763382 >> v2:172.21.15.53:6805/3736905990 conn(0x7fdc8c03e9f0 0x7fdc8c040ee0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc8c038930 msgr2=0x7fdc8c03ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 --2- 172.21.15.53:0/1976763382 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc8c038930 0x7fdc8c03ae40 crc :-1 s=READY pgs=3797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac06d8b0 msgr2=0x7fdcac09ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 --2- 172.21.15.53:0/1976763382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac06d8b0 0x7fdcac09ad00 crc :-1 s=READY pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 shutdown_connections 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 --2- 172.21.15.53:0/1976763382 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc8c038930 0x7fdc8c03ae40 unknown :-1 s=CLOSED pgs=3797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 --2- 172.21.15.53:0/1976763382 >> v2:172.21.15.53:6805/3736905990 conn(0x7fdc8c03e9f0 0x7fdc8c040ee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 --2- 172.21.15.53:0/1976763382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcac06d8b0 0x7fdcac09ad00 unknown :-1 s=CLOSED pgs=13009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 >> 172.21.15.53:0/1976763382 conn(0x7fdcac0a1e50 msgr2=0x7fdcac1b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 shutdown_connections 2024-04-25T09:30:49.216 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.230+0000 7fdcb0d9d640 1 -- 172.21.15.53:0/1976763382 wait complete. 2024-04-25T09:30:49.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T09:30:49.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.350+0000 7f928722d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.356+0000 7f928722d640 1 Processor -- start 2024-04-25T09:30:49.341 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.356+0000 7f928722d640 1 -- start start 2024-04-25T09:30:49.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.358+0000 7f928722d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f928009f6c0 0x7f928009fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.343 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.358+0000 7f928722d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9280070d80 con 0x7f92800a0010 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.358+0000 7f928722d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f92800717b0 con 0x7f928009f6c0 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.358+0000 7f9284fc9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f928009f6c0 0x7f928009fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.358+0000 7f927ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f92800a0010 0x7f92801329f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46472/0 (socket says 172.21.15.53:46472) 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.358+0000 7f927ffff640 1 -- 172.21.15.53:0/2420685821 learned_addr learned my addr 172.21.15.53:0/2420685821 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.359+0000 7f9284fc9640 1 -- 172.21.15.53:0/2420685821 >> v1:172.21.15.53:6789/0 conn(0x7f92800a0010 legacy=0x7f92801329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.359+0000 7f9284fc9640 1 -- 172.21.15.53:0/2420685821 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9280072330 con 0x7f928009f6c0 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.359+0000 7f9284fc9640 1 --2- 172.21.15.53:0/2420685821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 0x7f928009fad0 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a643db26c8e9702 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.359+0000 7f927f7fe640 1 -- 172.21.15.53:0/2420685821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9270009d90 con 0x7f928009f6c0 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.359+0000 7f927f7fe640 1 -- 172.21.15.53:0/2420685821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f927000e230 con 0x7f928009f6c0 2024-04-25T09:30:49.344 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.359+0000 7f927f7fe640 1 -- 172.21.15.53:0/2420685821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f927000e4d0 con 0x7f928009f6c0 2024-04-25T09:30:49.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.360+0000 7f928722d640 1 -- 172.21.15.53:0/2420685821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 msgr2=0x7f928009fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.360+0000 7f928722d640 1 --2- 172.21.15.53:0/2420685821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 0x7f928009fad0 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.360+0000 7f928722d640 1 -- 172.21.15.53:0/2420685821 shutdown_connections 2024-04-25T09:30:49.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.360+0000 7f928722d640 1 --2- 172.21.15.53:0/2420685821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 0x7f928009fad0 unknown :-1 s=CLOSED pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.345 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.360+0000 7f928722d640 1 -- 172.21.15.53:0/2420685821 >> 172.21.15.53:0/2420685821 conn(0x7f92800a1960 msgr2=0x7f92800a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:49.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.360+0000 7f928722d640 1 -- 172.21.15.53:0/2420685821 shutdown_connections 2024-04-25T09:30:49.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.360+0000 7f928722d640 1 -- 172.21.15.53:0/2420685821 wait complete. 2024-04-25T09:30:49.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.360+0000 7f928722d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.362+0000 7f928722d640 1 Processor -- start 2024-04-25T09:30:49.346 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.362+0000 7f928722d640 1 -- start start 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.363+0000 7f928722d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 0x7f928006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.363+0000 7f928722d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9280120d40 con 0x7f928009f6c0 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.363+0000 7f9284fc9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 0x7f928006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.363+0000 7f9284fc9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 0x7f928006e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40812/0 (socket says 172.21.15.53:40812) 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.363+0000 7f9284fc9640 1 -- 172.21.15.53:0/329854151 learned_addr learned my addr 172.21.15.53:0/329854151 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.364+0000 7f9284fc9640 1 -- 172.21.15.53:0/329854151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9280122040 con 0x7f928009f6c0 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.364+0000 7f9284fc9640 1 --2- 172.21.15.53:0/329854151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 0x7f928006e9c0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.364+0000 7f927d7fa640 1 -- 172.21.15.53:0/329854151 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9270014620 con 0x7f928009f6c0 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.364+0000 7f927d7fa640 1 -- 172.21.15.53:0/329854151 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9270014780 con 0x7f928009f6c0 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.364+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9280121350 con 0x7f928009f6c0 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.364+0000 7f927d7fa640 1 -- 172.21.15.53:0/329854151 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9270014a20 con 0x7f928009f6c0 2024-04-25T09:30:49.349 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.364+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9280121bc0 con 0x7f928009f6c0 2024-04-25T09:30:49.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.365+0000 7f927d7fa640 1 -- 172.21.15.53:0/329854151 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9270014bd0 con 0x7f928009f6c0 2024-04-25T09:30:49.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.365+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92800692b0 con 0x7f928009f6c0 2024-04-25T09:30:49.350 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.366+0000 7f927d7fa640 1 --2- 172.21.15.53:0/329854151 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f926c038980 0x7f926c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.366+0000 7f927d7fa640 1 -- 172.21.15.53:0/329854151 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7f9270019040 con 0x7f928009f6c0 2024-04-25T09:30:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.366+0000 7f927ffff640 1 --2- 172.21.15.53:0/329854151 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f926c038980 0x7f926c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.351 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.366+0000 7f927ffff640 1 --2- 172.21.15.53:0/329854151 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f926c038980 0x7f926c03ae90 crc :-1 s=READY pgs=3798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.355 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.371+0000 7f927d7fa640 1 -- 172.21.15.53:0/329854151 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f9270011380 con 0x7f928009f6c0 2024-04-25T09:30:49.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.558+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f928009bca0 con 0x7f926c038980 2024-04-25T09:30:49.543 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.559+0000 7f927d7fa640 1 -- 172.21.15.53:0/329854151 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f9274001250 con 0x7f926c038980 2024-04-25T09:30:49.543 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T09:30:49.547 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f926c038980 msgr2=0x7f926c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 --2- 172.21.15.53:0/329854151 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f926c038980 0x7f926c03ae90 crc :-1 s=READY pgs=3798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 msgr2=0x7f928006e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 --2- 172.21.15.53:0/329854151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 0x7f928006e9c0 crc :-1 s=READY pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 shutdown_connections 2024-04-25T09:30:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 --2- 172.21.15.53:0/329854151 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f926c038980 0x7f926c03ae90 unknown :-1 s=CLOSED pgs=3798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 --2- 172.21.15.53:0/329854151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f928009f6c0 0x7f928006e9c0 unknown :-1 s=CLOSED pgs=13012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 >> 172.21.15.53:0/329854151 conn(0x7f92800a1960 msgr2=0x7f92801bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 shutdown_connections 2024-04-25T09:30:49.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.562+0000 7f928722d640 1 -- 172.21.15.53:0/329854151 wait complete. 2024-04-25T09:30:49.565 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T09:30:49.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:30:49.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.690+0000 7f8521aed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.699+0000 7f8521aed640 1 Processor -- start 2024-04-25T09:30:49.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.699+0000 7f8521aed640 1 -- start start 2024-04-25T09:30:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f8521aed640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f851c135cd0 0x7f851c1380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f8521aed640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f851c0713e0 con 0x7f851c132d80 2024-04-25T09:30:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f8521aed640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f851c073970 con 0x7f851c135cd0 2024-04-25T09:30:49.686 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f851affd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f851c135cd0 0x7f851c1380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f851b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f851c132d80 0x7f851c133190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46480/0 (socket says 172.21.15.53:46480) 2024-04-25T09:30:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f851b7fe640 1 -- 172.21.15.53:0/1003295194 learned_addr learned my addr 172.21.15.53:0/1003295194 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f851affd640 1 -- 172.21.15.53:0/1003295194 >> v1:172.21.15.53:6789/0 conn(0x7f851c132d80 legacy=0x7f851c133190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f851affd640 1 -- 172.21.15.53:0/1003295194 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c1329c0 con 0x7f851c135cd0 2024-04-25T09:30:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f851a7fc640 1 -- 172.21.15.53:0/1003295194 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786482920 0 0) 0x7f851c0713e0 con 0x7f851c132d80 2024-04-25T09:30:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.701+0000 7f851affd640 1 --2- 172.21.15.53:0/1003295194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c135cd0 0x7f851c1380f0 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f824eb409f2e8b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f851a7fc640 1 -- 172.21.15.53:0/1003295194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8510009d90 con 0x7f851c135cd0 2024-04-25T09:30:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f851a7fc640 1 -- 172.21.15.53:0/1003295194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f851000e230 con 0x7f851c135cd0 2024-04-25T09:30:49.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f851a7fc640 1 -- 172.21.15.53:0/1003295194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f851000e4d0 con 0x7f851c135cd0 2024-04-25T09:30:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f8521aed640 1 -- 172.21.15.53:0/1003295194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c135cd0 msgr2=0x7f851c1380f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f8521aed640 1 --2- 172.21.15.53:0/1003295194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c135cd0 0x7f851c1380f0 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f8521aed640 1 -- 172.21.15.53:0/1003295194 shutdown_connections 2024-04-25T09:30:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f8521aed640 1 --2- 172.21.15.53:0/1003295194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c135cd0 0x7f851c1380f0 unknown :-1 s=CLOSED pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f8521aed640 1 -- 172.21.15.53:0/1003295194 >> 172.21.15.53:0/1003295194 conn(0x7f851c0a17c0 msgr2=0x7f851c0a1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f8521aed640 1 -- 172.21.15.53:0/1003295194 shutdown_connections 2024-04-25T09:30:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.702+0000 7f8521aed640 1 -- 172.21.15.53:0/1003295194 wait complete. 2024-04-25T09:30:49.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.703+0000 7f8521aed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.704+0000 7f8521aed640 1 Processor -- start 2024-04-25T09:30:49.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.705+0000 7f8521aed640 1 -- start start 2024-04-25T09:30:49.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.706+0000 7f8521aed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c132d80 0x7f851c11d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.706+0000 7f8521aed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f851c11f030 con 0x7f851c132d80 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.706+0000 7f851b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c132d80 0x7f851c11d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.706+0000 7f851b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c132d80 0x7f851c11d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40826/0 (socket says 172.21.15.53:40826) 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.706+0000 7f851b7fe640 1 -- 172.21.15.53:0/3834259985 learned_addr learned my addr 172.21.15.53:0/3834259985 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.707+0000 7f851b7fe640 1 -- 172.21.15.53:0/3834259985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c11d290 con 0x7f851c132d80 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.707+0000 7f851b7fe640 1 --2- 172.21.15.53:0/3834259985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c132d80 0x7f851c11d520 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.707+0000 7f8503fff640 1 -- 172.21.15.53:0/3834259985 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f850c004b80 con 0x7f851c132d80 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.707+0000 7f8503fff640 1 -- 172.21.15.53:0/3834259985 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f850c004ce0 con 0x7f851c132d80 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.707+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851c11cef0 con 0x7f851c132d80 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.707+0000 7f8503fff640 1 -- 172.21.15.53:0/3834259985 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f850c007120 con 0x7f851c132d80 2024-04-25T09:30:49.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.707+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851c11fea0 con 0x7f851c132d80 2024-04-25T09:30:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.708+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f851c120c80 con 0x7f851c132d80 2024-04-25T09:30:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.708+0000 7f8503fff640 1 -- 172.21.15.53:0/3834259985 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f850c007320 con 0x7f851c132d80 2024-04-25T09:30:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.708+0000 7f8503fff640 1 --2- 172.21.15.53:0/3834259985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8508038930 0x7f850803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.708+0000 7f8503fff640 1 -- 172.21.15.53:0/3834259985 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7f850c048630 con 0x7f851c132d80 2024-04-25T09:30:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.708+0000 7f8503fff640 1 --2- 172.21.15.53:0/3834259985 >> v2:172.21.15.151:6805/3300556569 conn(0x7f850803e9f0 0x7f8508040ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.708+0000 7f8503fff640 1 -- 172.21.15.53:0/3834259985 --> v2:172.21.15.151:6805/3300556569 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8508041570 con 0x7f850803e9f0 2024-04-25T09:30:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.708+0000 7f8503fff640 1 -- 172.21.15.53:0/3834259985 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7f850c04ab20 con 0x7f851c132d80 2024-04-25T09:30:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.709+0000 7f851affd640 1 --2- 172.21.15.53:0/3834259985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8508038930 0x7f850803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.709+0000 7f851affd640 1 --2- 172.21.15.53:0/3834259985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8508038930 0x7f850803ae40 crc :-1 s=READY pgs=3799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.709+0000 7f851bfff640 1 --2- 172.21.15.53:0/3834259985 >> v2:172.21.15.151:6805/3300556569 conn(0x7f850803e9f0 0x7f8508040ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:30:49.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.713+0000 7f851bfff640 1 --2- 172.21.15.53:0/3834259985 >> v2:172.21.15.151:6805/3300556569 conn(0x7f850803e9f0 0x7f8508040ee0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.714+0000 7f8503fff640 1 -- 172.21.15.53:0/3834259985 <== osd.2 v2:172.21.15.151:6805/3300556569 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f8508041570 con 0x7f850803e9f0 2024-04-25T09:30:49.702 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.718+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 --> v2:172.21.15.151:6805/3300556569 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f851c072220 con 0x7f850803e9f0 2024-04-25T09:30:49.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.719+0000 7f8503fff640 1 -- 172.21.15.53:0/3834259985 <== osd.2 v2:172.21.15.151:6805/3300556569 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f851400a820 con 0x7f850803e9f0 2024-04-25T09:30:49.704 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-25T09:30:49.704 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "" 2024-04-25T09:30:49.704 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-25T09:30:49.705 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 >> v2:172.21.15.151:6805/3300556569 conn(0x7f850803e9f0 msgr2=0x7f8508040ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 --2- 172.21.15.53:0/3834259985 >> v2:172.21.15.151:6805/3300556569 conn(0x7f850803e9f0 0x7f8508040ee0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8508038930 msgr2=0x7f850803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 --2- 172.21.15.53:0/3834259985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8508038930 0x7f850803ae40 crc :-1 s=READY pgs=3799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c132d80 msgr2=0x7f851c11d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 --2- 172.21.15.53:0/3834259985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c132d80 0x7f851c11d520 crc :-1 s=READY pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 shutdown_connections 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 --2- 172.21.15.53:0/3834259985 >> v2:172.21.15.151:6805/3300556569 conn(0x7f850803e9f0 0x7f8508040ee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 --2- 172.21.15.53:0/3834259985 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f8508038930 0x7f850803ae40 unknown :-1 s=CLOSED pgs=3799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 --2- 172.21.15.53:0/3834259985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f851c132d80 0x7f851c11d520 unknown :-1 s=CLOSED pgs=13015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 >> 172.21.15.53:0/3834259985 conn(0x7f851c0a17c0 msgr2=0x7f851c1307c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 shutdown_connections 2024-04-25T09:30:49.706 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.720+0000 7f8521aed640 1 -- 172.21.15.53:0/3834259985 wait complete. 2024-04-25T09:30:49.715 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T09:30:49.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.838+0000 7fdc66c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.844+0000 7fdc66c2d640 1 Processor -- start 2024-04-25T09:30:49.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.844+0000 7fdc66c2d640 1 -- start start 2024-04-25T09:30:49.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.846+0000 7fdc66c2d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdc601351e0 0x7fdc601355f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.846+0000 7fdc66c2d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc60134e00 con 0x7fdc6006d8b0 2024-04-25T09:30:49.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.846+0000 7fdc66c2d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdc6009cb50 con 0x7fdc601351e0 2024-04-25T09:30:49.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.846+0000 7fdc649c9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdc601351e0 0x7fdc601355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.846+0000 7fdc5ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdc6006d8b0 0x7fdc6006dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46486/0 (socket says 172.21.15.53:46486) 2024-04-25T09:30:49.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.846+0000 7fdc5ffff640 1 -- 172.21.15.53:0/2733231135 learned_addr learned my addr 172.21.15.53:0/2733231135 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:49.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.846+0000 7fdc649c9640 1 -- 172.21.15.53:0/2733231135 >> v1:172.21.15.53:6789/0 conn(0x7fdc6006d8b0 legacy=0x7fdc6006dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.846+0000 7fdc649c9640 1 -- 172.21.15.53:0/2733231135 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6009b4e0 con 0x7fdc601351e0 2024-04-25T09:30:49.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.846+0000 7fdc649c9640 1 --2- 172.21.15.53:0/2733231135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc601351e0 0x7fdc601355f0 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b1df05b48af314 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2733231135 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc5800e040 con 0x7fdc601351e0 2024-04-25T09:30:49.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2733231135 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc58007670 con 0x7fdc601351e0 2024-04-25T09:30:49.832 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc5f7fe640 1 -- 172.21.15.53:0/2733231135 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc58007910 con 0x7fdc601351e0 2024-04-25T09:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2733231135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc601351e0 msgr2=0x7fdc601355f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc66c2d640 1 --2- 172.21.15.53:0/2733231135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc601351e0 0x7fdc601355f0 crc :-1 s=READY pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2733231135 shutdown_connections 2024-04-25T09:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc66c2d640 1 --2- 172.21.15.53:0/2733231135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc601351e0 0x7fdc601355f0 unknown :-1 s=CLOSED pgs=13017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2733231135 >> 172.21.15.53:0/2733231135 conn(0x7fdc600a0950 msgr2=0x7fdc600a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2733231135 shutdown_connections 2024-04-25T09:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.847+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2733231135 wait complete. 2024-04-25T09:30:49.833 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.848+0000 7fdc66c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.849+0000 7fdc66c2d640 1 Processor -- start 2024-04-25T09:30:49.834 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.849+0000 7fdc66c2d640 1 -- start start 2024-04-25T09:30:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.851+0000 7fdc66c2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc6006d8b0 0x7fdc6011b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.836 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.851+0000 7fdc66c2d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6011cec0 con 0x7fdc6006d8b0 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.851+0000 7fdc649c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc6006d8b0 0x7fdc6011b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.851+0000 7fdc649c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc6006d8b0 0x7fdc6011b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40838/0 (socket says 172.21.15.53:40838) 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.851+0000 7fdc649c9640 1 -- 172.21.15.53:0/2012929343 learned_addr learned my addr 172.21.15.53:0/2012929343 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.851+0000 7fdc649c9640 1 -- 172.21.15.53:0/2012929343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6012ef70 con 0x7fdc6006d8b0 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.851+0000 7fdc649c9640 1 --2- 172.21.15.53:0/2012929343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc6006d8b0 0x7fdc6011b070 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.852+0000 7fdc5d7fa640 1 -- 172.21.15.53:0/2012929343 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc5800e040 con 0x7fdc6006d8b0 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.852+0000 7fdc5d7fa640 1 -- 172.21.15.53:0/2012929343 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdc58012a80 con 0x7fdc6006d8b0 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.852+0000 7fdc5d7fa640 1 -- 172.21.15.53:0/2012929343 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdc58012d20 con 0x7fdc6006d8b0 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.852+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc6011cae0 con 0x7fdc6006d8b0 2024-04-25T09:30:49.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.852+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc6012f1d0 con 0x7fdc6006d8b0 2024-04-25T09:30:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.853+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc60063880 con 0x7fdc6006d8b0 2024-04-25T09:30:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.853+0000 7fdc5d7fa640 1 -- 172.21.15.53:0/2012929343 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fdc580153f0 con 0x7fdc6006d8b0 2024-04-25T09:30:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.853+0000 7fdc5d7fa640 1 --2- 172.21.15.53:0/2012929343 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc4c038980 0x7fdc4c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.853+0000 7fdc5d7fa640 1 -- 172.21.15.53:0/2012929343 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7fdc58049df0 con 0x7fdc6006d8b0 2024-04-25T09:30:49.838 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.853+0000 7fdc5ffff640 1 --2- 172.21.15.53:0/2012929343 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc4c038980 0x7fdc4c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:49.839 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.854+0000 7fdc5ffff640 1 --2- 172.21.15.53:0/2012929343 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc4c038980 0x7fdc4c03ae90 crc :-1 s=READY pgs=3800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:49.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:49.858+0000 7fdc5d7fa640 1 -- 172.21.15.53:0/2012929343 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fdc5800fc80 con 0x7fdc6006d8b0 2024-04-25T09:30:50.030 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.046+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fdc6009df90 con 0x7fdc4c038980 2024-04-25T09:30:50.031 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.047+0000 7fdc5d7fa640 1 -- 172.21.15.53:0/2012929343 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fdc6009df90 con 0x7fdc4c038980 2024-04-25T09:30:50.031 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T09:30:50.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc4c038980 msgr2=0x7fdc4c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 --2- 172.21.15.53:0/2012929343 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc4c038980 0x7fdc4c03ae90 crc :-1 s=READY pgs=3800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc6006d8b0 msgr2=0x7fdc6011b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 --2- 172.21.15.53:0/2012929343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc6006d8b0 0x7fdc6011b070 crc :-1 s=READY pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 shutdown_connections 2024-04-25T09:30:50.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 --2- 172.21.15.53:0/2012929343 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fdc4c038980 0x7fdc4c03ae90 unknown :-1 s=CLOSED pgs=3800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 --2- 172.21.15.53:0/2012929343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc6006d8b0 0x7fdc6011b070 unknown :-1 s=CLOSED pgs=13018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 >> 172.21.15.53:0/2012929343 conn(0x7fdc600a0950 msgr2=0x7fdc601bce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:50.034 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 shutdown_connections 2024-04-25T09:30:50.035 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.049+0000 7fdc66c2d640 1 -- 172.21.15.53:0/2012929343 wait complete. 2024-04-25T09:30:50.045 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T09:30:50.046 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:30:50.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.169+0000 7fd1a879d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:50.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.178+0000 7fd1a879d640 1 Processor -- start 2024-04-25T09:30:50.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.178+0000 7fd1a879d640 1 -- start start 2024-04-25T09:30:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a879d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd1a0132d80 0x7fd1a0133190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a879d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a00713e0 con 0x7fd1a009f6c0 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a879d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a0073970 con 0x7fd1a0132d80 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a6539640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd1a0132d80 0x7fd1a0133190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a5d38640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd1a009f6c0 0x7fd1a009fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46496/0 (socket says 172.21.15.53:46496) 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a5d38640 1 -- 172.21.15.53:0/2913447777 learned_addr learned my addr 172.21.15.53:0/2913447777 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a5537640 1 -- 172.21.15.53:0/2913447777 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449464902 0 0) 0x7fd1a00713e0 con 0x7fd1a009f6c0 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a5537640 1 -- 172.21.15.53:0/2913447777 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd18c003580 con 0x7fd1a009f6c0 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a6539640 1 -- 172.21.15.53:0/2913447777 >> v1:172.21.15.53:6789/0 conn(0x7fd1a009f6c0 legacy=0x7fd1a009fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a6539640 1 -- 172.21.15.53:0/2913447777 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a01329c0 con 0x7fd1a0132d80 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.180+0000 7fd1a6539640 1 --2- 172.21.15.53:0/2913447777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a0132d80 0x7fd1a0133190 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f815417816a9254b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.181+0000 7fd1a5537640 1 -- 172.21.15.53:0/2913447777 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd19c009d90 con 0x7fd1a0132d80 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.181+0000 7fd1a5537640 1 -- 172.21.15.53:0/2913447777 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd19c00e230 con 0x7fd1a0132d80 2024-04-25T09:30:50.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.181+0000 7fd1a5537640 1 -- 172.21.15.53:0/2913447777 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd19c00e4d0 con 0x7fd1a0132d80 2024-04-25T09:30:50.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.181+0000 7fd1a879d640 1 -- 172.21.15.53:0/2913447777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a0132d80 msgr2=0x7fd1a0133190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.167 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.181+0000 7fd1a879d640 1 --2- 172.21.15.53:0/2913447777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a0132d80 0x7fd1a0133190 crc :-1 s=READY pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.181+0000 7fd1a879d640 1 -- 172.21.15.53:0/2913447777 shutdown_connections 2024-04-25T09:30:50.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.181+0000 7fd1a879d640 1 --2- 172.21.15.53:0/2913447777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a0132d80 0x7fd1a0133190 unknown :-1 s=CLOSED pgs=13020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.181+0000 7fd1a879d640 1 -- 172.21.15.53:0/2913447777 >> 172.21.15.53:0/2913447777 conn(0x7fd1a00a17c0 msgr2=0x7fd1a00a1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:50.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.182+0000 7fd1a879d640 1 -- 172.21.15.53:0/2913447777 shutdown_connections 2024-04-25T09:30:50.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.182+0000 7fd1a879d640 1 -- 172.21.15.53:0/2913447777 wait complete. 2024-04-25T09:30:50.168 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.182+0000 7fd1a879d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.183+0000 7fd1a879d640 1 Processor -- start 2024-04-25T09:30:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.183+0000 7fd1a879d640 1 -- start start 2024-04-25T09:30:50.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.185+0000 7fd1a879d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a009f6c0 0x7fd1a011efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.185+0000 7fd1a879d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a012fff0 con 0x7fd1a009f6c0 2024-04-25T09:30:50.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.185+0000 7fd1a6539640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a009f6c0 0x7fd1a011efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:50.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.185+0000 7fd1a6539640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a009f6c0 0x7fd1a011efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40844/0 (socket says 172.21.15.53:40844) 2024-04-25T09:30:50.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.185+0000 7fd1a6539640 1 -- 172.21.15.53:0/3709300557 learned_addr learned my addr 172.21.15.53:0/3709300557 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:50.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.185+0000 7fd1a6539640 1 -- 172.21.15.53:0/3709300557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a0130270 con 0x7fd1a009f6c0 2024-04-25T09:30:50.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.186+0000 7fd1a6539640 1 --2- 172.21.15.53:0/3709300557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a009f6c0 0x7fd1a011efc0 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.186+0000 7fd196ffd640 1 -- 172.21.15.53:0/3709300557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd19c014540 con 0x7fd1a009f6c0 2024-04-25T09:30:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.186+0000 7fd196ffd640 1 -- 172.21.15.53:0/3709300557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd19c0146a0 con 0x7fd1a009f6c0 2024-04-25T09:30:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.186+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a01225e0 con 0x7fd1a009f6c0 2024-04-25T09:30:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.186+0000 7fd196ffd640 1 -- 172.21.15.53:0/3709300557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd19c014940 con 0x7fd1a009f6c0 2024-04-25T09:30:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.186+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a00767f0 con 0x7fd1a009f6c0 2024-04-25T09:30:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.187+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd1a009bca0 con 0x7fd1a009f6c0 2024-04-25T09:30:50.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.187+0000 7fd196ffd640 1 -- 172.21.15.53:0/3709300557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fd19c014b40 con 0x7fd1a009f6c0 2024-04-25T09:30:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.187+0000 7fd196ffd640 1 --2- 172.21.15.53:0/3709300557 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd184038930 0x7fd18403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.187+0000 7fd196ffd640 1 -- 172.21.15.53:0/3709300557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7fd19c019040 con 0x7fd1a009f6c0 2024-04-25T09:30:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.187+0000 7fd196ffd640 1 --2- 172.21.15.53:0/3709300557 >> v2:172.21.15.151:6806/46311736 conn(0x7fd18403e9f0 0x7fd184040ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.187+0000 7fd196ffd640 1 -- 172.21.15.53:0/3709300557 --> v2:172.21.15.151:6806/46311736 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd184041570 con 0x7fd18403e9f0 2024-04-25T09:30:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.187+0000 7fd196ffd640 1 -- 172.21.15.53:0/3709300557 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7fd19c049fd0 con 0x7fd1a009f6c0 2024-04-25T09:30:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.187+0000 7fd1a5d38640 1 --2- 172.21.15.53:0/3709300557 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd184038930 0x7fd18403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:50.176 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.188+0000 7fd1a5d38640 1 --2- 172.21.15.53:0/3709300557 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd184038930 0x7fd18403ae40 crc :-1 s=READY pgs=3801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.188+0000 7fd1a6d3a640 1 --2- 172.21.15.53:0/3709300557 >> v2:172.21.15.151:6806/46311736 conn(0x7fd18403e9f0 0x7fd184040ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T09:30:50.177 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.191+0000 7fd1a6d3a640 1 --2- 172.21.15.53:0/3709300557 >> v2:172.21.15.151:6806/46311736 conn(0x7fd18403e9f0 0x7fd184040ee0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.193+0000 7fd196ffd640 1 -- 172.21.15.53:0/3709300557 <== osd.3 v2:172.21.15.151:6806/46311736 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7fd184041570 con 0x7fd18403e9f0 2024-04-25T09:30:50.181 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.196+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 --> v2:172.21.15.151:6806/46311736 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd1a0070cf0 con 0x7fd18403e9f0 2024-04-25T09:30:50.183 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd196ffd640 1 -- 172.21.15.53:0/3709300557 <== osd.3 v2:172.21.15.151:6806/46311736 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fd19800a820 con 0x7fd18403e9f0 2024-04-25T09:30:50.183 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-04-25T09:30:50.183 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "" 2024-04-25T09:30:50.184 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-04-25T09:30:50.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 >> v2:172.21.15.151:6806/46311736 conn(0x7fd18403e9f0 msgr2=0x7fd184040ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 --2- 172.21.15.53:0/3709300557 >> v2:172.21.15.151:6806/46311736 conn(0x7fd18403e9f0 0x7fd184040ee0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd184038930 msgr2=0x7fd18403ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 --2- 172.21.15.53:0/3709300557 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd184038930 0x7fd18403ae40 crc :-1 s=READY pgs=3801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a009f6c0 msgr2=0x7fd1a011efc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.186 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 --2- 172.21.15.53:0/3709300557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a009f6c0 0x7fd1a011efc0 crc :-1 s=READY pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 shutdown_connections 2024-04-25T09:30:50.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 --2- 172.21.15.53:0/3709300557 >> v2:172.21.15.151:6806/46311736 conn(0x7fd18403e9f0 0x7fd184040ee0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 --2- 172.21.15.53:0/3709300557 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fd184038930 0x7fd18403ae40 unknown :-1 s=CLOSED pgs=3801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 --2- 172.21.15.53:0/3709300557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a009f6c0 0x7fd1a011efc0 unknown :-1 s=CLOSED pgs=13021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 >> 172.21.15.53:0/3709300557 conn(0x7fd1a00a17c0 msgr2=0x7fd1a009c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:50.187 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.198+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 shutdown_connections 2024-04-25T09:30:50.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.199+0000 7fd1a879d640 1 -- 172.21.15.53:0/3709300557 wait complete. 2024-04-25T09:30:50.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T09:30:50.309 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.319+0000 7f4ca2c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:50.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.325+0000 7f4ca2c6d640 1 Processor -- start 2024-04-25T09:30:50.310 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.326+0000 7f4ca2c6d640 1 -- start start 2024-04-25T09:30:50.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.327+0000 7f4ca2c6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4c9c09f6c0 0x7f4c9c09fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.327+0000 7f4ca2c6d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c9c070d80 con 0x7f4c9c0a0010 2024-04-25T09:30:50.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.327+0000 7f4ca2c6d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4c9c0717b0 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.327+0000 7f4ca0a09640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4c9c09f6c0 0x7f4c9c09fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:50.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.327+0000 7f4c9bfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4c9c0a0010 0x7f4c9c1329f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46504/0 (socket says 172.21.15.53:46504) 2024-04-25T09:30:50.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.327+0000 7f4c9bfff640 1 -- 172.21.15.53:0/1852194789 learned_addr learned my addr 172.21.15.53:0/1852194789 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:50.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.328+0000 7f4c9b7fe640 1 -- 172.21.15.53:0/1852194789 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855415961 0 0) 0x7f4c9c070d80 con 0x7f4c9c0a0010 2024-04-25T09:30:50.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.328+0000 7f4c9b7fe640 1 -- 172.21.15.53:0/1852194789 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c84003580 con 0x7f4c9c0a0010 2024-04-25T09:30:50.313 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.328+0000 7f4ca0a09640 1 -- 172.21.15.53:0/1852194789 >> v1:172.21.15.53:6789/0 conn(0x7f4c9c0a0010 legacy=0x7f4c9c1329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.328+0000 7f4ca0a09640 1 -- 172.21.15.53:0/1852194789 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9c072330 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.328+0000 7f4ca0a09640 1 --2- 172.21.15.53:0/1852194789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 0x7f4c9c09fad0 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dd7694adb5a3fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.328+0000 7f4c9b7fe640 1 -- 172.21.15.53:0/1852194789 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c9400e040 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.328+0000 7f4c9b7fe640 1 -- 172.21.15.53:0/1852194789 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4c94007670 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.314 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.328+0000 7f4c9b7fe640 1 -- 172.21.15.53:0/1852194789 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c94007910 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.329+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1852194789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 msgr2=0x7f4c9c09fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.329+0000 7f4ca2c6d640 1 --2- 172.21.15.53:0/1852194789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 0x7f4c9c09fad0 crc :-1 s=READY pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.329+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1852194789 shutdown_connections 2024-04-25T09:30:50.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.329+0000 7f4ca2c6d640 1 --2- 172.21.15.53:0/1852194789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 0x7f4c9c09fad0 unknown :-1 s=CLOSED pgs=13023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.329+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1852194789 >> 172.21.15.53:0/1852194789 conn(0x7f4c9c0a1960 msgr2=0x7f4c9c0a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:50.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.329+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1852194789 shutdown_connections 2024-04-25T09:30:50.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.329+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1852194789 wait complete. 2024-04-25T09:30:50.315 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.329+0000 7f4ca2c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:50.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.331+0000 7f4ca2c6d640 1 Processor -- start 2024-04-25T09:30:50.316 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.331+0000 7f4ca2c6d640 1 -- start start 2024-04-25T09:30:50.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.332+0000 7f4ca2c6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 0x7f4c9c11c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.332+0000 7f4ca2c6d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9c11f210 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.332+0000 7f4ca0a09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 0x7f4c9c11c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:50.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.333+0000 7f4ca0a09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 0x7f4c9c11c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40858/0 (socket says 172.21.15.53:40858) 2024-04-25T09:30:50.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.333+0000 7f4ca0a09640 1 -- 172.21.15.53:0/1759242660 learned_addr learned my addr 172.21.15.53:0/1759242660 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:50.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.333+0000 7f4ca0a09640 1 -- 172.21.15.53:0/1759242660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9c11e4e0 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.333+0000 7f4ca0a09640 1 --2- 172.21.15.53:0/1759242660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 0x7f4c9c11c080 crc :-1 s=READY pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.333+0000 7f4c997fa640 1 -- 172.21.15.53:0/1759242660 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c9400e040 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.333+0000 7f4c997fa640 1 -- 172.21.15.53:0/1759242660 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4c94013810 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.333+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c9c11f470 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.333+0000 7f4c997fa640 1 -- 172.21.15.53:0/1759242660 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c94013ab0 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.319 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.333+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c9c11ea90 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.334+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c9c0692b0 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.334+0000 7f4c997fa640 1 -- 172.21.15.53:0/1759242660 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4c94011040 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.334+0000 7f4c997fa640 1 --2- 172.21.15.53:0/1759242660 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4c88038980 0x7f4c8803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.334+0000 7f4c997fa640 1 -- 172.21.15.53:0/1759242660 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7f4c94049a10 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.335+0000 7f4c9bfff640 1 --2- 172.21.15.53:0/1759242660 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4c88038980 0x7f4c8803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:50.320 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.335+0000 7f4c9bfff640 1 --2- 172.21.15.53:0/1759242660 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4c88038980 0x7f4c8803ae90 crc :-1 s=READY pgs=3802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.339+0000 7f4c997fa640 1 -- 172.21.15.53:0/1759242660 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f4c94010790 con 0x7f4c9c09f6c0 2024-04-25T09:30:50.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.526+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4c9c1201e0 con 0x7f4c88038980 2024-04-25T09:30:50.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.527+0000 7f4c997fa640 1 -- 172.21.15.53:0/1759242660 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f4c9c1201e0 con 0x7f4c88038980 2024-04-25T09:30:50.512 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T09:30:50.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.529+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4c88038980 msgr2=0x7f4c8803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.529+0000 7f4ca2c6d640 1 --2- 172.21.15.53:0/1759242660 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4c88038980 0x7f4c8803ae90 crc :-1 s=READY pgs=3802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.529+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 msgr2=0x7f4c9c11c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.529+0000 7f4ca2c6d640 1 --2- 172.21.15.53:0/1759242660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 0x7f4c9c11c080 crc :-1 s=READY pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.529+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 shutdown_connections 2024-04-25T09:30:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.529+0000 7f4ca2c6d640 1 --2- 172.21.15.53:0/1759242660 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7f4c88038980 0x7f4c8803ae90 unknown :-1 s=CLOSED pgs=3802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.529+0000 7f4ca2c6d640 1 --2- 172.21.15.53:0/1759242660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c9c09f6c0 0x7f4c9c11c080 unknown :-1 s=CLOSED pgs=13024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.529+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 >> 172.21.15.53:0/1759242660 conn(0x7f4c9c0a1960 msgr2=0x7f4c9c1b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.529+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 shutdown_connections 2024-04-25T09:30:50.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.530+0000 7f4ca2c6d640 1 -- 172.21.15.53:0/1759242660 wait complete. 2024-04-25T09:30:50.525 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:50.637 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.649+0000 7fbcb386d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.654+0000 7fbcb386d640 1 Processor -- start 2024-04-25T09:30:50.638 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.654+0000 7fbcb386d640 1 -- start start 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.655+0000 7fbcb386d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbcac06f210 0x7fbcac131570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.655+0000 7fbcb386d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcac130f10 con 0x7fbcac131ab0 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.655+0000 7fbcb386d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbcac09cfd0 con 0x7fbcac06f210 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.655+0000 7fbcb1609640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbcac06f210 0x7fbcac131570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.656+0000 7fbcb0e08640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbcac131ab0 0x7fbcac06d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:46512/0 (socket says 172.21.15.53:46512) 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.656+0000 7fbcb0e08640 1 -- 172.21.15.53:0/2208137941 learned_addr learned my addr 172.21.15.53:0/2208137941 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.656+0000 7fbcb1609640 1 -- 172.21.15.53:0/2208137941 >> v1:172.21.15.53:6789/0 conn(0x7fbcac131ab0 legacy=0x7fbcac06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.656+0000 7fbcb1609640 1 -- 172.21.15.53:0/2208137941 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac09c820 con 0x7fbcac06f210 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.656+0000 7fbcb1609640 1 --2- 172.21.15.53:0/2208137941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 0x7fbcac131570 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adf1d5cf0857119 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.656+0000 7fbca3fff640 1 -- 172.21.15.53:0/2208137941 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbca800e040 con 0x7fbcac06f210 2024-04-25T09:30:50.641 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.656+0000 7fbca3fff640 1 -- 172.21.15.53:0/2208137941 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbca8007670 con 0x7fbcac06f210 2024-04-25T09:30:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.656+0000 7fbca3fff640 1 -- 172.21.15.53:0/2208137941 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbca8007910 con 0x7fbcac06f210 2024-04-25T09:30:50.642 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.657+0000 7fbcb386d640 1 -- 172.21.15.53:0/2208137941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 msgr2=0x7fbcac131570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.657+0000 7fbcb386d640 1 --2- 172.21.15.53:0/2208137941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 0x7fbcac131570 crc :-1 s=READY pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.657+0000 7fbcb386d640 1 -- 172.21.15.53:0/2208137941 shutdown_connections 2024-04-25T09:30:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.657+0000 7fbcb386d640 1 --2- 172.21.15.53:0/2208137941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 0x7fbcac131570 unknown :-1 s=CLOSED pgs=13026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.657+0000 7fbcb386d640 1 -- 172.21.15.53:0/2208137941 >> 172.21.15.53:0/2208137941 conn(0x7fbcac09f6a0 msgr2=0x7fbcac09fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.657+0000 7fbcb386d640 1 -- 172.21.15.53:0/2208137941 shutdown_connections 2024-04-25T09:30:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.657+0000 7fbcb386d640 1 -- 172.21.15.53:0/2208137941 wait complete. 2024-04-25T09:30:50.643 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.657+0000 7fbcb386d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.659+0000 7fbcb386d640 1 Processor -- start 2024-04-25T09:30:50.644 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.659+0000 7fbcb386d640 1 -- start start 2024-04-25T09:30:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbcb386d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 0x7fbcac1c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbcb386d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac11c760 con 0x7fbcac06f210 2024-04-25T09:30:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbcb1609640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 0x7fbcac1c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbcb1609640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 0x7fbcac1c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:40886/0 (socket says 172.21.15.53:40886) 2024-04-25T09:30:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbcb1609640 1 -- 172.21.15.53:0/1823582191 learned_addr learned my addr 172.21.15.53:0/1823582191 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:30:50.646 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbcb1609640 1 -- 172.21.15.53:0/1823582191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac068380 con 0x7fbcac06f210 2024-04-25T09:30:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbcb1609640 1 --2- 172.21.15.53:0/1823582191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 0x7fbcac1c7960 crc :-1 s=READY pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1823582191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbca800e040 con 0x7fbcac06f210 2024-04-25T09:30:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1823582191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbca8012a90 con 0x7fbcac06f210 2024-04-25T09:30:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1823582191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbca8012d30 con 0x7fbcac06f210 2024-04-25T09:30:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.661+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcac11c1e0 con 0x7fbcac06f210 2024-04-25T09:30:50.647 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.662+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac073390 con 0x7fbcac06f210 2024-04-25T09:30:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.663+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1823582191 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fbca80153f0 con 0x7fbcac06f210 2024-04-25T09:30:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.663+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac072ab0 con 0x7fbcac06f210 2024-04-25T09:30:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.663+0000 7fbca1ffb640 1 --2- 172.21.15.53:0/1823582191 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbc900389b0 0x7fbc9003aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:30:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.663+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1823582191 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7fbca8049e30 con 0x7fbcac06f210 2024-04-25T09:30:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.663+0000 7fbcb0e08640 1 --2- 172.21.15.53:0/1823582191 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbc900389b0 0x7fbc9003aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:30:50.648 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.664+0000 7fbcb0e08640 1 --2- 172.21.15.53:0/1823582191 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbc900389b0 0x7fbc9003aec0 crc :-1 s=READY pgs=3803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:30:50.653 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.668+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1823582191 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fbca800fc80 con 0x7fbcac06f210 2024-04-25T09:30:50.837 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.853+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcac131140 con 0x7fbc900389b0 2024-04-25T09:30:50.841 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.856+0000 7fbca1ffb640 1 -- 172.21.15.53:0/1823582191 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109148 (crc 0 0 0) 0x7fbc9c0012b0 con 0x7fbc900389b0 2024-04-25T09:30:50.841 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:30:50.842 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbc900389b0 msgr2=0x7fbc9003aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 --2- 172.21.15.53:0/1823582191 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbc900389b0 0x7fbc9003aec0 crc :-1 s=READY pgs=3803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 msgr2=0x7fbcac1c7960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 --2- 172.21.15.53:0/1823582191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 0x7fbcac1c7960 crc :-1 s=READY pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 shutdown_connections 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 --2- 172.21.15.53:0/1823582191 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbc900389b0 0x7fbc9003aec0 unknown :-1 s=CLOSED pgs=3803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 --2- 172.21.15.53:0/1823582191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcac06f210 0x7fbcac1c7960 unknown :-1 s=CLOSED pgs=13027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 >> 172.21.15.53:0/1823582191 conn(0x7fbcac09f6a0 msgr2=0x7fbcac1b9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 shutdown_connections 2024-04-25T09:30:50.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:30:50.859+0000 7fbcb386d640 1 -- 172.21.15.53:0/1823582191 wait complete. 2024-04-25T09:30:50.855 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":1267,"stamp":"2024-04-25T09:30:49.401813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":296012,"kb_used_data":14700,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419134388,"statfs":{"total":429496729600,"available":429193613312,"internally_reserved":0,"allocated":15052800,"data_stored":6435390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002030"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.613773+0000","last_change":"2024-04-25T09:17:07.201124+0000","last_active":"2024-04-25T09:30:45.613773+0000","last_peered":"2024-04-25T09:30:45.613773+0000","last_clean":"2024-04-25T09:30:45.613773+0000","last_became_active":"2024-04-25T09:17:07.189673+0000","last_became_peered":"2024-04-25T09:17:07.189673+0000","last_unstale":"2024-04-25T09:30:45.613773+0000","last_undegraded":"2024-04-25T09:30:45.613773+0000","last_fullsized":"2024-04-25T09:30:45.613773+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.101648+0000","last_change":"2024-04-25T09:30:49.120274+0000","last_active":"2024-04-25T09:30:49.101648+0000","last_peered":"2024-04-25T09:30:49.101648+0000","last_clean":"2024-04-25T09:30:49.101648+0000","last_became_active":"2024-04-25T09:17:07.216422+0000","last_became_peered":"2024-04-25T09:17:07.216422+0000","last_unstale":"2024-04-25T09:30:49.101648+0000","last_undegraded":"2024-04-25T09:30:49.101648+0000","last_fullsized":"2024-04-25T09:30:49.101648+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.120101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.120101+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.862941+0000","last_change":"2024-04-25T09:17:07.221368+0000","last_active":"2024-04-25T09:30:47.862941+0000","last_peered":"2024-04-25T09:30:47.862941+0000","last_clean":"2024-04-25T09:30:47.862941+0000","last_became_active":"2024-04-25T09:17:07.210105+0000","last_became_peered":"2024-04-25T09:17:07.210105+0000","last_unstale":"2024-04-25T09:30:47.862941+0000","last_undegraded":"2024-04-25T09:30:47.862941+0000","last_fullsized":"2024-04-25T09:30:47.862941+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.633204+0000","last_change":"2024-04-25T09:17:07.259390+0000","last_active":"2024-04-25T09:30:47.633204+0000","last_peered":"2024-04-25T09:30:47.633204+0000","last_clean":"2024-04-25T09:30:47.633204+0000","last_became_active":"2024-04-25T09:17:07.245112+0000","last_became_peered":"2024-04-25T09:17:07.245112+0000","last_unstale":"2024-04-25T09:30:47.633204+0000","last_undegraded":"2024-04-25T09:30:47.633204+0000","last_fullsized":"2024-04-25T09:30:47.633204+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.595494+0000","last_change":"2024-04-25T09:17:07.282257+0000","last_active":"2024-04-25T09:30:45.595494+0000","last_peered":"2024-04-25T09:30:45.595494+0000","last_clean":"2024-04-25T09:30:45.595494+0000","last_became_active":"2024-04-25T09:17:07.266007+0000","last_became_peered":"2024-04-25T09:17:07.266007+0000","last_unstale":"2024-04-25T09:30:45.595494+0000","last_undegraded":"2024-04-25T09:30:45.595494+0000","last_fullsized":"2024-04-25T09:30:45.595494+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.095100+0000","last_change":"2024-04-25T09:30:49.117016+0000","last_active":"2024-04-25T09:30:49.095100+0000","last_peered":"2024-04-25T09:30:49.095100+0000","last_clean":"2024-04-25T09:30:49.095100+0000","last_became_active":"2024-04-25T09:17:07.160621+0000","last_became_peered":"2024-04-25T09:17:07.160621+0000","last_unstale":"2024-04-25T09:30:49.095100+0000","last_undegraded":"2024-04-25T09:30:49.095100+0000","last_fullsized":"2024-04-25T09:30:49.095100+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.116824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.116824+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.095691+0000","last_change":"2024-04-25T09:30:49.113422+0000","last_active":"2024-04-25T09:30:49.095691+0000","last_peered":"2024-04-25T09:30:49.095691+0000","last_clean":"2024-04-25T09:30:49.095691+0000","last_became_active":"2024-04-25T09:17:07.321872+0000","last_became_peered":"2024-04-25T09:17:07.321872+0000","last_unstale":"2024-04-25T09:30:49.095691+0000","last_undegraded":"2024-04-25T09:30:49.095691+0000","last_fullsized":"2024-04-25T09:30:49.095691+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.113123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.113123+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.091650+0000","last_change":"2024-04-25T09:30:49.108893+0000","last_active":"2024-04-25T09:30:49.091650+0000","last_peered":"2024-04-25T09:30:49.091650+0000","last_clean":"2024-04-25T09:30:49.091650+0000","last_became_active":"2024-04-25T09:17:07.266913+0000","last_became_peered":"2024-04-25T09:17:07.266913+0000","last_unstale":"2024-04-25T09:30:49.091650+0000","last_undegraded":"2024-04-25T09:30:49.091650+0000","last_fullsized":"2024-04-25T09:30:49.091650+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.108589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.108589+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.540396+0000","last_change":"2024-04-25T09:17:07.242083+0000","last_active":"2024-04-25T09:30:47.540396+0000","last_peered":"2024-04-25T09:30:47.540396+0000","last_clean":"2024-04-25T09:30:47.540396+0000","last_became_active":"2024-04-25T09:17:07.229886+0000","last_became_peered":"2024-04-25T09:17:07.229886+0000","last_unstale":"2024-04-25T09:30:47.540396+0000","last_undegraded":"2024-04-25T09:30:47.540396+0000","last_fullsized":"2024-04-25T09:30:47.540396+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.830403+0000","last_change":"2024-04-25T09:17:07.206231+0000","last_active":"2024-04-25T09:30:47.830403+0000","last_peered":"2024-04-25T09:30:47.830403+0000","last_clean":"2024-04-25T09:30:47.830403+0000","last_became_active":"2024-04-25T09:17:07.191533+0000","last_became_peered":"2024-04-25T09:17:07.191533+0000","last_unstale":"2024-04-25T09:30:47.830403+0000","last_undegraded":"2024-04-25T09:30:47.830403+0000","last_fullsized":"2024-04-25T09:30:47.830403+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.616035+0000","last_change":"2024-04-25T09:17:07.266661+0000","last_active":"2024-04-25T09:30:47.616035+0000","last_peered":"2024-04-25T09:30:47.616035+0000","last_clean":"2024-04-25T09:30:47.616035+0000","last_became_active":"2024-04-25T09:17:07.251853+0000","last_became_peered":"2024-04-25T09:17:07.251853+0000","last_unstale":"2024-04-25T09:30:47.616035+0000","last_undegraded":"2024-04-25T09:30:47.616035+0000","last_fullsized":"2024-04-25T09:30:47.616035+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.086275+0000","last_change":"2024-04-25T09:30:49.123319+0000","last_active":"2024-04-25T09:30:49.086275+0000","last_peered":"2024-04-25T09:30:49.086275+0000","last_clean":"2024-04-25T09:30:49.086275+0000","last_became_active":"2024-04-25T09:17:07.337829+0000","last_became_peered":"2024-04-25T09:17:07.337829+0000","last_unstale":"2024-04-25T09:30:49.086275+0000","last_undegraded":"2024-04-25T09:30:49.086275+0000","last_fullsized":"2024-04-25T09:30:49.086275+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.123150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.123150+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.594205+0000","last_change":"2024-04-25T09:17:07.285325+0000","last_active":"2024-04-25T09:30:47.594205+0000","last_peered":"2024-04-25T09:30:47.594205+0000","last_clean":"2024-04-25T09:30:47.594205+0000","last_became_active":"2024-04-25T09:17:07.279403+0000","last_became_peered":"2024-04-25T09:17:07.279403+0000","last_unstale":"2024-04-25T09:30:47.594205+0000","last_undegraded":"2024-04-25T09:30:47.594205+0000","last_fullsized":"2024-04-25T09:30:47.594205+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.642775+0000","last_change":"2024-04-25T09:17:07.319308+0000","last_active":"2024-04-25T09:30:47.642775+0000","last_peered":"2024-04-25T09:30:47.642775+0000","last_clean":"2024-04-25T09:30:47.642775+0000","last_became_active":"2024-04-25T09:17:07.313695+0000","last_became_peered":"2024-04-25T09:17:07.313695+0000","last_unstale":"2024-04-25T09:30:47.642775+0000","last_undegraded":"2024-04-25T09:30:47.642775+0000","last_fullsized":"2024-04-25T09:30:47.642775+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.082938+0000","last_change":"2024-04-25T09:30:49.120353+0000","last_active":"2024-04-25T09:30:49.082938+0000","last_peered":"2024-04-25T09:30:49.082938+0000","last_clean":"2024-04-25T09:30:49.082938+0000","last_became_active":"2024-04-25T09:17:07.356955+0000","last_became_peered":"2024-04-25T09:17:07.356955+0000","last_unstale":"2024-04-25T09:30:49.082938+0000","last_undegraded":"2024-04-25T09:30:49.082938+0000","last_fullsized":"2024-04-25T09:30:49.082938+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.120172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.120172+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.083844+0000","last_change":"2024-04-25T09:30:49.121949+0000","last_active":"2024-04-25T09:30:49.083844+0000","last_peered":"2024-04-25T09:30:49.083844+0000","last_clean":"2024-04-25T09:30:49.083844+0000","last_became_active":"2024-04-25T09:17:07.273692+0000","last_became_peered":"2024-04-25T09:17:07.273692+0000","last_unstale":"2024-04-25T09:30:49.083844+0000","last_undegraded":"2024-04-25T09:30:49.083844+0000","last_fullsized":"2024-04-25T09:30:49.083844+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.121767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.121767+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.078958+0000","last_change":"2024-04-25T09:30:49.103336+0000","last_active":"2024-04-25T09:30:49.078958+0000","last_peered":"2024-04-25T09:30:49.078958+0000","last_clean":"2024-04-25T09:30:49.078958+0000","last_became_active":"2024-04-25T09:17:07.258228+0000","last_became_peered":"2024-04-25T09:17:07.258228+0000","last_unstale":"2024-04-25T09:30:49.078958+0000","last_undegraded":"2024-04-25T09:30:49.078958+0000","last_fullsized":"2024-04-25T09:30:49.078958+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.103020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.103020+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.646080+0000","last_change":"2024-04-25T09:17:07.216743+0000","last_active":"2024-04-25T09:30:47.646080+0000","last_peered":"2024-04-25T09:30:47.646080+0000","last_clean":"2024-04-25T09:30:47.646080+0000","last_became_active":"2024-04-25T09:17:07.207791+0000","last_became_peered":"2024-04-25T09:17:07.207791+0000","last_unstale":"2024-04-25T09:30:47.646080+0000","last_undegraded":"2024-04-25T09:30:47.646080+0000","last_fullsized":"2024-04-25T09:30:47.646080+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.847745+0000","last_change":"2024-04-25T09:17:07.216193+0000","last_active":"2024-04-25T09:30:47.847745+0000","last_peered":"2024-04-25T09:30:47.847745+0000","last_clean":"2024-04-25T09:30:47.847745+0000","last_became_active":"2024-04-25T09:17:07.198934+0000","last_became_peered":"2024-04-25T09:17:07.198934+0000","last_unstale":"2024-04-25T09:30:47.847745+0000","last_undegraded":"2024-04-25T09:30:47.847745+0000","last_fullsized":"2024-04-25T09:30:47.847745+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.570627+0000","last_change":"2024-04-25T09:17:07.289029+0000","last_active":"2024-04-25T09:30:45.570627+0000","last_peered":"2024-04-25T09:30:45.570627+0000","last_clean":"2024-04-25T09:30:45.570627+0000","last_became_active":"2024-04-25T09:17:07.274194+0000","last_became_peered":"2024-04-25T09:17:07.274194+0000","last_unstale":"2024-04-25T09:30:45.570627+0000","last_undegraded":"2024-04-25T09:30:45.570627+0000","last_fullsized":"2024-04-25T09:30:45.570627+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.650644+0000","last_change":"2024-04-25T09:17:07.270278+0000","last_active":"2024-04-25T09:30:45.650644+0000","last_peered":"2024-04-25T09:30:45.650644+0000","last_clean":"2024-04-25T09:30:45.650644+0000","last_became_active":"2024-04-25T09:17:07.258040+0000","last_became_peered":"2024-04-25T09:17:07.258040+0000","last_unstale":"2024-04-25T09:30:45.650644+0000","last_undegraded":"2024-04-25T09:30:45.650644+0000","last_fullsized":"2024-04-25T09:30:45.650644+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1299,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.713184+0000","last_change":"2024-04-25T09:17:07.293534+0000","last_active":"2024-04-25T09:30:45.713184+0000","last_peered":"2024-04-25T09:30:45.713184+0000","last_clean":"2024-04-25T09:30:45.713184+0000","last_became_active":"2024-04-25T09:17:07.285972+0000","last_became_peered":"2024-04-25T09:17:07.285972+0000","last_unstale":"2024-04-25T09:30:45.713184+0000","last_undegraded":"2024-04-25T09:30:45.713184+0000","last_fullsized":"2024-04-25T09:30:45.713184+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.846529+0000","last_change":"2024-04-25T09:17:07.239436+0000","last_active":"2024-04-25T09:30:47.846529+0000","last_peered":"2024-04-25T09:30:47.846529+0000","last_clean":"2024-04-25T09:30:47.846529+0000","last_became_active":"2024-04-25T09:17:07.232151+0000","last_became_peered":"2024-04-25T09:17:07.232151+0000","last_unstale":"2024-04-25T09:30:47.846529+0000","last_undegraded":"2024-04-25T09:30:47.846529+0000","last_fullsized":"2024-04-25T09:30:47.846529+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.654258+0000","last_change":"2024-04-25T09:17:07.308904+0000","last_active":"2024-04-25T09:30:47.654258+0000","last_peered":"2024-04-25T09:30:47.654258+0000","last_clean":"2024-04-25T09:30:47.654258+0000","last_became_active":"2024-04-25T09:17:07.302869+0000","last_became_peered":"2024-04-25T09:17:07.302869+0000","last_unstale":"2024-04-25T09:30:47.654258+0000","last_undegraded":"2024-04-25T09:30:47.654258+0000","last_fullsized":"2024-04-25T09:30:47.654258+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.626811+0000","last_change":"2024-04-25T09:17:07.272067+0000","last_active":"2024-04-25T09:30:47.626811+0000","last_peered":"2024-04-25T09:30:47.626811+0000","last_clean":"2024-04-25T09:30:47.626811+0000","last_became_active":"2024-04-25T09:17:07.262656+0000","last_became_peered":"2024-04-25T09:17:07.262656+0000","last_unstale":"2024-04-25T09:30:47.626811+0000","last_undegraded":"2024-04-25T09:30:47.626811+0000","last_fullsized":"2024-04-25T09:30:47.626811+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.074482+0000","last_change":"2024-04-25T09:30:49.097881+0000","last_active":"2024-04-25T09:30:49.074482+0000","last_peered":"2024-04-25T09:30:49.074482+0000","last_clean":"2024-04-25T09:30:49.074482+0000","last_became_active":"2024-04-25T09:17:07.282946+0000","last_became_peered":"2024-04-25T09:17:07.282946+0000","last_unstale":"2024-04-25T09:30:49.074482+0000","last_undegraded":"2024-04-25T09:30:49.074482+0000","last_fullsized":"2024-04-25T09:30:49.074482+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.097564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.097564+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1281,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.573385+0000","last_change":"2024-04-25T09:17:07.247974+0000","last_active":"2024-04-25T09:30:47.573385+0000","last_peered":"2024-04-25T09:30:47.573385+0000","last_clean":"2024-04-25T09:30:47.573385+0000","last_became_active":"2024-04-25T09:17:07.233194+0000","last_became_peered":"2024-04-25T09:17:07.233194+0000","last_unstale":"2024-04-25T09:30:47.573385+0000","last_undegraded":"2024-04-25T09:30:47.573385+0000","last_fullsized":"2024-04-25T09:30:47.573385+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.072450+0000","last_change":"2024-04-25T09:30:49.117832+0000","last_active":"2024-04-25T09:30:49.072450+0000","last_peered":"2024-04-25T09:30:49.072450+0000","last_clean":"2024-04-25T09:30:49.072450+0000","last_became_active":"2024-04-25T09:17:07.297538+0000","last_became_peered":"2024-04-25T09:17:07.297538+0000","last_unstale":"2024-04-25T09:30:49.072450+0000","last_undegraded":"2024-04-25T09:30:49.072450+0000","last_fullsized":"2024-04-25T09:30:49.072450+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.117665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.117665+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.070117+0000","last_change":"2024-04-25T09:30:49.087949+0000","last_active":"2024-04-25T09:30:49.070117+0000","last_peered":"2024-04-25T09:30:49.070117+0000","last_clean":"2024-04-25T09:30:49.070117+0000","last_became_active":"2024-04-25T09:17:07.241694+0000","last_became_peered":"2024-04-25T09:17:07.241694+0000","last_unstale":"2024-04-25T09:30:49.070117+0000","last_undegraded":"2024-04-25T09:30:49.070117+0000","last_fullsized":"2024-04-25T09:30:49.070117+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.087750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.087750+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.068558+0000","last_change":"2024-04-25T09:30:49.111715+0000","last_active":"2024-04-25T09:30:49.068558+0000","last_peered":"2024-04-25T09:30:49.068558+0000","last_clean":"2024-04-25T09:30:49.068558+0000","last_became_active":"2024-04-25T09:17:07.311173+0000","last_became_peered":"2024-04-25T09:17:07.311173+0000","last_unstale":"2024-04-25T09:30:49.068558+0000","last_undegraded":"2024-04-25T09:30:49.068558+0000","last_fullsized":"2024-04-25T09:30:49.068558+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.111479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.111479+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1312,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.660254+0000","last_change":"2024-04-25T09:17:07.199203+0000","last_active":"2024-04-25T09:30:45.660254+0000","last_peered":"2024-04-25T09:30:45.660254+0000","last_clean":"2024-04-25T09:30:45.660254+0000","last_became_active":"2024-04-25T09:17:07.185148+0000","last_became_peered":"2024-04-25T09:17:07.185148+0000","last_unstale":"2024-04-25T09:30:45.660254+0000","last_undegraded":"2024-04-25T09:30:45.660254+0000","last_fullsized":"2024-04-25T09:30:45.660254+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1293,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.817922+0000","last_change":"2024-04-25T09:17:07.204194+0000","last_active":"2024-04-25T09:30:47.817922+0000","last_peered":"2024-04-25T09:30:47.817922+0000","last_clean":"2024-04-25T09:30:47.817922+0000","last_became_active":"2024-04-25T09:17:07.194953+0000","last_became_peered":"2024-04-25T09:17:07.194953+0000","last_unstale":"2024-04-25T09:30:47.817922+0000","last_undegraded":"2024-04-25T09:30:47.817922+0000","last_fullsized":"2024-04-25T09:30:47.817922+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:17:06.004280+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1896,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.688406+0000","last_change":"2024-04-25T09:12:15.261642+0000","last_active":"2024-04-25T09:30:45.688406+0000","last_peered":"2024-04-25T09:30:45.688406+0000","last_clean":"2024-04-25T09:30:45.688406+0000","last_became_active":"2024-04-25T09:12:15.255284+0000","last_became_peered":"2024-04-25T09:12:15.255284+0000","last_unstale":"2024-04-25T09:30:45.688406+0000","last_undegraded":"2024-04-25T09:30:45.688406+0000","last_fullsized":"2024-04-25T09:30:45.688406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1892,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.890611+0000","last_change":"2024-04-25T09:12:15.237133+0000","last_active":"2024-04-25T09:30:47.890611+0000","last_peered":"2024-04-25T09:30:47.890611+0000","last_clean":"2024-04-25T09:30:47.890611+0000","last_became_active":"2024-04-25T09:12:15.231593+0000","last_became_peered":"2024-04-25T09:12:15.231593+0000","last_unstale":"2024-04-25T09:30:47.890611+0000","last_undegraded":"2024-04-25T09:30:47.890611+0000","last_fullsized":"2024-04-25T09:30:47.890611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1878,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.721828+0000","last_change":"2024-04-25T09:12:15.244463+0000","last_active":"2024-04-25T09:30:47.721828+0000","last_peered":"2024-04-25T09:30:47.721828+0000","last_clean":"2024-04-25T09:30:47.721828+0000","last_became_active":"2024-04-25T09:12:15.239187+0000","last_became_peered":"2024-04-25T09:12:15.239187+0000","last_unstale":"2024-04-25T09:30:47.721828+0000","last_undegraded":"2024-04-25T09:30:47.721828+0000","last_fullsized":"2024-04-25T09:30:47.721828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1892,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.811731+0000","last_change":"2024-04-25T09:12:15.226592+0000","last_active":"2024-04-25T09:30:47.811731+0000","last_peered":"2024-04-25T09:30:47.811731+0000","last_clean":"2024-04-25T09:30:47.811731+0000","last_became_active":"2024-04-25T09:12:15.221443+0000","last_became_peered":"2024-04-25T09:12:15.221443+0000","last_unstale":"2024-04-25T09:30:47.811731+0000","last_undegraded":"2024-04-25T09:30:47.811731+0000","last_fullsized":"2024-04-25T09:30:47.811731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1894,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.068489+0000","last_change":"2024-04-25T09:30:49.108049+0000","last_active":"2024-04-25T09:30:49.068489+0000","last_peered":"2024-04-25T09:30:49.068489+0000","last_clean":"2024-04-25T09:30:49.068489+0000","last_became_active":"2024-04-25T09:12:15.236080+0000","last_became_peered":"2024-04-25T09:12:15.236080+0000","last_unstale":"2024-04-25T09:30:49.068489+0000","last_undegraded":"2024-04-25T09:30:49.068489+0000","last_fullsized":"2024-04-25T09:30:49.068489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.107871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.107871+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1896,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.704043+0000","last_change":"2024-04-25T09:12:15.245278+0000","last_active":"2024-04-25T09:30:45.704043+0000","last_peered":"2024-04-25T09:30:45.704043+0000","last_clean":"2024-04-25T09:30:45.704043+0000","last_became_active":"2024-04-25T09:12:15.239643+0000","last_became_peered":"2024-04-25T09:12:15.239643+0000","last_unstale":"2024-04-25T09:30:45.704043+0000","last_undegraded":"2024-04-25T09:30:45.704043+0000","last_fullsized":"2024-04-25T09:30:45.704043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1894,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.068492+0000","last_change":"2024-04-25T09:30:49.077618+0000","last_active":"2024-04-25T09:30:49.068492+0000","last_peered":"2024-04-25T09:30:49.068492+0000","last_clean":"2024-04-25T09:30:49.068492+0000","last_became_active":"2024-04-25T09:12:15.241282+0000","last_became_peered":"2024-04-25T09:12:15.241282+0000","last_unstale":"2024-04-25T09:30:49.068492+0000","last_undegraded":"2024-04-25T09:30:49.068492+0000","last_fullsized":"2024-04-25T09:30:49.068492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.077436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.077436+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1896,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.697751+0000","last_change":"2024-04-25T09:12:15.257926+0000","last_active":"2024-04-25T09:30:45.697751+0000","last_peered":"2024-04-25T09:30:45.697751+0000","last_clean":"2024-04-25T09:30:45.697751+0000","last_became_active":"2024-04-25T09:12:15.252630+0000","last_became_peered":"2024-04-25T09:12:15.252630+0000","last_unstale":"2024-04-25T09:30:45.697751+0000","last_undegraded":"2024-04-25T09:30:45.697751+0000","last_fullsized":"2024-04-25T09:30:45.697751+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:14.173556+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2014,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.602107+0000","last_change":"2024-04-25T09:12:12.208622+0000","last_active":"2024-04-25T09:30:47.602107+0000","last_peered":"2024-04-25T09:30:47.602107+0000","last_clean":"2024-04-25T09:30:47.602107+0000","last_became_active":"2024-04-25T09:12:12.203665+0000","last_became_peered":"2024-04-25T09:12:12.203665+0000","last_unstale":"2024-04-25T09:30:47.602107+0000","last_undegraded":"2024-04-25T09:30:47.602107+0000","last_fullsized":"2024-04-25T09:30:47.602107+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:11.160311+0000","last_clean_scrub_stamp":"2024-04-25T09:12:11.160311+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79492,"kb_used_data":3964,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778108,"statfs":{"total":107374182400,"available":107292782592,"internally_reserved":0,"allocated":4059136,"data_stored":1916994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":78932,"kb_used_data":3404,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778668,"statfs":{"total":107374182400,"available":107293356032,"internally_reserved":0,"allocated":3485696,"data_stored":1315002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":66420,"kb_used_data":3372,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104791180,"statfs":{"total":107374182400,"available":107306168320,"internally_reserved":0,"allocated":3452928,"data_stored":1306158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71168,"kb_used_data":3960,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786432,"statfs":{"total":107374182400,"available":107301306368,"internally_reserved":0,"allocated":4055040,"data_stored":1897236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:50.860 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.860 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.860 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.860 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.860 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.860 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.860 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.861 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.861 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.861 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.861 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.861 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.861 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.861 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.861 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.862 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.862 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.862 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.862 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.862 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-04-25T09:17:06.004280+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=17, tm_sec=6, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.862 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T09:12:14.173556+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=12, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.862 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T09:12:14.173556+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=12, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.862 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T09:12:14.173556+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=12, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.862 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T09:12:14.173556+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=12, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.863 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T09:12:14.173556+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=12, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.863 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T09:12:14.173556+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=12, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.863 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T09:12:11.160311+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=12, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=30, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:30:50.863 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T09:31:10.864 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:31:10.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:10.997+0000 7fbdf2d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.003+0000 7fbdf2d9d640 1 Processor -- start 2024-04-25T09:31:10.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.003+0000 7fbdf2d9d640 1 -- start start 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.004+0000 7fbdf2d9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbdec134dc0 0x7fbdec1371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.004+0000 7fbdf2d9d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdec12c280 con 0x7fbdec12b760 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.004+0000 7fbdf2d9d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbdec09ce80 con 0x7fbdec134dc0 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.004+0000 7fbdebfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbdec134dc0 0x7fbdec1371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.004+0000 7fbdf0b39640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbdec12b760 0x7fbdec12bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33060/0 (socket says 172.21.15.53:33060) 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.004+0000 7fbdf0b39640 1 -- 172.21.15.53:0/3844856209 learned_addr learned my addr 172.21.15.53:0/3844856209 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.005+0000 7fbdebfff640 1 -- 172.21.15.53:0/3844856209 >> v1:172.21.15.53:6789/0 conn(0x7fbdec12b760 legacy=0x7fbdec12bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.005+0000 7fbdebfff640 1 -- 172.21.15.53:0/3844856209 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec09dd50 con 0x7fbdec134dc0 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.005+0000 7fbdebfff640 1 --2- 172.21.15.53:0/3844856209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec134dc0 0x7fbdec1371e0 crc :-1 s=READY pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7204b13ddc0fb31f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.005+0000 7fbdeb7fe640 1 -- 172.21.15.53:0/3844856209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbde0009d90 con 0x7fbdec134dc0 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.005+0000 7fbdeb7fe640 1 -- 172.21.15.53:0/3844856209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbde000e230 con 0x7fbdec134dc0 2024-04-25T09:31:10.990 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.005+0000 7fbdeb7fe640 1 -- 172.21.15.53:0/3844856209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbde000e4d0 con 0x7fbdec134dc0 2024-04-25T09:31:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.006+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/3844856209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec134dc0 msgr2=0x7fbdec1371e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:31:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.006+0000 7fbdf2d9d640 1 --2- 172.21.15.53:0/3844856209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec134dc0 0x7fbdec1371e0 crc :-1 s=READY pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.006+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/3844856209 shutdown_connections 2024-04-25T09:31:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.006+0000 7fbdf2d9d640 1 --2- 172.21.15.53:0/3844856209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec134dc0 0x7fbdec1371e0 unknown :-1 s=CLOSED pgs=13029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.006+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/3844856209 >> 172.21.15.53:0/3844856209 conn(0x7fbdec0a0950 msgr2=0x7fbdec0a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:31:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.006+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/3844856209 shutdown_connections 2024-04-25T09:31:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.006+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/3844856209 wait complete. 2024-04-25T09:31:10.993 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.006+0000 7fbdf2d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.008+0000 7fbdf2d9d640 1 Processor -- start 2024-04-25T09:31:10.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.008+0000 7fbdf2d9d640 1 -- start start 2024-04-25T09:31:10.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbdf2d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec12b760 0x7fbdec1c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:31:10.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbdf2d9d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec11c180 con 0x7fbdec12b760 2024-04-25T09:31:10.995 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbdf0b39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec12b760 0x7fbdec1c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:31:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbdf0b39640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec12b760 0x7fbdec1c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57624/0 (socket says 172.21.15.53:57624) 2024-04-25T09:31:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbdf0b39640 1 -- 172.21.15.53:0/560362631 learned_addr learned my addr 172.21.15.53:0/560362631 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:31:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbdf0b39640 1 -- 172.21.15.53:0/560362631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec1c7520 con 0x7fbdec12b760 2024-04-25T09:31:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbdf0b39640 1 --2- 172.21.15.53:0/560362631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec12b760 0x7fbdec1c79e0 crc :-1 s=READY pgs=13030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:31:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbde97fa640 1 -- 172.21.15.53:0/560362631 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbde40070b0 con 0x7fbdec12b760 2024-04-25T09:31:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdec11cd20 con 0x7fbdec12b760 2024-04-25T09:31:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbde97fa640 1 -- 172.21.15.53:0/560362631 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbde4007210 con 0x7fbdec12b760 2024-04-25T09:31:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbde97fa640 1 -- 172.21.15.53:0/560362631 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbde40074b0 con 0x7fbdec12b760 2024-04-25T09:31:10.996 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.010+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdec11b890 con 0x7fbdec12b760 2024-04-25T09:31:10.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.011+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdec11bf40 con 0x7fbdec12b760 2024-04-25T09:31:10.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.011+0000 7fbde97fa640 1 -- 172.21.15.53:0/560362631 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fbde40076b0 con 0x7fbdec12b760 2024-04-25T09:31:10.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.012+0000 7fbde97fa640 1 --2- 172.21.15.53:0/560362631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbdd8038930 0x7fbdd803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:31:10.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.012+0000 7fbde97fa640 1 -- 172.21.15.53:0/560362631 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7fbde4048c50 con 0x7fbdec12b760 2024-04-25T09:31:10.997 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.012+0000 7fbdebfff640 1 --2- 172.21.15.53:0/560362631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbdd8038930 0x7fbdd803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:31:10.998 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.013+0000 7fbdebfff640 1 --2- 172.21.15.53:0/560362631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbdd8038930 0x7fbdd803ae40 crc :-1 s=READY pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:31:11.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.017+0000 7fbde97fa640 1 -- 172.21.15.53:0/560362631 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fbde40092e0 con 0x7fbdec12b760 2024-04-25T09:31:11.185 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.201+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 --> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbdec09c9d0 con 0x7fbdd8038930 2024-04-25T09:31:11.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.204+0000 7fbde97fa640 1 -- 172.21.15.53:0/560362631 <== mgr.4098 v2:172.21.15.151:6800/1387723690 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109138 (crc 0 0 0) 0x7fbde0009e00 con 0x7fbdd8038930 2024-04-25T09:31:11.191 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-04-25T09:31:11.192 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-04-25T09:31:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbdd8038930 msgr2=0x7fbdd803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:31:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 --2- 172.21.15.53:0/560362631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbdd8038930 0x7fbdd803ae40 crc :-1 s=READY pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec12b760 msgr2=0x7fbdec1c79e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:31:11.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 --2- 172.21.15.53:0/560362631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec12b760 0x7fbdec1c79e0 crc :-1 s=READY pgs=13030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 shutdown_connections 2024-04-25T09:31:11.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 --2- 172.21.15.53:0/560362631 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fbdd8038930 0x7fbdd803ae40 unknown :-1 s=CLOSED pgs=3804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 --2- 172.21.15.53:0/560362631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbdec12b760 0x7fbdec1c79e0 unknown :-1 s=CLOSED pgs=13030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 >> 172.21.15.53:0/560362631 conn(0x7fbdec0a0950 msgr2=0x7fbdec12e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:31:11.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 shutdown_connections 2024-04-25T09:31:11.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.207+0000 7fbdf2d9d640 1 -- 172.21.15.53:0/560362631 wait complete. 2024-04-25T09:31:11.203 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":1277,"stamp":"2024-04-25T09:31:09.407644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":296012,"kb_used_data":14700,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419134388,"statfs":{"total":429496729600,"available":429193613312,"internally_reserved":0,"allocated":15052800,"data_stored":6435390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003309"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1301,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.579349+0000","last_change":"2024-04-25T09:30:49.595437+0000","last_active":"2024-04-25T09:30:49.579349+0000","last_peered":"2024-04-25T09:30:49.579349+0000","last_clean":"2024-04-25T09:30:49.579349+0000","last_became_active":"2024-04-25T09:17:07.189673+0000","last_became_peered":"2024-04-25T09:17:07.189673+0000","last_unstale":"2024-04-25T09:30:49.579349+0000","last_undegraded":"2024-04-25T09:30:49.579349+0000","last_fullsized":"2024-04-25T09:30:49.579349+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.595270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.595270+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.101648+0000","last_change":"2024-04-25T09:30:49.120274+0000","last_active":"2024-04-25T09:30:49.101648+0000","last_peered":"2024-04-25T09:30:49.101648+0000","last_clean":"2024-04-25T09:30:49.101648+0000","last_became_active":"2024-04-25T09:17:07.216422+0000","last_became_peered":"2024-04-25T09:17:07.216422+0000","last_unstale":"2024-04-25T09:30:49.101648+0000","last_undegraded":"2024-04-25T09:30:49.101648+0000","last_fullsized":"2024-04-25T09:30:49.101648+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.120101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.120101+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.060354+0000","last_change":"2024-04-25T09:30:50.075899+0000","last_active":"2024-04-25T09:30:50.060354+0000","last_peered":"2024-04-25T09:30:50.060354+0000","last_clean":"2024-04-25T09:30:50.060354+0000","last_became_active":"2024-04-25T09:17:07.210105+0000","last_became_peered":"2024-04-25T09:17:07.210105+0000","last_unstale":"2024-04-25T09:30:50.060354+0000","last_undegraded":"2024-04-25T09:30:50.060354+0000","last_fullsized":"2024-04-25T09:30:50.060354+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.075703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.075703+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.555859+0000","last_change":"2024-04-25T09:30:50.585228+0000","last_active":"2024-04-25T09:30:50.555859+0000","last_peered":"2024-04-25T09:30:50.555859+0000","last_clean":"2024-04-25T09:30:50.555859+0000","last_became_active":"2024-04-25T09:17:07.245112+0000","last_became_peered":"2024-04-25T09:17:07.245112+0000","last_unstale":"2024-04-25T09:30:50.555859+0000","last_undegraded":"2024-04-25T09:30:50.555859+0000","last_fullsized":"2024-04-25T09:30:50.555859+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.585051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.585051+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1301,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.574880+0000","last_change":"2024-04-25T09:30:49.599985+0000","last_active":"2024-04-25T09:30:49.574880+0000","last_peered":"2024-04-25T09:30:49.574880+0000","last_clean":"2024-04-25T09:30:49.574880+0000","last_became_active":"2024-04-25T09:17:07.266007+0000","last_became_peered":"2024-04-25T09:17:07.266007+0000","last_unstale":"2024-04-25T09:30:49.574880+0000","last_undegraded":"2024-04-25T09:30:49.574880+0000","last_fullsized":"2024-04-25T09:30:49.574880+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.599808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.599808+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.095100+0000","last_change":"2024-04-25T09:30:49.117016+0000","last_active":"2024-04-25T09:30:49.095100+0000","last_peered":"2024-04-25T09:30:49.095100+0000","last_clean":"2024-04-25T09:30:49.095100+0000","last_became_active":"2024-04-25T09:17:07.160621+0000","last_became_peered":"2024-04-25T09:17:07.160621+0000","last_unstale":"2024-04-25T09:30:49.095100+0000","last_undegraded":"2024-04-25T09:30:49.095100+0000","last_fullsized":"2024-04-25T09:30:49.095100+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.116824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.116824+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.095691+0000","last_change":"2024-04-25T09:30:49.113422+0000","last_active":"2024-04-25T09:30:49.095691+0000","last_peered":"2024-04-25T09:30:49.095691+0000","last_clean":"2024-04-25T09:30:49.095691+0000","last_became_active":"2024-04-25T09:17:07.321872+0000","last_became_peered":"2024-04-25T09:17:07.321872+0000","last_unstale":"2024-04-25T09:30:49.095691+0000","last_undegraded":"2024-04-25T09:30:49.095691+0000","last_fullsized":"2024-04-25T09:30:49.095691+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.113123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.113123+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.091650+0000","last_change":"2024-04-25T09:30:49.108893+0000","last_active":"2024-04-25T09:30:49.091650+0000","last_peered":"2024-04-25T09:30:49.091650+0000","last_clean":"2024-04-25T09:30:49.091650+0000","last_became_active":"2024-04-25T09:17:07.266913+0000","last_became_peered":"2024-04-25T09:17:07.266913+0000","last_unstale":"2024-04-25T09:30:49.091650+0000","last_undegraded":"2024-04-25T09:30:49.091650+0000","last_fullsized":"2024-04-25T09:30:49.091650+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.108589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.108589+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.554077+0000","last_change":"2024-04-25T09:30:50.581541+0000","last_active":"2024-04-25T09:30:50.554077+0000","last_peered":"2024-04-25T09:30:50.554077+0000","last_clean":"2024-04-25T09:30:50.554077+0000","last_became_active":"2024-04-25T09:17:07.229886+0000","last_became_peered":"2024-04-25T09:17:07.229886+0000","last_unstale":"2024-04-25T09:30:50.554077+0000","last_undegraded":"2024-04-25T09:30:50.554077+0000","last_fullsized":"2024-04-25T09:30:50.554077+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.581354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.581354+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.056910+0000","last_change":"2024-04-25T09:30:50.074743+0000","last_active":"2024-04-25T09:30:50.056910+0000","last_peered":"2024-04-25T09:30:50.056910+0000","last_clean":"2024-04-25T09:30:50.056910+0000","last_became_active":"2024-04-25T09:17:07.191533+0000","last_became_peered":"2024-04-25T09:17:07.191533+0000","last_unstale":"2024-04-25T09:30:50.056910+0000","last_undegraded":"2024-04-25T09:30:50.056910+0000","last_fullsized":"2024-04-25T09:30:50.056910+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.074509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.074509+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.548505+0000","last_change":"2024-04-25T09:30:50.586665+0000","last_active":"2024-04-25T09:30:50.548505+0000","last_peered":"2024-04-25T09:30:50.548505+0000","last_clean":"2024-04-25T09:30:50.548505+0000","last_became_active":"2024-04-25T09:17:07.251853+0000","last_became_peered":"2024-04-25T09:17:07.251853+0000","last_unstale":"2024-04-25T09:30:50.548505+0000","last_undegraded":"2024-04-25T09:30:50.548505+0000","last_fullsized":"2024-04-25T09:30:50.548505+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.586474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.586474+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.086275+0000","last_change":"2024-04-25T09:30:49.123319+0000","last_active":"2024-04-25T09:30:49.086275+0000","last_peered":"2024-04-25T09:30:49.086275+0000","last_clean":"2024-04-25T09:30:49.086275+0000","last_became_active":"2024-04-25T09:17:07.337829+0000","last_became_peered":"2024-04-25T09:17:07.337829+0000","last_unstale":"2024-04-25T09:30:49.086275+0000","last_undegraded":"2024-04-25T09:30:49.086275+0000","last_fullsized":"2024-04-25T09:30:49.086275+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.123150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.123150+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.545090+0000","last_change":"2024-04-25T09:30:50.576758+0000","last_active":"2024-04-25T09:30:50.545090+0000","last_peered":"2024-04-25T09:30:50.545090+0000","last_clean":"2024-04-25T09:30:50.545090+0000","last_became_active":"2024-04-25T09:17:07.279403+0000","last_became_peered":"2024-04-25T09:17:07.279403+0000","last_unstale":"2024-04-25T09:30:50.545090+0000","last_undegraded":"2024-04-25T09:30:50.545090+0000","last_fullsized":"2024-04-25T09:30:50.545090+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.576579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.576579+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.540490+0000","last_change":"2024-04-25T09:30:50.578906+0000","last_active":"2024-04-25T09:30:50.540490+0000","last_peered":"2024-04-25T09:30:50.540490+0000","last_clean":"2024-04-25T09:30:50.540490+0000","last_became_active":"2024-04-25T09:17:07.313695+0000","last_became_peered":"2024-04-25T09:17:07.313695+0000","last_unstale":"2024-04-25T09:30:50.540490+0000","last_undegraded":"2024-04-25T09:30:50.540490+0000","last_fullsized":"2024-04-25T09:30:50.540490+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.578726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.578726+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.082938+0000","last_change":"2024-04-25T09:30:49.120353+0000","last_active":"2024-04-25T09:30:49.082938+0000","last_peered":"2024-04-25T09:30:49.082938+0000","last_clean":"2024-04-25T09:30:49.082938+0000","last_became_active":"2024-04-25T09:17:07.356955+0000","last_became_peered":"2024-04-25T09:17:07.356955+0000","last_unstale":"2024-04-25T09:30:49.082938+0000","last_undegraded":"2024-04-25T09:30:49.082938+0000","last_fullsized":"2024-04-25T09:30:49.082938+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.120172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.120172+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.083844+0000","last_change":"2024-04-25T09:30:49.121949+0000","last_active":"2024-04-25T09:30:49.083844+0000","last_peered":"2024-04-25T09:30:49.083844+0000","last_clean":"2024-04-25T09:30:49.083844+0000","last_became_active":"2024-04-25T09:17:07.273692+0000","last_became_peered":"2024-04-25T09:17:07.273692+0000","last_unstale":"2024-04-25T09:30:49.083844+0000","last_undegraded":"2024-04-25T09:30:49.083844+0000","last_fullsized":"2024-04-25T09:30:49.083844+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.121767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.121767+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.078958+0000","last_change":"2024-04-25T09:30:49.103336+0000","last_active":"2024-04-25T09:30:49.078958+0000","last_peered":"2024-04-25T09:30:49.078958+0000","last_clean":"2024-04-25T09:30:49.078958+0000","last_became_active":"2024-04-25T09:17:07.258228+0000","last_became_peered":"2024-04-25T09:17:07.258228+0000","last_unstale":"2024-04-25T09:30:49.078958+0000","last_undegraded":"2024-04-25T09:30:49.078958+0000","last_fullsized":"2024-04-25T09:30:49.078958+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.103020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.103020+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.538846+0000","last_change":"2024-04-25T09:30:50.573987+0000","last_active":"2024-04-25T09:30:50.538846+0000","last_peered":"2024-04-25T09:30:50.538846+0000","last_clean":"2024-04-25T09:30:50.538846+0000","last_became_active":"2024-04-25T09:17:07.207791+0000","last_became_peered":"2024-04-25T09:17:07.207791+0000","last_unstale":"2024-04-25T09:30:50.538846+0000","last_undegraded":"2024-04-25T09:30:50.538846+0000","last_fullsized":"2024-04-25T09:30:50.538846+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.573805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.573805+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.055334+0000","last_change":"2024-04-25T09:30:50.070853+0000","last_active":"2024-04-25T09:30:50.055334+0000","last_peered":"2024-04-25T09:30:50.055334+0000","last_clean":"2024-04-25T09:30:50.055334+0000","last_became_active":"2024-04-25T09:17:07.198934+0000","last_became_peered":"2024-04-25T09:17:07.198934+0000","last_unstale":"2024-04-25T09:30:50.055334+0000","last_undegraded":"2024-04-25T09:30:50.055334+0000","last_fullsized":"2024-04-25T09:30:50.055334+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.070633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.070633+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1301,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.573140+0000","last_change":"2024-04-25T09:30:49.601391+0000","last_active":"2024-04-25T09:30:49.573140+0000","last_peered":"2024-04-25T09:30:49.573140+0000","last_clean":"2024-04-25T09:30:49.573140+0000","last_became_active":"2024-04-25T09:17:07.274194+0000","last_became_peered":"2024-04-25T09:17:07.274194+0000","last_unstale":"2024-04-25T09:30:49.573140+0000","last_undegraded":"2024-04-25T09:30:49.573140+0000","last_fullsized":"2024-04-25T09:30:49.573140+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.601225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.601225+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1301,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.569860+0000","last_change":"2024-04-25T09:30:49.598474+0000","last_active":"2024-04-25T09:30:49.569860+0000","last_peered":"2024-04-25T09:30:49.569860+0000","last_clean":"2024-04-25T09:30:49.569860+0000","last_became_active":"2024-04-25T09:17:07.258040+0000","last_became_peered":"2024-04-25T09:17:07.258040+0000","last_unstale":"2024-04-25T09:30:49.569860+0000","last_undegraded":"2024-04-25T09:30:49.569860+0000","last_fullsized":"2024-04-25T09:30:49.569860+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.598286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.598286+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1301,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.567657+0000","last_change":"2024-04-25T09:30:49.596580+0000","last_active":"2024-04-25T09:30:49.567657+0000","last_peered":"2024-04-25T09:30:49.567657+0000","last_clean":"2024-04-25T09:30:49.567657+0000","last_became_active":"2024-04-25T09:17:07.285972+0000","last_became_peered":"2024-04-25T09:17:07.285972+0000","last_unstale":"2024-04-25T09:30:49.567657+0000","last_undegraded":"2024-04-25T09:30:49.567657+0000","last_fullsized":"2024-04-25T09:30:49.567657+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.596415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.596415+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.053699+0000","last_change":"2024-04-25T09:30:50.072465+0000","last_active":"2024-04-25T09:30:50.053699+0000","last_peered":"2024-04-25T09:30:50.053699+0000","last_clean":"2024-04-25T09:30:50.053699+0000","last_became_active":"2024-04-25T09:17:07.232151+0000","last_became_peered":"2024-04-25T09:17:07.232151+0000","last_unstale":"2024-04-25T09:30:50.053699+0000","last_undegraded":"2024-04-25T09:30:50.053699+0000","last_fullsized":"2024-04-25T09:30:50.053699+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.072252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.072252+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.536901+0000","last_change":"2024-04-25T09:30:50.571706+0000","last_active":"2024-04-25T09:30:50.536901+0000","last_peered":"2024-04-25T09:30:50.536901+0000","last_clean":"2024-04-25T09:30:50.536901+0000","last_became_active":"2024-04-25T09:17:07.302869+0000","last_became_peered":"2024-04-25T09:17:07.302869+0000","last_unstale":"2024-04-25T09:30:50.536901+0000","last_undegraded":"2024-04-25T09:30:50.536901+0000","last_fullsized":"2024-04-25T09:30:50.536901+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.571520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.571520+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.535193+0000","last_change":"2024-04-25T09:30:50.569425+0000","last_active":"2024-04-25T09:30:50.535193+0000","last_peered":"2024-04-25T09:30:50.535193+0000","last_clean":"2024-04-25T09:30:50.535193+0000","last_became_active":"2024-04-25T09:17:07.262656+0000","last_became_peered":"2024-04-25T09:17:07.262656+0000","last_unstale":"2024-04-25T09:30:50.535193+0000","last_undegraded":"2024-04-25T09:30:50.535193+0000","last_fullsized":"2024-04-25T09:30:50.535193+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.569221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.569221+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.074482+0000","last_change":"2024-04-25T09:30:49.097881+0000","last_active":"2024-04-25T09:30:49.074482+0000","last_peered":"2024-04-25T09:30:49.074482+0000","last_clean":"2024-04-25T09:30:49.074482+0000","last_became_active":"2024-04-25T09:17:07.282946+0000","last_became_peered":"2024-04-25T09:17:07.282946+0000","last_unstale":"2024-04-25T09:30:49.074482+0000","last_undegraded":"2024-04-25T09:30:49.074482+0000","last_fullsized":"2024-04-25T09:30:49.074482+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.097564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.097564+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1283,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.533459+0000","last_change":"2024-04-25T09:30:50.568392+0000","last_active":"2024-04-25T09:30:50.533459+0000","last_peered":"2024-04-25T09:30:50.533459+0000","last_clean":"2024-04-25T09:30:50.533459+0000","last_became_active":"2024-04-25T09:17:07.233194+0000","last_became_peered":"2024-04-25T09:17:07.233194+0000","last_unstale":"2024-04-25T09:30:50.533459+0000","last_undegraded":"2024-04-25T09:30:50.533459+0000","last_fullsized":"2024-04-25T09:30:50.533459+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.568189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.568189+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.072450+0000","last_change":"2024-04-25T09:30:49.117832+0000","last_active":"2024-04-25T09:30:49.072450+0000","last_peered":"2024-04-25T09:30:49.072450+0000","last_clean":"2024-04-25T09:30:49.072450+0000","last_became_active":"2024-04-25T09:17:07.297538+0000","last_became_peered":"2024-04-25T09:17:07.297538+0000","last_unstale":"2024-04-25T09:30:49.072450+0000","last_undegraded":"2024-04-25T09:30:49.072450+0000","last_fullsized":"2024-04-25T09:30:49.072450+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.117665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.117665+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.070117+0000","last_change":"2024-04-25T09:30:49.087949+0000","last_active":"2024-04-25T09:30:49.070117+0000","last_peered":"2024-04-25T09:30:49.070117+0000","last_clean":"2024-04-25T09:30:49.070117+0000","last_became_active":"2024-04-25T09:17:07.241694+0000","last_became_peered":"2024-04-25T09:17:07.241694+0000","last_unstale":"2024-04-25T09:30:49.070117+0000","last_undegraded":"2024-04-25T09:30:49.070117+0000","last_fullsized":"2024-04-25T09:30:49.070117+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.087750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.087750+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1287,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.068558+0000","last_change":"2024-04-25T09:30:49.111715+0000","last_active":"2024-04-25T09:30:49.068558+0000","last_peered":"2024-04-25T09:30:49.068558+0000","last_clean":"2024-04-25T09:30:49.068558+0000","last_became_active":"2024-04-25T09:17:07.311173+0000","last_became_peered":"2024-04-25T09:17:07.311173+0000","last_unstale":"2024-04-25T09:30:49.068558+0000","last_undegraded":"2024-04-25T09:30:49.068558+0000","last_fullsized":"2024-04-25T09:30:49.068558+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.111479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.111479+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1314,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.565412+0000","last_change":"2024-04-25T09:30:49.593669+0000","last_active":"2024-04-25T09:30:49.565412+0000","last_peered":"2024-04-25T09:30:49.565412+0000","last_clean":"2024-04-25T09:30:49.565412+0000","last_became_active":"2024-04-25T09:17:07.185148+0000","last_became_peered":"2024-04-25T09:17:07.185148+0000","last_unstale":"2024-04-25T09:30:49.565412+0000","last_undegraded":"2024-04-25T09:30:49.565412+0000","last_fullsized":"2024-04-25T09:30:49.565412+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-04-25T09:30:49.593487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.593487+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1295,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.052329+0000","last_change":"2024-04-25T09:30:50.068930+0000","last_active":"2024-04-25T09:30:50.052329+0000","last_peered":"2024-04-25T09:30:50.052329+0000","last_clean":"2024-04-25T09:30:50.052329+0000","last_became_active":"2024-04-25T09:17:07.194953+0000","last_became_peered":"2024-04-25T09:17:07.194953+0000","last_unstale":"2024-04-25T09:30:50.052329+0000","last_undegraded":"2024-04-25T09:30:50.052329+0000","last_fullsized":"2024-04-25T09:30:50.052329+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.068710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.068710+0000","last_clean_scrub_stamp":"2024-04-25T09:17:06.004280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1898,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.565203+0000","last_change":"2024-04-25T09:30:49.593547+0000","last_active":"2024-04-25T09:30:49.565203+0000","last_peered":"2024-04-25T09:30:49.565203+0000","last_clean":"2024-04-25T09:30:49.565203+0000","last_became_active":"2024-04-25T09:12:15.255284+0000","last_became_peered":"2024-04-25T09:12:15.255284+0000","last_unstale":"2024-04-25T09:30:49.565203+0000","last_undegraded":"2024-04-25T09:30:49.565203+0000","last_fullsized":"2024-04-25T09:30:49.565203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.593263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.593263+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1894,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.052192+0000","last_change":"2024-04-25T09:30:50.072929+0000","last_active":"2024-04-25T09:30:50.052192+0000","last_peered":"2024-04-25T09:30:50.052192+0000","last_clean":"2024-04-25T09:30:50.052192+0000","last_became_active":"2024-04-25T09:12:15.231593+0000","last_became_peered":"2024-04-25T09:12:15.231593+0000","last_unstale":"2024-04-25T09:30:50.052192+0000","last_undegraded":"2024-04-25T09:30:50.052192+0000","last_fullsized":"2024-04-25T09:30:50.052192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.072721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.072721+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1880,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.531429+0000","last_change":"2024-04-25T09:30:50.566319+0000","last_active":"2024-04-25T09:30:50.531429+0000","last_peered":"2024-04-25T09:30:50.531429+0000","last_clean":"2024-04-25T09:30:50.531429+0000","last_became_active":"2024-04-25T09:12:15.239187+0000","last_became_peered":"2024-04-25T09:12:15.239187+0000","last_unstale":"2024-04-25T09:30:50.531429+0000","last_undegraded":"2024-04-25T09:30:50.531429+0000","last_fullsized":"2024-04-25T09:30:50.531429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.565995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.565995+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1894,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.050513+0000","last_change":"2024-04-25T09:30:50.065938+0000","last_active":"2024-04-25T09:30:50.050513+0000","last_peered":"2024-04-25T09:30:50.050513+0000","last_clean":"2024-04-25T09:30:50.050513+0000","last_became_active":"2024-04-25T09:12:15.221443+0000","last_became_peered":"2024-04-25T09:12:15.221443+0000","last_unstale":"2024-04-25T09:30:50.050513+0000","last_undegraded":"2024-04-25T09:30:50.050513+0000","last_fullsized":"2024-04-25T09:30:50.050513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:50.065702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.065702+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1894,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.068489+0000","last_change":"2024-04-25T09:30:49.108049+0000","last_active":"2024-04-25T09:30:49.068489+0000","last_peered":"2024-04-25T09:30:49.068489+0000","last_clean":"2024-04-25T09:30:49.068489+0000","last_became_active":"2024-04-25T09:12:15.236080+0000","last_became_peered":"2024-04-25T09:12:15.236080+0000","last_unstale":"2024-04-25T09:30:49.068489+0000","last_undegraded":"2024-04-25T09:30:49.068489+0000","last_fullsized":"2024-04-25T09:30:49.068489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.107871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.107871+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1898,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.563546+0000","last_change":"2024-04-25T09:30:49.589088+0000","last_active":"2024-04-25T09:30:49.563546+0000","last_peered":"2024-04-25T09:30:49.563546+0000","last_clean":"2024-04-25T09:30:49.563546+0000","last_became_active":"2024-04-25T09:12:15.239643+0000","last_became_peered":"2024-04-25T09:12:15.239643+0000","last_unstale":"2024-04-25T09:30:49.563546+0000","last_undegraded":"2024-04-25T09:30:49.563546+0000","last_fullsized":"2024-04-25T09:30:49.563546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.588891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.588891+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1894,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.068492+0000","last_change":"2024-04-25T09:30:49.077618+0000","last_active":"2024-04-25T09:30:49.068492+0000","last_peered":"2024-04-25T09:30:49.068492+0000","last_clean":"2024-04-25T09:30:49.068492+0000","last_became_active":"2024-04-25T09:12:15.241282+0000","last_became_peered":"2024-04-25T09:12:15.241282+0000","last_unstale":"2024-04-25T09:30:49.068492+0000","last_undegraded":"2024-04-25T09:30:49.068492+0000","last_fullsized":"2024-04-25T09:30:49.068492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.077436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.077436+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1898,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.565022+0000","last_change":"2024-04-25T09:30:49.592344+0000","last_active":"2024-04-25T09:30:49.565022+0000","last_peered":"2024-04-25T09:30:49.565022+0000","last_clean":"2024-04-25T09:30:49.565022+0000","last_became_active":"2024-04-25T09:12:15.252630+0000","last_became_peered":"2024-04-25T09:12:15.252630+0000","last_unstale":"2024-04-25T09:30:49.565022+0000","last_undegraded":"2024-04-25T09:30:49.565022+0000","last_fullsized":"2024-04-25T09:30:49.565022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:30:49.592171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:49.592171+0000","last_clean_scrub_stamp":"2024-04-25T09:12:14.173556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2016,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.531152+0000","last_change":"2024-04-25T09:30:50.583905+0000","last_active":"2024-04-25T09:30:50.531152+0000","last_peered":"2024-04-25T09:30:50.531152+0000","last_clean":"2024-04-25T09:30:50.531152+0000","last_became_active":"2024-04-25T09:12:12.203665+0000","last_became_peered":"2024-04-25T09:12:12.203665+0000","last_unstale":"2024-04-25T09:30:50.531152+0000","last_undegraded":"2024-04-25T09:30:50.531152+0000","last_fullsized":"2024-04-25T09:30:50.531152+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'97","last_scrub_stamp":"2024-04-25T09:30:50.583704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:30:50.583704+0000","last_clean_scrub_stamp":"2024-04-25T09:12:11.160311+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79492,"kb_used_data":3964,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778108,"statfs":{"total":107374182400,"available":107292782592,"internally_reserved":0,"allocated":4059136,"data_stored":1916994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":78932,"kb_used_data":3404,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778668,"statfs":{"total":107374182400,"available":107293356032,"internally_reserved":0,"allocated":3485696,"data_stored":1315002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706802,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":66420,"kb_used_data":3372,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104791180,"statfs":{"total":107374182400,"available":107306168320,"internally_reserved":0,"allocated":3452928,"data_stored":1306158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706802,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71168,"kb_used_data":3960,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786432,"statfs":{"total":107374182400,"available":107301306368,"internally_reserved":0,"allocated":4055040,"data_stored":1897236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:31:11.206 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T09:31:11.317 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.325+0000 7fb815e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.333+0000 7fb815e6d640 1 Processor -- start 2024-04-25T09:31:11.318 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.334+0000 7fb815e6d640 1 -- start start 2024-04-25T09:31:11.321 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.335+0000 7fb815e6d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb810133090 0x7fb810137f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.335+0000 7fb815e6d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8100738f0 con 0x7fb81006e660 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.335+0000 7fb815e6d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb81009cf10 con 0x7fb810133090 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.335+0000 7fb80effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb810133090 0x7fb810137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.335+0000 7fb80f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb81006e660 0x7fb810132980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33066/0 (socket says 172.21.15.53:33066) 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.335+0000 7fb80f7fe640 1 -- 172.21.15.53:0/4283976873 learned_addr learned my addr 172.21.15.53:0/4283976873 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.336+0000 7fb80effd640 1 -- 172.21.15.53:0/4283976873 >> v1:172.21.15.53:6789/0 conn(0x7fb81006e660 legacy=0x7fb810132980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.336+0000 7fb80effd640 1 -- 172.21.15.53:0/4283976873 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81009cc40 con 0x7fb810133090 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.336+0000 7fb80e7fc640 1 -- 172.21.15.53:0/4283976873 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530577889 0 0) 0x7fb800001110 con 0x7fb81006e660 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.336+0000 7fb80effd640 1 --2- 172.21.15.53:0/4283976873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb810133090 0x7fb810137f20 crc :-1 s=READY pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bbc69d7eedbfd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.336+0000 7fb80e7fc640 1 -- 172.21.15.53:0/4283976873 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb804009d80 con 0x7fb810133090 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.336+0000 7fb80e7fc640 1 -- 172.21.15.53:0/4283976873 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb80400e230 con 0x7fb810133090 2024-04-25T09:31:11.322 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.336+0000 7fb80e7fc640 1 -- 172.21.15.53:0/4283976873 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb80400e4d0 con 0x7fb810133090 2024-04-25T09:31:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.337+0000 7fb815e6d640 1 -- 172.21.15.53:0/4283976873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb810133090 msgr2=0x7fb810137f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:31:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.337+0000 7fb815e6d640 1 --2- 172.21.15.53:0/4283976873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb810133090 0x7fb810137f20 crc :-1 s=READY pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.337+0000 7fb815e6d640 1 -- 172.21.15.53:0/4283976873 shutdown_connections 2024-04-25T09:31:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.337+0000 7fb815e6d640 1 --2- 172.21.15.53:0/4283976873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb810133090 0x7fb810137f20 unknown :-1 s=CLOSED pgs=13032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.337+0000 7fb815e6d640 1 -- 172.21.15.53:0/4283976873 >> 172.21.15.53:0/4283976873 conn(0x7fb8100a1be0 msgr2=0x7fb8100a1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:31:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.337+0000 7fb815e6d640 1 -- 172.21.15.53:0/4283976873 shutdown_connections 2024-04-25T09:31:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.337+0000 7fb815e6d640 1 -- 172.21.15.53:0/4283976873 wait complete. 2024-04-25T09:31:11.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.337+0000 7fb815e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:11.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.339+0000 7fb815e6d640 1 Processor -- start 2024-04-25T09:31:11.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.339+0000 7fb815e6d640 1 -- start start 2024-04-25T09:31:11.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.340+0000 7fb815e6d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb81006e660 0x7fb81011bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:31:11.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.340+0000 7fb815e6d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb810120050 con 0x7fb81006e660 2024-04-25T09:31:11.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.340+0000 7fb80f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb81006e660 0x7fb81011bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:31:11.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.340+0000 7fb80f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb81006e660 0x7fb81011bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:57650/0 (socket says 172.21.15.53:57650) 2024-04-25T09:31:11.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.340+0000 7fb80f7fe640 1 -- 172.21.15.53:0/1042952156 learned_addr learned my addr 172.21.15.53:0/1042952156 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-04-25T09:31:11.326 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.341+0000 7fb80f7fe640 1 -- 172.21.15.53:0/1042952156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8101300c0 con 0x7fb81006e660 2024-04-25T09:31:11.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.341+0000 7fb80f7fe640 1 --2- 172.21.15.53:0/1042952156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb81006e660 0x7fb81011bf60 crc :-1 s=READY pgs=13033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:31:11.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.341+0000 7fb7f7fff640 1 -- 172.21.15.53:0/1042952156 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb800004b80 con 0x7fb81006e660 2024-04-25T09:31:11.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.341+0000 7fb7f7fff640 1 -- 172.21.15.53:0/1042952156 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb800004ce0 con 0x7fb81006e660 2024-04-25T09:31:11.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.341+0000 7fb7f7fff640 1 -- 172.21.15.53:0/1042952156 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb800007120 con 0x7fb81006e660 2024-04-25T09:31:11.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.341+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81011e3d0 con 0x7fb81006e660 2024-04-25T09:31:11.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.341+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81011f530 con 0x7fb81006e660 2024-04-25T09:31:11.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.342+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8100692b0 con 0x7fb81006e660 2024-04-25T09:31:11.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.342+0000 7fb7f7fff640 1 -- 172.21.15.53:0/1042952156 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb8000072d0 con 0x7fb81006e660 2024-04-25T09:31:11.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.342+0000 7fb7f7fff640 1 --2- 172.21.15.53:0/1042952156 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb7fc038980 0x7fb7fc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:31:11.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.343+0000 7fb7f7fff640 1 -- 172.21.15.53:0/1042952156 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(714..714 src has 652..714) ==== 3403+0+0 (crc 0 0 0) 0x7fb800048490 con 0x7fb81006e660 2024-04-25T09:31:11.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.343+0000 7fb80effd640 1 --2- 172.21.15.53:0/1042952156 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb7fc038980 0x7fb7fc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:31:11.328 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.343+0000 7fb80effd640 1 --2- 172.21.15.53:0/1042952156 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb7fc038980 0x7fb7fc03ae90 crc :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:31:11.332 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.348+0000 7fb7f7fff640 1 -- 172.21.15.53:0/1042952156 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fb80000a650 con 0x7fb81006e660 2024-04-25T09:31:11.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.534+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb81011fe00 con 0x7fb81006e660 2024-04-25T09:31:11.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.536+0000 7fb7f7fff640 1 -- 172.21.15.53:0/1042952156 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7fb81011fe00 con 0x7fb81006e660 2024-04-25T09:31:11.522 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.537+0000 7fb7f7fff640 1 -- 172.21.15.53:0/1042952156 <== mon.0 v2:172.21.15.53:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7fb800007680 con 0x7fb81006e660 2024-04-25T09:31:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb7fc038980 msgr2=0x7fb7fc03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:31:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 --2- 172.21.15.53:0/1042952156 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb7fc038980 0x7fb7fc03ae90 crc :-1 s=READY pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb81006e660 msgr2=0x7fb81011bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:31:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 --2- 172.21.15.53:0/1042952156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb81006e660 0x7fb81011bf60 crc :-1 s=READY pgs=13033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.524 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 shutdown_connections 2024-04-25T09:31:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 --2- 172.21.15.53:0/1042952156 >> [v2:172.21.15.151:6800/1387723690,v1:172.21.15.151:6801/1387723690] conn(0x7fb7fc038980 0x7fb7fc03ae90 unknown :-1 s=CLOSED pgs=3805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 --2- 172.21.15.53:0/1042952156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb81006e660 0x7fb81011bf60 unknown :-1 s=CLOSED pgs=13033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:31:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 >> 172.21.15.53:0/1042952156 conn(0x7fb8100a1be0 msgr2=0x7fb8101baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:31:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 shutdown_connections 2024-04-25T09:31:11.525 INFO:teuthology.orchestra.run.smithi053.stderr:2024-04-25T09:31:11.539+0000 7fb815e6d640 1 -- 172.21.15.53:0/1042952156 wait complete. 2024-04-25T09:31:11.537 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T09:31:11.537 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T09:31:11.538 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T09:31:11.538 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:31:11.632 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T09:31:11.632 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T09:31:11.633 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:31:11.716 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T09:31:11.716 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T09:31:11.716 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:31:11.805 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T09:31:11.805 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T09:31:11.805 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:31:11.890 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T09:31:11.890 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T09:31:11.891 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T09:31:11.891 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:31:11.918 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T09:31:11.918 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T09:31:11.918 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T09:31:11.918 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:31:11.933 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T09:31:11.933 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T09:31:11.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-25T09:31:12.006 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-25T09:31:12.007 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T09:31:12.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi053.front.sepia.ceph.com 2024-04-25T09:31:12.188 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T09:31:12.303 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T09:31:12.304 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T09:31:12.400 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T09:31:12.400 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T09:31:12.511 INFO:tasks.ceph:Archiving mon data... 2024-04-25T09:31:12.512 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969/data/mon.a.tgz 2024-04-25T09:31:12.512 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-04-25T09:31:12.528 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.QQdbuUck6E 2024-04-25T09:31:12.528 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QQdbuUck6E 2024-04-25T09:31:12.674 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.QQdbuUck6E 2024-04-25T09:31:12.758 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.QQdbuUck6E is 345KB 2024-04-25T09:31:12.855 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.QQdbuUck6E 2024-04-25T09:31:12.870 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T09:31:12.871 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:31:12.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:31:12.991 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:31:13.007 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:31:13.007 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T09:31:13.009 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969/remote/smithi053/crash 2024-04-25T09:31:13.009 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:31:13.055 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969/remote/smithi151/crash 2024-04-25T09:31:13.056 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:31:13.098 INFO:tasks.ceph:Compressing logs... 2024-04-25T09:31:13.099 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:31:13.102 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:31:13.123 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96329.log 2024-04-25T09:31:13.123 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96757.log 2024-04-25T09:31:13.123 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94962.log 2024-04-25T09:31:13.176 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28024.log 2024-04-25T09:31:13.176 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T09:31:13.176 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T09:31:13.176 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28024.log: /var/log/ceph/ceph-osd.2.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28024.log.gz 2024-04-25T09:31:13.176 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27984.log 2024-04-25T09:31:13.176 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28064.log 2024-04-25T09:31:13.176 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.27984.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T09:31:13.176 INFO:teuthology.orchestra.run.smithi151.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.27984.log.gz 2024-04-25T09:31:13.176 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.28064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27944.log 2024-04-25T09:31:13.177 INFO:teuthology.orchestra.run.smithi151.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28064.log.gz 2024-04-25T09:31:13.177 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.27944.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.27944.log.gz 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95420.log 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96757.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96329.log.gz 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93747.log 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96757.log.gz 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.95420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95527.log 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.94962.log.gz 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97636.log 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.95527.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.97092.log 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96161.log 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.95420.log.gz 2024-04-25T09:31:13.191 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97636.log.gz 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96843.log 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97092.log.gz 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28398.log 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96161.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.93747.log.gz 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94795.log 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96161.log.gz 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.28398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97050.log 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96843.log.gz 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.28398.log.gz 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94794.log 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.94795.log.gz 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31431.log 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97050.log.gz 2024-04-25T09:31:13.192 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96888.log 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94569.log 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96888.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.95527.log.gz 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94429.log 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94794.log.gz 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96888.log.gz 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94569.log: /var/log/ceph/ceph-client.admin.94429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96086.log 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.94429.log.gz 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29432.log 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94569.log.gz 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96203.log 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.96086.log.gz 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94832.log 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.31431.log.gz 2024-04-25T09:31:13.193 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 85.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.29432.log.gz /var/log/ceph/ceph-client.admin.94200.log 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96203.log: /var/log/ceph/ceph-client.admin.94832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97386.log 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96203.log.gz 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96266.log 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94832.log.gz 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93709.log 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.97386.log.gz 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94979.log 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96266.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94200.log.gz 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93555.log 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93709.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96266.log.gz 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29573.log 2024-04-25T09:31:13.194 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93555.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.93709.log.gz 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94468.log 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29573.log.gz 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97302.log 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94570.log 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94468.log: /var/log/ceph/ceph-client.admin.97302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31527.log 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.93555.log.gz 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97302.log.gz 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93299.log 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.94468.log.gz 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93518.log 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31527.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94570.log.gz 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93299.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:31:13.195 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97596.log 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31527.log.gz 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97218.log 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93518.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.94979.log.gz 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93299.log.gz 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94568.log 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97218.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97596.log.gz 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29852.log 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97218.log.gz 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.93518.log.gz 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-client.admin.94568.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94572.log 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.29852.log: /var/log/ceph/ceph-client.admin.94571.log 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94572.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.29852.log.gz 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31450.log 2024-04-25T09:31:13.196 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94568.log.gz 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96631.log 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.94572.log.gz 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94467.log 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96631.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94571.log.gz 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96182.log 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.31450.log.gz 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94830.log 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96631.log.gz 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29390.log 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94467.log.gz 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94830.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96182.log.gz 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96224.log 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97260.log 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96224.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29390.log.gz 2024-04-25T09:31:13.197 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96418.log 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94830.log.gz 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96224.log.gz 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94721.log 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97260.log.gz 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96694.log 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94721.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96418.log.gz 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96694.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.25843.log 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94721.log.gz 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96694.log.gz 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr:gzip/var/log/ceph/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.97344.log 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.tmp-client.admin.25843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96509.log 2024-04-25T09:31:13.198 INFO:teuthology.orchestra.run.smithi053.stderr: 68.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.25843.log.gz 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31489.log 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97344.log.gz 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96509.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.96509.log.gz 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94831.log 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29348.log 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96439.log 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.94831.log.gz 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93671.log 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96245.log 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96439.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29348.log.gz 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93671.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.96439.log.gzgzip 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96465.log 2024-04-25T09:31:13.199 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94430.log 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93671.log.gz 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96465.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.96245.log.gz 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96913.log 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29744.log 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94430.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96465.log.gz 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29936.log 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31546.log 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96913.log.gz 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94430.log.gz 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29936.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29744.log.gz 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94279.log 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1%/var/log/ceph/ceph-client.admin.31546.log: -- replaced with /var/log/ceph/ceph-client.admin.29936.log.gz 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96287.log 2024-04-25T09:31:13.200 INFO:teuthology.orchestra.run.smithi053.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31546.log.gz 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95906.log 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96652.log 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7%/var/log/ceph/ceph-client.admin.95906.log: -- replaced with /var/log/ceph/ceph-client.admin.96287.log.gz 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96715.log 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96308.log 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95906.log.gz/var/log/ceph/ceph-client.admin.96652.log: 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97428.log 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96652.log.gz 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6%/var/log/ceph/ceph-client.admin.96308.log: -- replaced with /var/log/ceph/ceph-client.admin.96715.log.gz 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94466.log 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96308.log.gz 2024-04-25T09:31:13.201 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31565.log 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97428.log: /var/log/ceph/ceph-client.admin.94466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28242.log 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31565.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97428.log.gz 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95939.log 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94466.log.gz 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.31489.log.gz 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.28242.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.28242.log.gz 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95739.log 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.95939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29474.log 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.95739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31397.log 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29474.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29474.log.gz 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29575.log 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.31397.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.31397.log.gz 2024-04-25T09:31:13.202 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96374.log 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.95739.log.gz 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29575.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29575.log.gz 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94425.log 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93865.log 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96374.log.gz 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.94279.log.gz 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94425.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.94425.log.gz 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30155.log 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96778.log 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96937.log 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96778.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96778.log.gz 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93215.log 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96937.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.96937.log.gz 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97512.log 2024-04-25T09:31:13.203 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93215.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.95939.log.gz 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96799.log 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97512.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.93865.log.gz 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97512.log.gz 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94517.log 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93814.log 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94517.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96799.log.gz 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96864.log 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94517.log.gz 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94654.log 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96864.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.30155.log.gz 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96864.log.gz 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94431.log 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.93814.log.gz/var/log/ceph/ceph-client.admin.94654.log: 2024-04-25T09:31:13.204 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29298.log 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97554.log 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94654.log.gz 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29298.log: 90.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96605.log 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94431.log.gz 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29298.log.gz 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28427.log 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97554.log.gz 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30624.log 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1%/var/log/ceph/ceph-client.admin.28427.log: -- replaced with /var/log/ceph/ceph-client.admin.96605.log.gz 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96820.log 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28427.log.gz 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.30624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96736.log 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96820.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96820.log.gz 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94653.log 2024-04-25T09:31:13.205 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94519.log 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94653.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96736.log.gz 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94655.log 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94653.log.gz/var/log/ceph/ceph-client.admin.94519.log: 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94519.log.gz 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29574.log 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97134.log 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29574.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29574.log.gz 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94655.log.gz 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29743.log 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96581.log 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97134.log.gz 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29743.log: 87.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94915.log 2024-04-25T09:31:13.206 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29743.log.gz 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96581.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.96581.log.gz 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29576.log 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96136.log 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29576.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29576.log.gz 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94915.log.gz 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29242.log 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94518.log 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29242.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96136.log.gz 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.93215.log.gz 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29242.log.gz 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94758.log 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96533.log 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94518.log: gzip -5/var/log/ceph/ceph-client.admin.94758.log: --verbose -- /var/log/ceph/ceph-client.admin.95191.log 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96533.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.94758.log.gz 2024-04-25T09:31:13.207 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96533.log.gz 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28163.log 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94518.log.gz 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.95191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94722.log 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96373.log 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.28163.log: /var/log/ceph/ceph-client.admin.94722.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.28163.log.gz 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97470.log 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94722.log.gz 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.30624.log.gz 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94757.log 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr: 87.6%/var/log/ceph/ceph-client.admin.97470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29741.log 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96373.log.gz/var/log/ceph/ceph-client.admin.94757.log: 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.97470.log.gz 2024-04-25T09:31:13.208 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93690.log 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29741.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94757.log.gz 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96464.log 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29741.log.gz 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96112.log 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97176.log 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96112.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93690.log.gz 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96464.log.gz 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:gzip 85.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.94883.log 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96112.log.gz 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.97176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93728.log 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97176.log.gz/var/log/ceph/ceph-client.admin.94883.log: 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96673.log 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96555.log 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94883.log.gz 2024-04-25T09:31:13.209 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93728.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95191.log.gz 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96673.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96673.log.gz 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93728.log.gz 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93337.log 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29742.log 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96555.log.gz 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.93337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29894.log 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95238.log 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29742.log.gz 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.29894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96350.log 85.6% -- replaced with /var/log/ceph/ceph-client.admin.29894.log.gz 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.95238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94406.log 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.96350.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.93337.log.gz 2024-04-25T09:31:13.210 INFO:teuthology.orchestra.run.smithi053.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96350.log.gz 2024-04-25T09:31:13.211 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.94406.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.94406.log.gz 2024-04-25T09:31:13.211 INFO:teuthology.orchestra.run.smithi053.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.95238.log.gz 2024-04-25T09:31:13.380 INFO:teuthology.orchestra.run.smithi151.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T09:31:13.608 INFO:teuthology.orchestra.run.smithi053.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31565.log.gz 2024-04-25T09:31:14.677 INFO:teuthology.orchestra.run.smithi053.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T09:31:17.695 INFO:teuthology.orchestra.run.smithi151.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T09:31:17.941 INFO:teuthology.orchestra.run.smithi151.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T09:31:17.943 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-04-25T09:31:17.943 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m4.782s 2024-04-25T09:31:17.943 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m9.100s 2024-04-25T09:31:17.943 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.410s 2024-04-25T09:31:18.026 INFO:teuthology.orchestra.run.smithi053.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T09:31:18.955 INFO:teuthology.orchestra.run.smithi053.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T09:31:18.957 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-04-25T09:31:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m5.843s 2024-04-25T09:31:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m12.386s 2024-04-25T09:31:18.957 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.546s 2024-04-25T09:31:18.957 INFO:tasks.ceph:Archiving logs... 2024-04-25T09:31:18.958 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969/remote/smithi053/log 2024-04-25T09:31:18.959 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:31:21.071 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969/remote/smithi151/log 2024-04-25T09:31:21.072 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:31:22.580 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T09:31:22.589 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T09:31:22.589 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:31:22.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:31:22.674 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T09:31:22.684 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T09:31:22.684 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:31:22.687 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:31:22.701 INFO:teuthology.orchestra.run.smithi053.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:31:22.703 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:31:22.707 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:31:22.707 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2024-04-25T09:31:22.707 INFO:teuthology.orchestra.run.smithi053.stdout:^- hv01.front.sepia.ceph.com 2 6 377 8 +1802us[+1796us] +/- 685ms 2024-04-25T09:31:22.707 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv02.front.sepia.ceph.com 3 6 377 6 -848us[ -854us] +/- 57ms 2024-04-25T09:31:22.707 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +1035us[+1029us] +/- 65ms 2024-04-25T09:31:22.707 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:31:22.709 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:31:22.709 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-04-25T09:31:22.709 INFO:teuthology.orchestra.run.smithi151.stdout:^- hv01.front.sepia.ceph.com 2 6 377 7 +1768us[+1789us] +/- 685ms 2024-04-25T09:31:22.709 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv02.front.sepia.ceph.com 3 6 377 5 -873us[ -852us] +/- 57ms 2024-04-25T09:31:22.709 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +1012us[+1033us] +/- 65ms 2024-04-25T09:31:22.709 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:31:22.710 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T09:31:22.721 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T09:31:22.721 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T09:31:22.730 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T09:31:22.818 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T09:31:22.883 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T09:31:22.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:31:22.914 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T09:31:22.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:31:22.943 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T09:31:22.952 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T09:31:22.960 INFO:teuthology.task.internal:Duration was 1580.134698 seconds 2024-04-25T09:31:22.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T09:31:22.969 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T09:31:22.969 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:31:22.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:31:23.011 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:31:23.022 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:31:23.316 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T09:31:23.317 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-04-25T09:31:23.317 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:31:23.340 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-04-25T09:31:23.340 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:31:23.383 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T09:31:23.383 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:31:23.385 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:31:23.451 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T09:31:23.451 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:31:23.455 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:31:23.586 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T09:31:23.597 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T09:31:23.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:31:23.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:31:23.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T09:31:23.657 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:31:23.665 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:31:23.686 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-04-25T09:31:23.709 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-04-25T09:31:23.732 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:31:23.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:31:23.756 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:31:23.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:31:23.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T09:31:23.795 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T09:31:23.796 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969/remote/smithi053 2024-04-25T09:31:23.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:31:23.829 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672969/remote/smithi151 2024-04-25T09:31:23.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:31:23.861 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T09:31:23.861 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:31:23.865 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:31:23.910 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T09:31:23.922 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T09:31:23.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T09:31:23.933 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T09:31:23.933 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:31:23.936 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:31:23.949 INFO:teuthology.orchestra.run.smithi053.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:31 /home/ubuntu/cephtest 2024-04-25T09:31:23.965 INFO:teuthology.orchestra.run.smithi151.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:31 /home/ubuntu/cephtest 2024-04-25T09:31:23.966 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T09:31:23.976 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T09:31:23.999 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 1580.1346981525421 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-04-25T09:31:23.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:31:24.086 INFO:teuthology.run:pass